Nov 08 03:45:15 user nova-compute[75014]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75014) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75014) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75014) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 08 03:45:15 user nova-compute[75014]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:45:15 user nova-compute[75014]: INFO nova.virt.driver [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 08 03:45:15 user nova-compute[75014]: INFO nova.compute.provider_config [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] Acquiring lock "singleton_lock" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] Acquired lock "singleton_lock" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] Releasing lock "singleton_lock" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] Full set of CONF: {{(pid=75014) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ******************************************************************************** {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] Configuration options gathered from: {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ================================================================================ {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] allow_resize_to_same_host      = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] arq_binding_timeout            = 300 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] backdoor_port                  = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] backdoor_socket                = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] block_device_allocate_retries  = 300 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] block_device_allocate_retries_interval = 5 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cert                           = self.pem {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] compute_monitors               = [] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] config_dir                     = [] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] config_drive_format            = iso9660 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] config_source                  = [] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] console_host                   = user {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] control_exchange               = nova {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cpu_allocation_ratio           = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] daemon                         = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] debug                          = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] default_access_ip_network_name = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] default_availability_zone      = nova {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] default_ephemeral_format       = ext4 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] default_green_pool_size        = 1000 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] default_schedule_zone          = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] disk_allocation_ratio          = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] enable_new_services            = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] enabled_ssl_apis               = [] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] flat_injected                  = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] force_config_drive             = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] force_raw_images               = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] graceful_shutdown_timeout      = 5 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] heal_instance_info_cache_interval = 60 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] host                           = user {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] instance_build_timeout         = 0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] instance_delete_interval       = 300 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] instance_name_template         = instance-%08x {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] instance_usage_audit           = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] instance_usage_audit_period    = month {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] internal_service_availability_zone = internal {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] key                            = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] live_migration_retry_count     = 30 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] log_config_append              = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] log_dir                        = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] log_file                       = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] log_options                    = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] log_rotate_interval            = 1 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] log_rotate_interval_type       = days {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] log_rotation_type              = none {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] long_rpc_timeout               = 1800 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] max_concurrent_builds          = 10 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] max_concurrent_live_migrations = 1 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] max_concurrent_snapshots       = 5 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] max_local_block_devices        = 3 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] max_logfile_count              = 30 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] max_logfile_size_mb            = 200 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] maximum_instance_delete_attempts = 5 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] metadata_listen                = 0.0.0.0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] metadata_listen_port           = 8775 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] metadata_workers               = 3 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] migrate_max_retries            = -1 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] mkisofs_cmd                    = genisoimage {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] my_ip                          = 10.0.0.210 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] network_allocate_retries       = 0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] osapi_compute_listen_port      = 8774 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] osapi_compute_unique_server_name_scope =  {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] osapi_compute_workers          = 3 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] password_length                = 12 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] periodic_enable                = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] periodic_fuzzy_delay           = 60 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] pointer_model                  = ps2mouse {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] preallocate_images             = none {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] publish_errors                 = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] pybasedir                      = /opt/stack/nova {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ram_allocation_ratio           = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] rate_limit_burst               = 0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] rate_limit_except_level        = CRITICAL {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] rate_limit_interval            = 0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] reboot_timeout                 = 0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] reclaim_instance_interval      = 0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] record                         = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] reimage_timeout_per_gb         = 60 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] report_interval                = 120 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] rescue_timeout                 = 0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] reserved_host_cpus             = 0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] reserved_host_disk_mb          = 0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] reserved_host_memory_mb        = 512 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] reserved_huge_pages            = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] resize_confirm_window          = 0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] resize_fs_using_block_device   = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] resume_guests_state_on_host_boot = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] rpc_response_timeout           = 60 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] run_external_periodic_tasks    = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] running_deleted_instance_action = reap {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] running_deleted_instance_timeout = 0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] scheduler_instance_sync_interval = 120 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] service_down_time              = 720 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] servicegroup_driver            = db {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] shelved_offload_time           = 0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] shelved_poll_interval          = 3600 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] shutdown_timeout               = 0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] source_is_ipv6                 = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ssl_only                       = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] state_path                     = /opt/stack/data/nova {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] sync_power_state_interval      = 600 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] sync_power_state_pool_size     = 1000 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] syslog_log_facility            = LOG_USER {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] tempdir                        = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] timeout_nbd                    = 10 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] transport_url                  = **** {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] update_resources_interval      = 0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] use_cow_images                 = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] use_eventlog                   = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] use_journal                    = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] use_json                       = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] use_rootwrap_daemon            = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] use_stderr                     = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] use_syslog                     = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vcpu_pin_set                   = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vif_plugging_is_fatal          = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vif_plugging_timeout           = 0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] virt_mkfs                      = [] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] volume_usage_poll_interval     = 0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] watch_log_file                 = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] web                            = /usr/share/spice-html5 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_concurrency.disable_process_locking = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api.auth_strategy              = keystone {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api.compute_link_prefix        = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api.dhcp_domain                = novalocal {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api.enable_instance_password   = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api.glance_link_prefix         = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api.instance_list_per_project_cells = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api.list_records_by_skipping_down_cells = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api.local_metadata_per_cell    = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api.max_limit                  = 1000 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api.metadata_cache_expiration  = 15 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api.neutron_default_tenant_id  = default {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api.use_forwarded_for          = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api.use_neutron_default_nets   = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api.vendordata_dynamic_targets = [] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api.vendordata_jsonfile_path   = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cache.backend_argument         = **** {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cache.config_prefix            = cache.oslo {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cache.dead_timeout             = 60.0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cache.debug_cache_backend      = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cache.enable_retry_client      = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cache.enable_socket_keepalive  = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cache.enabled                  = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cache.expiration_time          = 600 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cache.hashclient_retry_attempts = 2 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cache.memcache_dead_retry      = 300 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cache.memcache_password        =  {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cache.memcache_sasl_enabled    = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cache.memcache_username        =  {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cache.proxies                  = [] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cache.retry_attempts           = 2 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cache.retry_delay              = 0.0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cache.socket_keepalive_count   = 1 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cache.socket_keepalive_idle    = 1 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cache.socket_keepalive_interval = 1 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cache.tls_allowed_ciphers      = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cache.tls_cafile               = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cache.tls_certfile             = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cache.tls_enabled              = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cache.tls_keyfile              = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cinder.auth_section            = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cinder.auth_type               = password {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cinder.cafile                  = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cinder.certfile                = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cinder.collect_timing          = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cinder.cross_az_attach         = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cinder.debug                   = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cinder.endpoint_template       = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cinder.http_retries            = 3 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cinder.insecure                = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cinder.keyfile                 = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cinder.os_region_name          = RegionOne {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cinder.split_loggers           = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cinder.timeout                 = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] compute.cpu_dedicated_set      = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] compute.cpu_shared_set         = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] compute.image_type_exclude_list = [] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] compute.resource_provider_association_refresh = 300 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] compute.shutdown_retry_interval = 10 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] conductor.workers              = 3 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] console.allowed_origins        = [] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] console.ssl_ciphers            = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] console.ssl_minimum_version    = default {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] consoleauth.token_ttl          = 600 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cyborg.cafile                  = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cyborg.certfile                = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cyborg.collect_timing          = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cyborg.connect_retries         = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cyborg.connect_retry_delay     = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cyborg.endpoint_override       = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cyborg.insecure                = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cyborg.keyfile                 = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cyborg.max_version             = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cyborg.min_version             = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cyborg.region_name             = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cyborg.service_name            = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cyborg.service_type            = accelerator {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cyborg.split_loggers           = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cyborg.status_code_retries     = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cyborg.status_code_retry_delay = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cyborg.timeout                 = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] cyborg.version                 = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] database.backend               = sqlalchemy {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] database.connection            = **** {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] database.connection_debug      = 0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] database.connection_parameters =  {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] database.connection_recycle_time = 3600 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] database.connection_trace      = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] database.db_inc_retry_interval = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] database.db_max_retries        = 20 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] database.db_max_retry_interval = 10 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] database.db_retry_interval     = 1 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] database.max_overflow          = 50 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] database.max_pool_size         = 5 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] database.max_retries           = 10 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] database.mysql_wsrep_sync_wait = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] database.pool_timeout          = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] database.retry_interval        = 10 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] database.slave_connection      = **** {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] database.sqlite_synchronous    = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api_database.backend           = sqlalchemy {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api_database.connection        = **** {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api_database.connection_debug  = 0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api_database.connection_parameters =  {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api_database.connection_recycle_time = 3600 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api_database.connection_trace  = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api_database.db_inc_retry_interval = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api_database.db_max_retries    = 20 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api_database.db_max_retry_interval = 10 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api_database.db_retry_interval = 1 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api_database.max_overflow      = 50 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api_database.max_pool_size     = 5 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api_database.max_retries       = 10 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api_database.pool_timeout      = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api_database.retry_interval    = 10 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api_database.slave_connection  = **** {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] api_database.sqlite_synchronous = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] devices.enabled_mdev_types     = [] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ephemeral_storage_encryption.enabled = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] glance.api_servers             = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] glance.cafile                  = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] glance.certfile                = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] glance.collect_timing          = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] glance.connect_retries         = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] glance.connect_retry_delay     = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] glance.debug                   = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] glance.default_trusted_certificate_ids = [] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] glance.enable_certificate_validation = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] glance.enable_rbd_download     = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] glance.endpoint_override       = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] glance.insecure                = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] glance.keyfile                 = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] glance.max_version             = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] glance.min_version             = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] glance.num_retries             = 3 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] glance.rbd_ceph_conf           =  {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] glance.rbd_connect_timeout     = 5 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] glance.rbd_pool                =  {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] glance.rbd_user                =  {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] glance.region_name             = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] glance.service_name            = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] glance.service_type            = image {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] glance.split_loggers           = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] glance.status_code_retries     = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] glance.status_code_retry_delay = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] glance.timeout                 = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] glance.verify_glance_signatures = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] glance.version                 = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] guestfs.debug                  = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] hyperv.config_drive_cdrom      = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] hyperv.config_drive_inject_password = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] hyperv.enable_remotefx         = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] hyperv.instances_path_share    =  {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] hyperv.limit_cpu_features      = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] hyperv.use_multipath_io        = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] hyperv.vswitch_name            = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] mks.enabled                    = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] image_cache.manager_interval   = 2400 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] image_cache.precache_concurrency = 1 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] image_cache.remove_unused_base_images = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] image_cache.subdirectory_name  = _base {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ironic.api_max_retries         = 60 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ironic.api_retry_interval      = 2 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ironic.auth_section            = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ironic.auth_type               = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ironic.cafile                  = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ironic.certfile                = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ironic.collect_timing          = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ironic.conductor_group         = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ironic.connect_retries         = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ironic.connect_retry_delay     = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ironic.endpoint_override       = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ironic.insecure                = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ironic.keyfile                 = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ironic.max_version             = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ironic.min_version             = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ironic.peer_list               = [] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ironic.region_name             = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ironic.serial_console_state_timeout = 10 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ironic.service_name            = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ironic.service_type            = baremetal {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ironic.split_loggers           = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ironic.status_code_retries     = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ironic.status_code_retry_delay = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ironic.timeout                 = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ironic.version                 = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] key_manager.fixed_key          = **** {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] barbican.barbican_api_version  = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] barbican.barbican_endpoint     = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] barbican.barbican_endpoint_type = public {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] barbican.barbican_region_name  = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] barbican.cafile                = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] barbican.certfile              = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] barbican.collect_timing        = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] barbican.insecure              = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] barbican.keyfile               = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] barbican.number_of_retries     = 60 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] barbican.retry_delay           = 1 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] barbican.send_service_user_token = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] barbican.split_loggers         = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] barbican.timeout               = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] barbican.verify_ssl            = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] barbican.verify_ssl_path       = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] barbican_service_user.auth_section = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] barbican_service_user.auth_type = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] barbican_service_user.cafile   = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] barbican_service_user.certfile = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] barbican_service_user.collect_timing = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] barbican_service_user.insecure = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] barbican_service_user.keyfile  = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] barbican_service_user.split_loggers = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] barbican_service_user.timeout  = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vault.approle_role_id          = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vault.approle_secret_id        = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vault.cafile                   = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vault.certfile                 = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vault.collect_timing           = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vault.insecure                 = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vault.keyfile                  = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vault.kv_mountpoint            = secret {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vault.kv_path                  = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vault.kv_version               = 2 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vault.namespace                = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vault.root_token_id            = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vault.split_loggers            = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vault.ssl_ca_crt_file          = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vault.timeout                  = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vault.use_ssl                  = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] keystone.auth_section          = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] keystone.auth_type             = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] keystone.cafile                = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] keystone.certfile              = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] keystone.collect_timing        = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] keystone.connect_retries       = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] keystone.connect_retry_delay   = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] keystone.endpoint_override     = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] keystone.insecure              = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] keystone.keyfile               = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] keystone.max_version           = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] keystone.min_version           = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] keystone.region_name           = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] keystone.service_name          = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] keystone.service_type          = identity {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] keystone.split_loggers         = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] keystone.status_code_retries   = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] keystone.status_code_retry_delay = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] keystone.timeout               = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] keystone.version               = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.connection_uri         =  {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.cpu_mode               = custom {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: WARNING oslo_config.cfg [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.cpu_power_governor_high = performance {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.cpu_power_management   = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.device_detach_attempts = 8 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.device_detach_timeout  = 20 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.disk_cachemodes        = [] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.disk_prefix            = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.enabled_perf_events    = [] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.file_backed_memory     = 0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.gid_maps               = [] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.hw_disk_discard        = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.hw_machine_type        = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.images_rbd_pool        = rbd {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.images_type            = default {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.images_volume_group    = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.inject_key             = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.inject_partition       = -2 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.inject_password        = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.iscsi_iface            = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.iser_use_multipath     = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.live_migration_downtime = 500 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.live_migration_inbound_addr = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.live_migration_scheme  = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.live_migration_timeout_action = abort {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.live_migration_tunnelled = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: WARNING oslo_config.cfg [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 08 03:45:15 user nova-compute[75014]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 08 03:45:15 user nova-compute[75014]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 08 03:45:15 user nova-compute[75014]: and ``live_migration_inbound_addr`` respectively.
Nov 08 03:45:15 user nova-compute[75014]: ).  Its value may be silently ignored in the future.
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.live_migration_with_native_tls = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.max_queues             = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.nfs_mount_options      = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.num_pcie_ports         = 0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.pmem_namespaces        = [] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.quobyte_client_cfg     = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.rbd_secret_uuid        = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.rbd_user               = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.rescue_image_id        = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.rescue_kernel_id       = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.rx_queue_size          = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.smbfs_mount_options    =  {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.snapshot_compression   = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.snapshot_image_format  = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.sparse_logical_volumes = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.swtpm_enabled          = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.swtpm_group            = tss {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.swtpm_user             = tss {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.sysinfo_serial         = unique {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.tb_cache_size          = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.tx_queue_size          = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.uid_maps               = [] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.use_virtio_for_bridges = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.virt_type              = kvm {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.volume_clear           = zero {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.volume_clear_size      = 0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.volume_use_multipath   = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.vzstorage_cache_path   = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] neutron.auth_section           = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] neutron.auth_type              = password {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] neutron.cafile                 = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] neutron.certfile               = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] neutron.collect_timing         = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] neutron.connect_retries        = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] neutron.connect_retry_delay    = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] neutron.default_floating_pool  = public {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] neutron.endpoint_override      = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] neutron.extension_sync_interval = 600 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] neutron.http_retries           = 3 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] neutron.insecure               = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] neutron.keyfile                = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] neutron.max_version            = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] neutron.min_version            = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] neutron.ovs_bridge             = br-int {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] neutron.physnets               = [] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] neutron.region_name            = RegionOne {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] neutron.service_metadata_proxy = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] neutron.service_name           = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] neutron.service_type           = network {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] neutron.split_loggers          = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] neutron.status_code_retries    = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] neutron.status_code_retry_delay = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] neutron.timeout                = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] neutron.version                = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] notifications.bdms_in_notifications = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] notifications.default_level    = INFO {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] notifications.notification_format = unversioned {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] notifications.notify_on_state_change = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] pci.alias                      = [] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] pci.device_spec                = [] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] pci.report_in_placement        = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.auth_section         = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.auth_type            = password {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.cafile               = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.certfile             = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.collect_timing       = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.connect_retries      = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.connect_retry_delay  = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.default_domain_id    = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.default_domain_name  = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.domain_id            = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.domain_name          = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.endpoint_override    = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.insecure             = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.keyfile              = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.max_version          = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.min_version          = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.password             = **** {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.project_domain_id    = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.project_domain_name  = Default {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.project_id           = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.project_name         = service {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.region_name          = RegionOne {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.service_name         = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.service_type         = placement {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.split_loggers        = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.status_code_retries  = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.status_code_retry_delay = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.system_scope         = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.timeout              = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.trust_id             = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.user_domain_id       = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.user_domain_name     = Default {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.user_id              = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.username             = placement {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] placement.version              = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] quota.cores                    = 20 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] quota.count_usage_from_placement = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] quota.injected_file_content_bytes = 10240 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] quota.injected_file_path_length = 255 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] quota.injected_files           = 5 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] quota.instances                = 10 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] quota.key_pairs                = 100 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] quota.metadata_items           = 128 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] quota.ram                      = 51200 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] quota.recheck_quota            = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] quota.server_group_members     = 10 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] quota.server_groups            = 10 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] rdp.enabled                    = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] scheduler.image_metadata_prefilter = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] scheduler.max_attempts         = 3 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] scheduler.max_placement_results = 1000 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] scheduler.workers              = 3 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] filter_scheduler.host_subset_size = 1 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] filter_scheduler.isolated_hosts = [] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] filter_scheduler.isolated_images = [] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] filter_scheduler.pci_in_placement = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] filter_scheduler.track_instance_changes = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] metrics.required               = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] metrics.weight_multiplier      = 1.0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] metrics.weight_setting         = [] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] serial_console.enabled         = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] serial_console.port_range      = 10000:20000 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] serial_console.serialproxy_port = 6083 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] service_user.auth_section      = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] service_user.auth_type         = password {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] service_user.cafile            = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] service_user.certfile          = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] service_user.collect_timing    = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] service_user.insecure          = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] service_user.keyfile           = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] service_user.send_service_user_token = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] service_user.split_loggers     = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] service_user.timeout           = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] spice.agent_enabled            = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] spice.enabled                  = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] spice.html5proxy_port          = 6082 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] spice.image_compression        = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] spice.jpeg_compression         = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] spice.playback_compression     = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] spice.server_listen            = 127.0.0.1 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] spice.streaming_mode           = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] spice.zlib_compression         = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] upgrade_levels.baseapi         = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] upgrade_levels.cert            = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] upgrade_levels.compute         = auto {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] upgrade_levels.conductor       = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] upgrade_levels.scheduler       = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vendordata_dynamic_auth.cafile = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vendordata_dynamic_auth.certfile = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vendordata_dynamic_auth.insecure = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vendordata_dynamic_auth.timeout = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vmware.api_retry_count         = 10 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vmware.ca_file                 = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vmware.cache_prefix            = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vmware.cluster_name            = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vmware.connection_pool_size    = 10 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vmware.console_delay_seconds   = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vmware.datastore_regex         = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vmware.host_ip                 = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vmware.host_password           = **** {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vmware.host_port               = 443 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vmware.host_username           = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vmware.insecure                = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vmware.integration_bridge      = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vmware.maximum_objects         = 100 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vmware.pbm_default_policy      = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vmware.pbm_enabled             = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vmware.pbm_wsdl_location       = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vmware.serial_port_proxy_uri   = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vmware.serial_port_service_uri = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vmware.task_poll_interval      = 0.5 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vmware.use_linked_clone        = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vmware.vnc_keymap              = en-us {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vmware.vnc_port                = 5900 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vmware.vnc_port_total          = 10000 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vnc.auth_schemes               = ['none'] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vnc.enabled                    = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vnc.novncproxy_port            = 6080 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vnc.vencrypt_ca_certs          = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vnc.vencrypt_client_cert       = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vnc.vencrypt_client_key        = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] workarounds.disable_rootwrap   = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] workarounds.enable_numa_live_migration = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] workarounds.libvirt_disable_apic = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] wsgi.client_socket_timeout     = 900 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] wsgi.default_pool_size         = 1000 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] wsgi.keep_alive                = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] wsgi.max_header_line           = 16384 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] wsgi.ssl_ca_file               = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] wsgi.ssl_cert_file             = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] wsgi.ssl_key_file              = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] wsgi.tcp_keepidle              = 600 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] zvm.ca_file                    = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] zvm.cloud_connector_url        = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] zvm.reachable_timeout          = 300 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_policy.enforce_new_defaults = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_policy.enforce_scope      = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_policy.policy_default_rule = default {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] profiler.connection_string     = messaging:// {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] profiler.enabled               = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] profiler.es_doc_type           = notification {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] profiler.es_scroll_size        = 10000 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] profiler.es_scroll_time        = 2m {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] profiler.filter_error_trace    = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] profiler.hmac_keys             = **** {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] profiler.sentinel_service_name = mymaster {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] profiler.socket_timeout        = 0.1 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] profiler.trace_requests        = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] profiler.trace_sqlalchemy      = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] profiler_jaeger.process_tags   = {} {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] profiler_jaeger.service_name_prefix = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] profiler_otlp.service_name_prefix = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] remote_debug.host              = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] remote_debug.port              = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_notifications.retry = -1 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_limit.auth_section        = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_limit.auth_type           = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_limit.cafile              = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_limit.certfile            = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_limit.collect_timing      = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_limit.connect_retries     = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_limit.connect_retry_delay = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_limit.endpoint_id         = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_limit.endpoint_override   = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_limit.insecure            = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_limit.keyfile             = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_limit.max_version         = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_limit.min_version         = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_limit.region_name         = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_limit.service_name        = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_limit.service_type        = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_limit.split_loggers       = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_limit.status_code_retries = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_limit.status_code_retry_delay = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_limit.timeout             = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_limit.valid_interfaces    = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_limit.version             = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_reports.file_event_handler = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] oslo_reports.log_dir           = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vif_plug_ovs_privileged.group  = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] vif_plug_ovs_privileged.user   = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] os_vif_ovs.isolate_vif         = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] os_brick.lock_path             = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] privsep_osbrick.capabilities   = [21] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] privsep_osbrick.group          = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] privsep_osbrick.helper_command = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] privsep_osbrick.user           = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] nova_sys_admin.group           = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] nova_sys_admin.helper_command  = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] nova_sys_admin.user            = None {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG oslo_service.service [None req-033b80d0-d255-49f4-82ac-a180f3fc9fe8 None None] ******************************************************************************** {{(pid=75014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 08 03:45:15 user nova-compute[75014]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 08 03:45:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Connecting to libvirt: qemu:///system {{(pid=75014) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f0421487550> {{(pid=75014) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 08 03:45:15 user nova-compute[75014]: libvirt:  error : internal error: could not initialize domain event timer
Nov 08 03:45:15 user nova-compute[75014]: WARNING nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 08 03:45:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f0421487550> {{(pid=75014) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Starting native event thread {{(pid=75014) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Starting green dispatch thread {{(pid=75014) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 08 03:45:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Starting connection event dispatch thread {{(pid=75014) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 08 03:45:15 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Connection event '1' reason 'None'
Nov 08 03:45:16 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 08 03:45:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.mount [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Initialising _HostMountState generation 0 {{(pid=75014) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 08 03:45:23 user nova-compute[75014]: INFO nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Libvirt host capabilities <capabilities>
Nov 08 03:45:23 user nova-compute[75014]:   <host>
Nov 08 03:45:23 user nova-compute[75014]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 08 03:45:23 user nova-compute[75014]:     <cpu>
Nov 08 03:45:23 user nova-compute[75014]:       <arch>x86_64</arch>
Nov 08 03:45:23 user nova-compute[75014]:       <model>IvyBridge-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <vendor>Intel</vendor>
Nov 08 03:45:23 user nova-compute[75014]:       <microcode version='1070'/>
Nov 08 03:45:23 user nova-compute[75014]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 08 03:45:23 user nova-compute[75014]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature name='ss'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature name='vmx'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature name='pcid'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature name='osxsave'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature name='hypervisor'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature name='arat'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature name='tsc_adjust'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature name='md-clear'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature name='stibp'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature name='arch-capabilities'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature name='ssbd'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature name='invtsc'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature name='rsba'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature name='skip-l1dfl-vmentry'/>
Nov 08 03:45:23 user nova-compute[75014]:       <pages unit='KiB' size='4'/>
Nov 08 03:45:23 user nova-compute[75014]:       <pages unit='KiB' size='2048'/>
Nov 08 03:45:23 user nova-compute[75014]:     </cpu>
Nov 08 03:45:23 user nova-compute[75014]:     <power_management>
Nov 08 03:45:23 user nova-compute[75014]:       <suspend_mem/>
Nov 08 03:45:23 user nova-compute[75014]:       <suspend_disk/>
Nov 08 03:45:23 user nova-compute[75014]:       <suspend_hybrid/>
Nov 08 03:45:23 user nova-compute[75014]:     </power_management>
Nov 08 03:45:23 user nova-compute[75014]:     <iommu support='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     <migration_features>
Nov 08 03:45:23 user nova-compute[75014]:       <live/>
Nov 08 03:45:23 user nova-compute[75014]:       <uri_transports>
Nov 08 03:45:23 user nova-compute[75014]:         <uri_transport>tcp</uri_transport>
Nov 08 03:45:23 user nova-compute[75014]:         <uri_transport>rdma</uri_transport>
Nov 08 03:45:23 user nova-compute[75014]:       </uri_transports>
Nov 08 03:45:23 user nova-compute[75014]:     </migration_features>
Nov 08 03:45:23 user nova-compute[75014]:     <topology>
Nov 08 03:45:23 user nova-compute[75014]:       <cells num='2'>
Nov 08 03:45:23 user nova-compute[75014]:         <cell id='0'>
Nov 08 03:45:23 user nova-compute[75014]:           <memory unit='KiB'>8140616</memory>
Nov 08 03:45:23 user nova-compute[75014]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 08 03:45:23 user nova-compute[75014]:           <pages unit='KiB' size='2048'>0</pages>
Nov 08 03:45:23 user nova-compute[75014]:           <distances>
Nov 08 03:45:23 user nova-compute[75014]:             <sibling id='0' value='10'/>
Nov 08 03:45:23 user nova-compute[75014]:             <sibling id='1' value='20'/>
Nov 08 03:45:23 user nova-compute[75014]:           </distances>
Nov 08 03:45:23 user nova-compute[75014]:           <cpus num='6'>
Nov 08 03:45:23 user nova-compute[75014]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 08 03:45:23 user nova-compute[75014]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 08 03:45:23 user nova-compute[75014]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 08 03:45:23 user nova-compute[75014]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 08 03:45:23 user nova-compute[75014]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 08 03:45:23 user nova-compute[75014]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 08 03:45:23 user nova-compute[75014]:           </cpus>
Nov 08 03:45:23 user nova-compute[75014]:         </cell>
Nov 08 03:45:23 user nova-compute[75014]:         <cell id='1'>
Nov 08 03:45:23 user nova-compute[75014]:           <memory unit='KiB'>8255068</memory>
Nov 08 03:45:23 user nova-compute[75014]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 08 03:45:23 user nova-compute[75014]:           <pages unit='KiB' size='2048'>0</pages>
Nov 08 03:45:23 user nova-compute[75014]:           <distances>
Nov 08 03:45:23 user nova-compute[75014]:             <sibling id='0' value='20'/>
Nov 08 03:45:23 user nova-compute[75014]:             <sibling id='1' value='10'/>
Nov 08 03:45:23 user nova-compute[75014]:           </distances>
Nov 08 03:45:23 user nova-compute[75014]:           <cpus num='6'>
Nov 08 03:45:23 user nova-compute[75014]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 08 03:45:23 user nova-compute[75014]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 08 03:45:23 user nova-compute[75014]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 08 03:45:23 user nova-compute[75014]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 08 03:45:23 user nova-compute[75014]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 08 03:45:23 user nova-compute[75014]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 08 03:45:23 user nova-compute[75014]:           </cpus>
Nov 08 03:45:23 user nova-compute[75014]:         </cell>
Nov 08 03:45:23 user nova-compute[75014]:       </cells>
Nov 08 03:45:23 user nova-compute[75014]:     </topology>
Nov 08 03:45:23 user nova-compute[75014]:     <cache>
Nov 08 03:45:23 user nova-compute[75014]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 08 03:45:23 user nova-compute[75014]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 08 03:45:23 user nova-compute[75014]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 08 03:45:23 user nova-compute[75014]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 08 03:45:23 user nova-compute[75014]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 08 03:45:23 user nova-compute[75014]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 08 03:45:23 user nova-compute[75014]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 08 03:45:23 user nova-compute[75014]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 08 03:45:23 user nova-compute[75014]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 08 03:45:23 user nova-compute[75014]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 08 03:45:23 user nova-compute[75014]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 08 03:45:23 user nova-compute[75014]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 08 03:45:23 user nova-compute[75014]:     </cache>
Nov 08 03:45:23 user nova-compute[75014]:     <secmodel>
Nov 08 03:45:23 user nova-compute[75014]:       <model>apparmor</model>
Nov 08 03:45:23 user nova-compute[75014]:       <doi>0</doi>
Nov 08 03:45:23 user nova-compute[75014]:     </secmodel>
Nov 08 03:45:23 user nova-compute[75014]:     <secmodel>
Nov 08 03:45:23 user nova-compute[75014]:       <model>dac</model>
Nov 08 03:45:23 user nova-compute[75014]:       <doi>0</doi>
Nov 08 03:45:23 user nova-compute[75014]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 08 03:45:23 user nova-compute[75014]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 08 03:45:23 user nova-compute[75014]:     </secmodel>
Nov 08 03:45:23 user nova-compute[75014]:   </host>
Nov 08 03:45:23 user nova-compute[75014]:   <guest>
Nov 08 03:45:23 user nova-compute[75014]:     <os_type>hvm</os_type>
Nov 08 03:45:23 user nova-compute[75014]:     <arch name='alpha'>
Nov 08 03:45:23 user nova-compute[75014]:       <wordsize>64</wordsize>
Nov 08 03:45:23 user nova-compute[75014]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>clipper</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <domain type='qemu'/>
Nov 08 03:45:23 user nova-compute[75014]:     </arch>
Nov 08 03:45:23 user nova-compute[75014]:     <features>
Nov 08 03:45:23 user nova-compute[75014]:       <cpuselection/>
Nov 08 03:45:23 user nova-compute[75014]:       <deviceboot/>
Nov 08 03:45:23 user nova-compute[75014]:       <disksnapshot default='on' toggle='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     </features>
Nov 08 03:45:23 user nova-compute[75014]:   </guest>
Nov 08 03:45:23 user nova-compute[75014]:   <guest>
Nov 08 03:45:23 user nova-compute[75014]:     <os_type>hvm</os_type>
Nov 08 03:45:23 user nova-compute[75014]:     <arch name='armv6l'>
Nov 08 03:45:23 user nova-compute[75014]:       <wordsize>32</wordsize>
Nov 08 03:45:23 user nova-compute[75014]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>integratorcp</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>borzoi</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>spitz</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>nuri</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>musca-b1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>versatileab</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>kzm</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>musca-a</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>smdkc210</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>sx1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>z2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>tosa</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>sabrelite</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>realview-eb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>n810</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>n800</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>versatilepb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>terrier</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>mainstone</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>midway</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>musicpal</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>microbit</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>cubieboard</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>verdex</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>netduino2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>raspi2b</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>cheetah</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>highbank</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>akita</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>connex</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>collie</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>raspi0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <domain type='qemu'/>
Nov 08 03:45:23 user nova-compute[75014]:     </arch>
Nov 08 03:45:23 user nova-compute[75014]:     <features>
Nov 08 03:45:23 user nova-compute[75014]:       <cpuselection/>
Nov 08 03:45:23 user nova-compute[75014]:       <deviceboot/>
Nov 08 03:45:23 user nova-compute[75014]:       <disksnapshot default='on' toggle='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     </features>
Nov 08 03:45:23 user nova-compute[75014]:   </guest>
Nov 08 03:45:23 user nova-compute[75014]:   <guest>
Nov 08 03:45:23 user nova-compute[75014]:     <os_type>hvm</os_type>
Nov 08 03:45:23 user nova-compute[75014]:     <arch name='armv7l'>
Nov 08 03:45:23 user nova-compute[75014]:       <wordsize>32</wordsize>
Nov 08 03:45:23 user nova-compute[75014]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>integratorcp</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>borzoi</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>spitz</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>nuri</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>musca-b1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>versatileab</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>kzm</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>musca-a</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>smdkc210</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>sx1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>z2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>tosa</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>sabrelite</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>realview-eb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>n810</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>n800</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>versatilepb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>terrier</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>mainstone</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>midway</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>musicpal</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>microbit</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>cubieboard</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>verdex</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>netduino2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>raspi2b</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>cheetah</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>highbank</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>akita</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>connex</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>collie</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>raspi0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <domain type='qemu'/>
Nov 08 03:45:23 user nova-compute[75014]:     </arch>
Nov 08 03:45:23 user nova-compute[75014]:     <features>
Nov 08 03:45:23 user nova-compute[75014]:       <cpuselection/>
Nov 08 03:45:23 user nova-compute[75014]:       <deviceboot/>
Nov 08 03:45:23 user nova-compute[75014]:       <disksnapshot default='on' toggle='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     </features>
Nov 08 03:45:23 user nova-compute[75014]:   </guest>
Nov 08 03:45:23 user nova-compute[75014]:   <guest>
Nov 08 03:45:23 user nova-compute[75014]:     <os_type>hvm</os_type>
Nov 08 03:45:23 user nova-compute[75014]:     <arch name='aarch64'>
Nov 08 03:45:23 user nova-compute[75014]:       <wordsize>64</wordsize>
Nov 08 03:45:23 user nova-compute[75014]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>integratorcp</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>borzoi</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>spitz</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>nuri</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>musca-b1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>versatileab</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>kzm</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>musca-a</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>smdkc210</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>sx1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>z2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>tosa</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>sabrelite</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>realview-eb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>n810</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>n800</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>versatilepb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>terrier</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>mainstone</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>midway</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>musicpal</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>microbit</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>cubieboard</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>verdex</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>netduino2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>raspi3b</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>raspi2b</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>cheetah</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>highbank</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>akita</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>connex</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>collie</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>raspi0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <domain type='qemu'/>
Nov 08 03:45:23 user nova-compute[75014]:     </arch>
Nov 08 03:45:23 user nova-compute[75014]:     <features>
Nov 08 03:45:23 user nova-compute[75014]:       <acpi default='on' toggle='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:       <cpuselection/>
Nov 08 03:45:23 user nova-compute[75014]:       <deviceboot/>
Nov 08 03:45:23 user nova-compute[75014]:       <disksnapshot default='on' toggle='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     </features>
Nov 08 03:45:23 user nova-compute[75014]:   </guest>
Nov 08 03:45:23 user nova-compute[75014]:   <guest>
Nov 08 03:45:23 user nova-compute[75014]:     <os_type>hvm</os_type>
Nov 08 03:45:23 user nova-compute[75014]:     <arch name='cris'>
Nov 08 03:45:23 user nova-compute[75014]:       <wordsize>32</wordsize>
Nov 08 03:45:23 user nova-compute[75014]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <domain type='qemu'/>
Nov 08 03:45:23 user nova-compute[75014]:     </arch>
Nov 08 03:45:23 user nova-compute[75014]:     <features>
Nov 08 03:45:23 user nova-compute[75014]:       <cpuselection/>
Nov 08 03:45:23 user nova-compute[75014]:       <deviceboot/>
Nov 08 03:45:23 user nova-compute[75014]:       <disksnapshot default='on' toggle='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     </features>
Nov 08 03:45:23 user nova-compute[75014]:   </guest>
Nov 08 03:45:23 user nova-compute[75014]:   <guest>
Nov 08 03:45:23 user nova-compute[75014]:     <os_type>hvm</os_type>
Nov 08 03:45:23 user nova-compute[75014]:     <arch name='i686'>
Nov 08 03:45:23 user nova-compute[75014]:       <wordsize>32</wordsize>
Nov 08 03:45:23 user nova-compute[75014]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>x-remote</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>isapc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>microvm</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <domain type='qemu'/>
Nov 08 03:45:23 user nova-compute[75014]:       <domain type='kvm'/>
Nov 08 03:45:23 user nova-compute[75014]:     </arch>
Nov 08 03:45:23 user nova-compute[75014]:     <features>
Nov 08 03:45:23 user nova-compute[75014]:       <pae/>
Nov 08 03:45:23 user nova-compute[75014]:       <nonpae/>
Nov 08 03:45:23 user nova-compute[75014]:       <acpi default='on' toggle='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:       <apic default='on' toggle='no'/>
Nov 08 03:45:23 user nova-compute[75014]:       <cpuselection/>
Nov 08 03:45:23 user nova-compute[75014]:       <deviceboot/>
Nov 08 03:45:23 user nova-compute[75014]:       <disksnapshot default='on' toggle='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     </features>
Nov 08 03:45:23 user nova-compute[75014]:   </guest>
Nov 08 03:45:23 user nova-compute[75014]:   <guest>
Nov 08 03:45:23 user nova-compute[75014]:     <os_type>hvm</os_type>
Nov 08 03:45:23 user nova-compute[75014]:     <arch name='m68k'>
Nov 08 03:45:23 user nova-compute[75014]:       <wordsize>32</wordsize>
Nov 08 03:45:23 user nova-compute[75014]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>an5206</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>q800</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>next-cube</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <domain type='qemu'/>
Nov 08 03:45:23 user nova-compute[75014]:     </arch>
Nov 08 03:45:23 user nova-compute[75014]:     <features>
Nov 08 03:45:23 user nova-compute[75014]:       <cpuselection/>
Nov 08 03:45:23 user nova-compute[75014]:       <deviceboot/>
Nov 08 03:45:23 user nova-compute[75014]:       <disksnapshot default='on' toggle='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     </features>
Nov 08 03:45:23 user nova-compute[75014]:   </guest>
Nov 08 03:45:23 user nova-compute[75014]:   <guest>
Nov 08 03:45:23 user nova-compute[75014]:     <os_type>hvm</os_type>
Nov 08 03:45:23 user nova-compute[75014]:     <arch name='microblaze'>
Nov 08 03:45:23 user nova-compute[75014]:       <wordsize>32</wordsize>
Nov 08 03:45:23 user nova-compute[75014]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <domain type='qemu'/>
Nov 08 03:45:23 user nova-compute[75014]:     </arch>
Nov 08 03:45:23 user nova-compute[75014]:     <features>
Nov 08 03:45:23 user nova-compute[75014]:       <cpuselection/>
Nov 08 03:45:23 user nova-compute[75014]:       <deviceboot/>
Nov 08 03:45:23 user nova-compute[75014]:       <disksnapshot default='on' toggle='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     </features>
Nov 08 03:45:23 user nova-compute[75014]:   </guest>
Nov 08 03:45:23 user nova-compute[75014]:   <guest>
Nov 08 03:45:23 user nova-compute[75014]:     <os_type>hvm</os_type>
Nov 08 03:45:23 user nova-compute[75014]:     <arch name='microblazeel'>
Nov 08 03:45:23 user nova-compute[75014]:       <wordsize>32</wordsize>
Nov 08 03:45:23 user nova-compute[75014]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <domain type='qemu'/>
Nov 08 03:45:23 user nova-compute[75014]:     </arch>
Nov 08 03:45:23 user nova-compute[75014]:     <features>
Nov 08 03:45:23 user nova-compute[75014]:       <cpuselection/>
Nov 08 03:45:23 user nova-compute[75014]:       <deviceboot/>
Nov 08 03:45:23 user nova-compute[75014]:       <disksnapshot default='on' toggle='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     </features>
Nov 08 03:45:23 user nova-compute[75014]:   </guest>
Nov 08 03:45:23 user nova-compute[75014]:   <guest>
Nov 08 03:45:23 user nova-compute[75014]:     <os_type>hvm</os_type>
Nov 08 03:45:23 user nova-compute[75014]:     <arch name='mips'>
Nov 08 03:45:23 user nova-compute[75014]:       <wordsize>32</wordsize>
Nov 08 03:45:23 user nova-compute[75014]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='16'>malta</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <domain type='qemu'/>
Nov 08 03:45:23 user nova-compute[75014]:     </arch>
Nov 08 03:45:23 user nova-compute[75014]:     <features>
Nov 08 03:45:23 user nova-compute[75014]:       <cpuselection/>
Nov 08 03:45:23 user nova-compute[75014]:       <deviceboot/>
Nov 08 03:45:23 user nova-compute[75014]:       <disksnapshot default='on' toggle='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     </features>
Nov 08 03:45:23 user nova-compute[75014]:   </guest>
Nov 08 03:45:23 user nova-compute[75014]:   <guest>
Nov 08 03:45:23 user nova-compute[75014]:     <os_type>hvm</os_type>
Nov 08 03:45:23 user nova-compute[75014]:     <arch name='mipsel'>
Nov 08 03:45:23 user nova-compute[75014]:       <wordsize>32</wordsize>
Nov 08 03:45:23 user nova-compute[75014]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='16'>malta</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <domain type='qemu'/>
Nov 08 03:45:23 user nova-compute[75014]:     </arch>
Nov 08 03:45:23 user nova-compute[75014]:     <features>
Nov 08 03:45:23 user nova-compute[75014]:       <cpuselection/>
Nov 08 03:45:23 user nova-compute[75014]:       <deviceboot/>
Nov 08 03:45:23 user nova-compute[75014]:       <disksnapshot default='on' toggle='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     </features>
Nov 08 03:45:23 user nova-compute[75014]:   </guest>
Nov 08 03:45:23 user nova-compute[75014]:   <guest>
Nov 08 03:45:23 user nova-compute[75014]:     <os_type>hvm</os_type>
Nov 08 03:45:23 user nova-compute[75014]:     <arch name='mips64'>
Nov 08 03:45:23 user nova-compute[75014]:       <wordsize>64</wordsize>
Nov 08 03:45:23 user nova-compute[75014]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='16'>malta</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>pica61</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>magnum</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <domain type='qemu'/>
Nov 08 03:45:23 user nova-compute[75014]:     </arch>
Nov 08 03:45:23 user nova-compute[75014]:     <features>
Nov 08 03:45:23 user nova-compute[75014]:       <cpuselection/>
Nov 08 03:45:23 user nova-compute[75014]:       <deviceboot/>
Nov 08 03:45:23 user nova-compute[75014]:       <disksnapshot default='on' toggle='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     </features>
Nov 08 03:45:23 user nova-compute[75014]:   </guest>
Nov 08 03:45:23 user nova-compute[75014]:   <guest>
Nov 08 03:45:23 user nova-compute[75014]:     <os_type>hvm</os_type>
Nov 08 03:45:23 user nova-compute[75014]:     <arch name='mips64el'>
Nov 08 03:45:23 user nova-compute[75014]:       <wordsize>64</wordsize>
Nov 08 03:45:23 user nova-compute[75014]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='16'>malta</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>pica61</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>magnum</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='16'>boston</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <domain type='qemu'/>
Nov 08 03:45:23 user nova-compute[75014]:     </arch>
Nov 08 03:45:23 user nova-compute[75014]:     <features>
Nov 08 03:45:23 user nova-compute[75014]:       <cpuselection/>
Nov 08 03:45:23 user nova-compute[75014]:       <deviceboot/>
Nov 08 03:45:23 user nova-compute[75014]:       <disksnapshot default='on' toggle='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     </features>
Nov 08 03:45:23 user nova-compute[75014]:   </guest>
Nov 08 03:45:23 user nova-compute[75014]:   <guest>
Nov 08 03:45:23 user nova-compute[75014]:     <os_type>hvm</os_type>
Nov 08 03:45:23 user nova-compute[75014]:     <arch name='ppc'>
Nov 08 03:45:23 user nova-compute[75014]:       <wordsize>32</wordsize>
Nov 08 03:45:23 user nova-compute[75014]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>g3beige</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>mac99</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='32'>ppce500</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>pegasos2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>sam460ex</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>bamboo</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>40p</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>ref405ep</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>taihu</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <domain type='qemu'/>
Nov 08 03:45:23 user nova-compute[75014]:     </arch>
Nov 08 03:45:23 user nova-compute[75014]:     <features>
Nov 08 03:45:23 user nova-compute[75014]:       <cpuselection/>
Nov 08 03:45:23 user nova-compute[75014]:       <deviceboot/>
Nov 08 03:45:23 user nova-compute[75014]:       <disksnapshot default='on' toggle='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     </features>
Nov 08 03:45:23 user nova-compute[75014]:   </guest>
Nov 08 03:45:23 user nova-compute[75014]:   <guest>
Nov 08 03:45:23 user nova-compute[75014]:     <os_type>hvm</os_type>
Nov 08 03:45:23 user nova-compute[75014]:     <arch name='ppc64'>
Nov 08 03:45:23 user nova-compute[75014]:       <wordsize>64</wordsize>
Nov 08 03:45:23 user nova-compute[75014]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2048'>powernv9</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>taihu</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2048'>powernv10</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='32'>ppce500</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>40p</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>pegasos2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>bamboo</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>g3beige</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>mac99</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>sam460ex</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>ref405ep</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2048'>powernv8</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <domain type='qemu'/>
Nov 08 03:45:23 user nova-compute[75014]:     </arch>
Nov 08 03:45:23 user nova-compute[75014]:     <features>
Nov 08 03:45:23 user nova-compute[75014]:       <cpuselection/>
Nov 08 03:45:23 user nova-compute[75014]:       <deviceboot/>
Nov 08 03:45:23 user nova-compute[75014]:       <disksnapshot default='on' toggle='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     </features>
Nov 08 03:45:23 user nova-compute[75014]:   </guest>
Nov 08 03:45:23 user nova-compute[75014]:   <guest>
Nov 08 03:45:23 user nova-compute[75014]:     <os_type>hvm</os_type>
Nov 08 03:45:23 user nova-compute[75014]:     <arch name='ppc64le'>
Nov 08 03:45:23 user nova-compute[75014]:       <wordsize>64</wordsize>
Nov 08 03:45:23 user nova-compute[75014]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2048'>powernv9</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>taihu</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2048'>powernv10</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='32'>ppce500</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>40p</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>pegasos2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>bamboo</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>g3beige</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>mac99</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>sam460ex</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>ref405ep</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2048'>powernv8</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <domain type='qemu'/>
Nov 08 03:45:23 user nova-compute[75014]:     </arch>
Nov 08 03:45:23 user nova-compute[75014]:     <features>
Nov 08 03:45:23 user nova-compute[75014]:       <cpuselection/>
Nov 08 03:45:23 user nova-compute[75014]:       <deviceboot/>
Nov 08 03:45:23 user nova-compute[75014]:       <disksnapshot default='on' toggle='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     </features>
Nov 08 03:45:23 user nova-compute[75014]:   </guest>
Nov 08 03:45:23 user nova-compute[75014]:   <guest>
Nov 08 03:45:23 user nova-compute[75014]:     <os_type>hvm</os_type>
Nov 08 03:45:23 user nova-compute[75014]:     <arch name='riscv32'>
Nov 08 03:45:23 user nova-compute[75014]:       <wordsize>32</wordsize>
Nov 08 03:45:23 user nova-compute[75014]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='8'>spike</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>opentitan</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='5'>sifive_u</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>sifive_e</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='8'>virt</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <domain type='qemu'/>
Nov 08 03:45:23 user nova-compute[75014]:     </arch>
Nov 08 03:45:23 user nova-compute[75014]:     <features>
Nov 08 03:45:23 user nova-compute[75014]:       <cpuselection/>
Nov 08 03:45:23 user nova-compute[75014]:       <deviceboot/>
Nov 08 03:45:23 user nova-compute[75014]:       <disksnapshot default='on' toggle='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     </features>
Nov 08 03:45:23 user nova-compute[75014]:   </guest>
Nov 08 03:45:23 user nova-compute[75014]:   <guest>
Nov 08 03:45:23 user nova-compute[75014]:     <os_type>hvm</os_type>
Nov 08 03:45:23 user nova-compute[75014]:     <arch name='riscv64'>
Nov 08 03:45:23 user nova-compute[75014]:       <wordsize>64</wordsize>
Nov 08 03:45:23 user nova-compute[75014]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='8'>spike</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='5'>sifive_u</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>shakti_c</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>sifive_e</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='8'>virt</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <domain type='qemu'/>
Nov 08 03:45:23 user nova-compute[75014]:     </arch>
Nov 08 03:45:23 user nova-compute[75014]:     <features>
Nov 08 03:45:23 user nova-compute[75014]:       <cpuselection/>
Nov 08 03:45:23 user nova-compute[75014]:       <deviceboot/>
Nov 08 03:45:23 user nova-compute[75014]:       <disksnapshot default='on' toggle='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     </features>
Nov 08 03:45:23 user nova-compute[75014]:   </guest>
Nov 08 03:45:23 user nova-compute[75014]:   <guest>
Nov 08 03:45:23 user nova-compute[75014]:     <os_type>hvm</os_type>
Nov 08 03:45:23 user nova-compute[75014]:     <arch name='s390x'>
Nov 08 03:45:23 user nova-compute[75014]:       <wordsize>64</wordsize>
Nov 08 03:45:23 user nova-compute[75014]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <domain type='qemu'/>
Nov 08 03:45:23 user nova-compute[75014]:     </arch>
Nov 08 03:45:23 user nova-compute[75014]:     <features>
Nov 08 03:45:23 user nova-compute[75014]:       <cpuselection/>
Nov 08 03:45:23 user nova-compute[75014]:       <deviceboot/>
Nov 08 03:45:23 user nova-compute[75014]:       <disksnapshot default='on' toggle='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     </features>
Nov 08 03:45:23 user nova-compute[75014]:   </guest>
Nov 08 03:45:23 user nova-compute[75014]:   <guest>
Nov 08 03:45:23 user nova-compute[75014]:     <os_type>hvm</os_type>
Nov 08 03:45:23 user nova-compute[75014]:     <arch name='sh4'>
Nov 08 03:45:23 user nova-compute[75014]:       <wordsize>32</wordsize>
Nov 08 03:45:23 user nova-compute[75014]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>shix</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>r2d</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <domain type='qemu'/>
Nov 08 03:45:23 user nova-compute[75014]:     </arch>
Nov 08 03:45:23 user nova-compute[75014]:     <features>
Nov 08 03:45:23 user nova-compute[75014]:       <cpuselection/>
Nov 08 03:45:23 user nova-compute[75014]:       <deviceboot/>
Nov 08 03:45:23 user nova-compute[75014]:       <disksnapshot default='on' toggle='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     </features>
Nov 08 03:45:23 user nova-compute[75014]:   </guest>
Nov 08 03:45:23 user nova-compute[75014]:   <guest>
Nov 08 03:45:23 user nova-compute[75014]:     <os_type>hvm</os_type>
Nov 08 03:45:23 user nova-compute[75014]:     <arch name='sh4eb'>
Nov 08 03:45:23 user nova-compute[75014]:       <wordsize>64</wordsize>
Nov 08 03:45:23 user nova-compute[75014]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>shix</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>r2d</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <domain type='qemu'/>
Nov 08 03:45:23 user nova-compute[75014]:     </arch>
Nov 08 03:45:23 user nova-compute[75014]:     <features>
Nov 08 03:45:23 user nova-compute[75014]:       <cpuselection/>
Nov 08 03:45:23 user nova-compute[75014]:       <deviceboot/>
Nov 08 03:45:23 user nova-compute[75014]:       <disksnapshot default='on' toggle='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     </features>
Nov 08 03:45:23 user nova-compute[75014]:   </guest>
Nov 08 03:45:23 user nova-compute[75014]:   <guest>
Nov 08 03:45:23 user nova-compute[75014]:     <os_type>hvm</os_type>
Nov 08 03:45:23 user nova-compute[75014]:     <arch name='sparc'>
Nov 08 03:45:23 user nova-compute[75014]:       <wordsize>32</wordsize>
Nov 08 03:45:23 user nova-compute[75014]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>SS-5</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>SS-20</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>LX</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>SS-4</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>SS-10</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>Voyager</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <domain type='qemu'/>
Nov 08 03:45:23 user nova-compute[75014]:     </arch>
Nov 08 03:45:23 user nova-compute[75014]:     <features>
Nov 08 03:45:23 user nova-compute[75014]:       <cpuselection/>
Nov 08 03:45:23 user nova-compute[75014]:       <deviceboot/>
Nov 08 03:45:23 user nova-compute[75014]:       <disksnapshot default='on' toggle='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     </features>
Nov 08 03:45:23 user nova-compute[75014]:   </guest>
Nov 08 03:45:23 user nova-compute[75014]:   <guest>
Nov 08 03:45:23 user nova-compute[75014]:     <os_type>hvm</os_type>
Nov 08 03:45:23 user nova-compute[75014]:     <arch name='sparc64'>
Nov 08 03:45:23 user nova-compute[75014]:       <wordsize>64</wordsize>
Nov 08 03:45:23 user nova-compute[75014]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>sun4u</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>niagara</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>sun4v</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <domain type='qemu'/>
Nov 08 03:45:23 user nova-compute[75014]:     </arch>
Nov 08 03:45:23 user nova-compute[75014]:     <features>
Nov 08 03:45:23 user nova-compute[75014]:       <cpuselection/>
Nov 08 03:45:23 user nova-compute[75014]:       <deviceboot/>
Nov 08 03:45:23 user nova-compute[75014]:       <disksnapshot default='on' toggle='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     </features>
Nov 08 03:45:23 user nova-compute[75014]:   </guest>
Nov 08 03:45:23 user nova-compute[75014]:   <guest>
Nov 08 03:45:23 user nova-compute[75014]:     <os_type>hvm</os_type>
Nov 08 03:45:23 user nova-compute[75014]:     <arch name='x86_64'>
Nov 08 03:45:23 user nova-compute[75014]:       <wordsize>64</wordsize>
Nov 08 03:45:23 user nova-compute[75014]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>x-remote</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='1'>isapc</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>microvm</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <domain type='qemu'/>
Nov 08 03:45:23 user nova-compute[75014]:       <domain type='kvm'/>
Nov 08 03:45:23 user nova-compute[75014]:     </arch>
Nov 08 03:45:23 user nova-compute[75014]:     <features>
Nov 08 03:45:23 user nova-compute[75014]:       <acpi default='on' toggle='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:       <apic default='on' toggle='no'/>
Nov 08 03:45:23 user nova-compute[75014]:       <cpuselection/>
Nov 08 03:45:23 user nova-compute[75014]:       <deviceboot/>
Nov 08 03:45:23 user nova-compute[75014]:       <disksnapshot default='on' toggle='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     </features>
Nov 08 03:45:23 user nova-compute[75014]:   </guest>
Nov 08 03:45:23 user nova-compute[75014]:   <guest>
Nov 08 03:45:23 user nova-compute[75014]:     <os_type>hvm</os_type>
Nov 08 03:45:23 user nova-compute[75014]:     <arch name='xtensa'>
Nov 08 03:45:23 user nova-compute[75014]:       <wordsize>32</wordsize>
Nov 08 03:45:23 user nova-compute[75014]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>sim</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='32'>kc705</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='32'>ml605</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='32'>virt</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='32'>lx200</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='32'>lx60</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <domain type='qemu'/>
Nov 08 03:45:23 user nova-compute[75014]:     </arch>
Nov 08 03:45:23 user nova-compute[75014]:     <features>
Nov 08 03:45:23 user nova-compute[75014]:       <cpuselection/>
Nov 08 03:45:23 user nova-compute[75014]:       <deviceboot/>
Nov 08 03:45:23 user nova-compute[75014]:       <disksnapshot default='on' toggle='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     </features>
Nov 08 03:45:23 user nova-compute[75014]:   </guest>
Nov 08 03:45:23 user nova-compute[75014]:   <guest>
Nov 08 03:45:23 user nova-compute[75014]:     <os_type>hvm</os_type>
Nov 08 03:45:23 user nova-compute[75014]:     <arch name='xtensaeb'>
Nov 08 03:45:23 user nova-compute[75014]:       <wordsize>32</wordsize>
Nov 08 03:45:23 user nova-compute[75014]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='4'>sim</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='32'>kc705</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='32'>ml605</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='32'>virt</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='32'>lx200</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='32'>lx60</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 08 03:45:23 user nova-compute[75014]:       <domain type='qemu'/>
Nov 08 03:45:23 user nova-compute[75014]:     </arch>
Nov 08 03:45:23 user nova-compute[75014]:     <features>
Nov 08 03:45:23 user nova-compute[75014]:       <cpuselection/>
Nov 08 03:45:23 user nova-compute[75014]:       <deviceboot/>
Nov 08 03:45:23 user nova-compute[75014]:       <disksnapshot default='on' toggle='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     </features>
Nov 08 03:45:23 user nova-compute[75014]:   </guest>
Nov 08 03:45:23 user nova-compute[75014]: </capabilities>
Nov 08 03:45:23 user nova-compute[75014]: 
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75014) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75014) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75014) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75014) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75014) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75014) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75014) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75014) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75014) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75014) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75014) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'pc', 'ubuntu-q35', 'q35'} {{(pid=75014) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 08 03:45:23 user nova-compute[75014]: <domainCapabilities>
Nov 08 03:45:23 user nova-compute[75014]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 03:45:23 user nova-compute[75014]:   <domain>kvm</domain>
Nov 08 03:45:23 user nova-compute[75014]:   <machine>pc-i440fx-jammy</machine>
Nov 08 03:45:23 user nova-compute[75014]:   <arch>i686</arch>
Nov 08 03:45:23 user nova-compute[75014]:   <vcpu max='255'/>
Nov 08 03:45:23 user nova-compute[75014]:   <iothreads supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:   <os supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:     <enum name='firmware'/>
Nov 08 03:45:23 user nova-compute[75014]:     <loader supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='type'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>rom</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>pflash</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='readonly'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>yes</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>no</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='secure'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>no</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </loader>
Nov 08 03:45:23 user nova-compute[75014]:   </os>
Nov 08 03:45:23 user nova-compute[75014]:   <cpu>
Nov 08 03:45:23 user nova-compute[75014]:     <mode name='host-passthrough' supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='hostPassthroughMigratable'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>off</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </mode>
Nov 08 03:45:23 user nova-compute[75014]:     <mode name='maximum' supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='maximumMigratable'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>on</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>off</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </mode>
Nov 08 03:45:23 user nova-compute[75014]:     <mode name='host-model' supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <vendor>Intel</vendor>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='ss'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='vmx'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='pcid'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='hypervisor'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='arat'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='umip'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='md-clear'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='stibp'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='ssbd'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='ibpb'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='ibrs'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='amd-stibp'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='disable' name='erms'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='disable' name='lm'/>
Nov 08 03:45:23 user nova-compute[75014]:     </mode>
Nov 08 03:45:23 user nova-compute[75014]:     <mode name='custom' supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>qemu64</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>qemu32</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>phenom</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>pentium3</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>pentium2</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>pentium</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>n270</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>kvm64</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>kvm32</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>coreduo</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>core2duo</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>athlon</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Westmere</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Snowridge</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Server</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Client</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>SandyBridge</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Penryn</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G5</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G4</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G3</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G2</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G1</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Nehalem</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>IvyBridge</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Icelake-Server</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Haswell</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>EPYC-Rome</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>EPYC-Milan</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>EPYC</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Dhyana</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Cooperlake</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Conroe</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Broadwell</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>486</model>
Nov 08 03:45:23 user nova-compute[75014]:     </mode>
Nov 08 03:45:23 user nova-compute[75014]:   </cpu>
Nov 08 03:45:23 user nova-compute[75014]:   <memoryBacking supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:     <enum name='sourceType'>
Nov 08 03:45:23 user nova-compute[75014]:       <value>file</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>anonymous</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>memfd</value>
Nov 08 03:45:23 user nova-compute[75014]:     </enum>
Nov 08 03:45:23 user nova-compute[75014]:   </memoryBacking>
Nov 08 03:45:23 user nova-compute[75014]:   <devices>
Nov 08 03:45:23 user nova-compute[75014]:     <disk supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='diskDevice'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>disk</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>cdrom</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>floppy</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>lun</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='bus'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>ide</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>fdc</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>scsi</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>usb</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>sata</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='model'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio-transitional</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio-non-transitional</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </disk>
Nov 08 03:45:23 user nova-compute[75014]:     <graphics supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='type'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>sdl</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>vnc</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>spice</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>egl-headless</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </graphics>
Nov 08 03:45:23 user nova-compute[75014]:     <video supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='modelType'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>vga</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>cirrus</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>vmvga</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>qxl</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>none</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>bochs</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>ramfb</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </video>
Nov 08 03:45:23 user nova-compute[75014]:     <hostdev supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='mode'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>subsystem</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='startupPolicy'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>default</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>mandatory</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>requisite</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>optional</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='subsysType'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>usb</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>pci</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>scsi</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='capsType'/>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='pciBackend'/>
Nov 08 03:45:23 user nova-compute[75014]:     </hostdev>
Nov 08 03:45:23 user nova-compute[75014]:     <rng supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='model'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio-transitional</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio-non-transitional</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='backendModel'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>random</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>egd</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>builtin</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </rng>
Nov 08 03:45:23 user nova-compute[75014]:     <filesystem supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='driverType'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>path</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>handle</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtiofs</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </filesystem>
Nov 08 03:45:23 user nova-compute[75014]:     <tpm supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='model'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>tpm-tis</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>tpm-crb</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='backendModel'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>passthrough</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>emulator</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </tpm>
Nov 08 03:45:23 user nova-compute[75014]:   </devices>
Nov 08 03:45:23 user nova-compute[75014]:   <features>
Nov 08 03:45:23 user nova-compute[75014]:     <gic supported='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     <vmcoreinfo supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:     <genid supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:     <backingStoreInput supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:     <backup supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:     <sev supported='no'/>
Nov 08 03:45:23 user nova-compute[75014]:   </features>
Nov 08 03:45:23 user nova-compute[75014]: </domainCapabilities>
Nov 08 03:45:23 user nova-compute[75014]:  {{(pid=75014) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 08 03:45:23 user nova-compute[75014]: <domainCapabilities>
Nov 08 03:45:23 user nova-compute[75014]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 03:45:23 user nova-compute[75014]:   <domain>kvm</domain>
Nov 08 03:45:23 user nova-compute[75014]:   <machine>pc-i440fx-6.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:   <arch>i686</arch>
Nov 08 03:45:23 user nova-compute[75014]:   <vcpu max='255'/>
Nov 08 03:45:23 user nova-compute[75014]:   <iothreads supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:   <os supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:     <enum name='firmware'/>
Nov 08 03:45:23 user nova-compute[75014]:     <loader supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='type'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>rom</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>pflash</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='readonly'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>yes</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>no</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='secure'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>no</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </loader>
Nov 08 03:45:23 user nova-compute[75014]:   </os>
Nov 08 03:45:23 user nova-compute[75014]:   <cpu>
Nov 08 03:45:23 user nova-compute[75014]:     <mode name='host-passthrough' supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='hostPassthroughMigratable'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>off</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </mode>
Nov 08 03:45:23 user nova-compute[75014]:     <mode name='maximum' supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='maximumMigratable'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>on</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>off</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </mode>
Nov 08 03:45:23 user nova-compute[75014]:     <mode name='host-model' supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <vendor>Intel</vendor>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='ss'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='vmx'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='pcid'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='hypervisor'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='arat'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='umip'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='md-clear'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='stibp'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='ssbd'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='ibpb'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='ibrs'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='amd-stibp'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='disable' name='erms'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='disable' name='lm'/>
Nov 08 03:45:23 user nova-compute[75014]:     </mode>
Nov 08 03:45:23 user nova-compute[75014]:     <mode name='custom' supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>qemu64</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>qemu32</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>phenom</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>pentium3</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>pentium2</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>pentium</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>n270</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>kvm64</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>kvm32</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>coreduo</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>core2duo</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>athlon</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Westmere</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Snowridge</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Server</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Client</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>SandyBridge</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Penryn</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G5</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G4</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G3</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G2</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G1</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Nehalem</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>IvyBridge</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Icelake-Server</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Haswell</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>EPYC-Rome</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>EPYC-Milan</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>EPYC</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Dhyana</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Cooperlake</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Conroe</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Broadwell</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>486</model>
Nov 08 03:45:23 user nova-compute[75014]:     </mode>
Nov 08 03:45:23 user nova-compute[75014]:   </cpu>
Nov 08 03:45:23 user nova-compute[75014]:   <memoryBacking supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:     <enum name='sourceType'>
Nov 08 03:45:23 user nova-compute[75014]:       <value>file</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>anonymous</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>memfd</value>
Nov 08 03:45:23 user nova-compute[75014]:     </enum>
Nov 08 03:45:23 user nova-compute[75014]:   </memoryBacking>
Nov 08 03:45:23 user nova-compute[75014]:   <devices>
Nov 08 03:45:23 user nova-compute[75014]:     <disk supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='diskDevice'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>disk</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>cdrom</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>floppy</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>lun</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='bus'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>ide</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>fdc</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>scsi</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>usb</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>sata</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='model'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio-transitional</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio-non-transitional</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </disk>
Nov 08 03:45:23 user nova-compute[75014]:     <graphics supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='type'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>sdl</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>vnc</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>spice</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>egl-headless</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </graphics>
Nov 08 03:45:23 user nova-compute[75014]:     <video supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='modelType'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>vga</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>cirrus</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>vmvga</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>qxl</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>none</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>bochs</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>ramfb</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </video>
Nov 08 03:45:23 user nova-compute[75014]:     <hostdev supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='mode'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>subsystem</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='startupPolicy'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>default</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>mandatory</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>requisite</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>optional</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='subsysType'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>usb</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>pci</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>scsi</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='capsType'/>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='pciBackend'/>
Nov 08 03:45:23 user nova-compute[75014]:     </hostdev>
Nov 08 03:45:23 user nova-compute[75014]:     <rng supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='model'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio-transitional</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio-non-transitional</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='backendModel'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>random</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>egd</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>builtin</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </rng>
Nov 08 03:45:23 user nova-compute[75014]:     <filesystem supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='driverType'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>path</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>handle</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtiofs</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </filesystem>
Nov 08 03:45:23 user nova-compute[75014]:     <tpm supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='model'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>tpm-tis</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>tpm-crb</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='backendModel'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>passthrough</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>emulator</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </tpm>
Nov 08 03:45:23 user nova-compute[75014]:   </devices>
Nov 08 03:45:23 user nova-compute[75014]:   <features>
Nov 08 03:45:23 user nova-compute[75014]:     <gic supported='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     <vmcoreinfo supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:     <genid supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:     <backingStoreInput supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:     <backup supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:     <sev supported='no'/>
Nov 08 03:45:23 user nova-compute[75014]:   </features>
Nov 08 03:45:23 user nova-compute[75014]: </domainCapabilities>
Nov 08 03:45:23 user nova-compute[75014]:  {{(pid=75014) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 08 03:45:23 user nova-compute[75014]: <domainCapabilities>
Nov 08 03:45:23 user nova-compute[75014]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 03:45:23 user nova-compute[75014]:   <domain>kvm</domain>
Nov 08 03:45:23 user nova-compute[75014]:   <machine>pc-q35-jammy</machine>
Nov 08 03:45:23 user nova-compute[75014]:   <arch>i686</arch>
Nov 08 03:45:23 user nova-compute[75014]:   <vcpu max='288'/>
Nov 08 03:45:23 user nova-compute[75014]:   <iothreads supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:   <os supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:     <enum name='firmware'/>
Nov 08 03:45:23 user nova-compute[75014]:     <loader supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='type'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>rom</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>pflash</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='readonly'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>yes</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>no</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='secure'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>no</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </loader>
Nov 08 03:45:23 user nova-compute[75014]:   </os>
Nov 08 03:45:23 user nova-compute[75014]:   <cpu>
Nov 08 03:45:23 user nova-compute[75014]:     <mode name='host-passthrough' supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='hostPassthroughMigratable'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>off</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </mode>
Nov 08 03:45:23 user nova-compute[75014]:     <mode name='maximum' supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='maximumMigratable'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>on</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>off</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </mode>
Nov 08 03:45:23 user nova-compute[75014]:     <mode name='host-model' supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <vendor>Intel</vendor>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='ss'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='vmx'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='pcid'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='hypervisor'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='arat'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='umip'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='md-clear'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='stibp'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='ssbd'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='ibpb'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='ibrs'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='amd-stibp'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='disable' name='erms'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='disable' name='lm'/>
Nov 08 03:45:23 user nova-compute[75014]:     </mode>
Nov 08 03:45:23 user nova-compute[75014]:     <mode name='custom' supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>qemu64</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>qemu32</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>phenom</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>pentium3</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>pentium2</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>pentium</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>n270</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>kvm64</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>kvm32</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>coreduo</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>core2duo</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>athlon</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Westmere</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Snowridge</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Server</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Client</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>SandyBridge</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Penryn</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G5</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G4</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G3</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G2</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G1</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Nehalem</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>IvyBridge</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Icelake-Server</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Haswell</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>EPYC-Rome</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>EPYC-Milan</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>EPYC</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Dhyana</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Cooperlake</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Conroe</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Broadwell</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>486</model>
Nov 08 03:45:23 user nova-compute[75014]:     </mode>
Nov 08 03:45:23 user nova-compute[75014]:   </cpu>
Nov 08 03:45:23 user nova-compute[75014]:   <memoryBacking supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:     <enum name='sourceType'>
Nov 08 03:45:23 user nova-compute[75014]:       <value>file</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>anonymous</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>memfd</value>
Nov 08 03:45:23 user nova-compute[75014]:     </enum>
Nov 08 03:45:23 user nova-compute[75014]:   </memoryBacking>
Nov 08 03:45:23 user nova-compute[75014]:   <devices>
Nov 08 03:45:23 user nova-compute[75014]:     <disk supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='diskDevice'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>disk</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>cdrom</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>floppy</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>lun</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='bus'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>fdc</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>scsi</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>usb</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>sata</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='model'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio-transitional</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio-non-transitional</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </disk>
Nov 08 03:45:23 user nova-compute[75014]:     <graphics supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='type'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>sdl</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>vnc</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>spice</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>egl-headless</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </graphics>
Nov 08 03:45:23 user nova-compute[75014]:     <video supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='modelType'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>vga</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>cirrus</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>vmvga</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>qxl</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>none</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>bochs</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>ramfb</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </video>
Nov 08 03:45:23 user nova-compute[75014]:     <hostdev supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='mode'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>subsystem</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='startupPolicy'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>default</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>mandatory</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>requisite</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>optional</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='subsysType'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>usb</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>pci</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>scsi</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='capsType'/>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='pciBackend'/>
Nov 08 03:45:23 user nova-compute[75014]:     </hostdev>
Nov 08 03:45:23 user nova-compute[75014]:     <rng supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='model'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio-transitional</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio-non-transitional</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='backendModel'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>random</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>egd</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>builtin</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </rng>
Nov 08 03:45:23 user nova-compute[75014]:     <filesystem supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='driverType'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>path</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>handle</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtiofs</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </filesystem>
Nov 08 03:45:23 user nova-compute[75014]:     <tpm supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='model'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>tpm-tis</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>tpm-crb</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='backendModel'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>passthrough</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>emulator</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </tpm>
Nov 08 03:45:23 user nova-compute[75014]:   </devices>
Nov 08 03:45:23 user nova-compute[75014]:   <features>
Nov 08 03:45:23 user nova-compute[75014]:     <gic supported='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     <vmcoreinfo supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:     <genid supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:     <backingStoreInput supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:     <backup supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:     <sev supported='no'/>
Nov 08 03:45:23 user nova-compute[75014]:   </features>
Nov 08 03:45:23 user nova-compute[75014]: </domainCapabilities>
Nov 08 03:45:23 user nova-compute[75014]:  {{(pid=75014) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 08 03:45:23 user nova-compute[75014]: <domainCapabilities>
Nov 08 03:45:23 user nova-compute[75014]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 03:45:23 user nova-compute[75014]:   <domain>kvm</domain>
Nov 08 03:45:23 user nova-compute[75014]:   <machine>pc-q35-6.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:   <arch>i686</arch>
Nov 08 03:45:23 user nova-compute[75014]:   <vcpu max='288'/>
Nov 08 03:45:23 user nova-compute[75014]:   <iothreads supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:   <os supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:     <enum name='firmware'/>
Nov 08 03:45:23 user nova-compute[75014]:     <loader supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='type'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>rom</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>pflash</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='readonly'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>yes</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>no</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='secure'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>no</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </loader>
Nov 08 03:45:23 user nova-compute[75014]:   </os>
Nov 08 03:45:23 user nova-compute[75014]:   <cpu>
Nov 08 03:45:23 user nova-compute[75014]:     <mode name='host-passthrough' supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='hostPassthroughMigratable'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>off</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </mode>
Nov 08 03:45:23 user nova-compute[75014]:     <mode name='maximum' supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='maximumMigratable'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>on</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>off</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </mode>
Nov 08 03:45:23 user nova-compute[75014]:     <mode name='host-model' supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <vendor>Intel</vendor>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='ss'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='vmx'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='pcid'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='hypervisor'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='arat'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='umip'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='md-clear'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='stibp'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='ssbd'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='ibpb'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='ibrs'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='amd-stibp'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='disable' name='erms'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='disable' name='lm'/>
Nov 08 03:45:23 user nova-compute[75014]:     </mode>
Nov 08 03:45:23 user nova-compute[75014]:     <mode name='custom' supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>qemu64</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>qemu32</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>phenom</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>pentium3</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>pentium2</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>pentium</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>n270</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>kvm64</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>kvm32</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>coreduo</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>core2duo</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>athlon</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Westmere</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Snowridge</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Server</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Client</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>SandyBridge</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Penryn</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G5</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G4</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G3</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G2</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G1</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Nehalem</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>IvyBridge</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Icelake-Server</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Haswell</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>EPYC-Rome</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>EPYC-Milan</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>EPYC</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Dhyana</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Cooperlake</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Conroe</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Broadwell</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>486</model>
Nov 08 03:45:23 user nova-compute[75014]:     </mode>
Nov 08 03:45:23 user nova-compute[75014]:   </cpu>
Nov 08 03:45:23 user nova-compute[75014]:   <memoryBacking supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:     <enum name='sourceType'>
Nov 08 03:45:23 user nova-compute[75014]:       <value>file</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>anonymous</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>memfd</value>
Nov 08 03:45:23 user nova-compute[75014]:     </enum>
Nov 08 03:45:23 user nova-compute[75014]:   </memoryBacking>
Nov 08 03:45:23 user nova-compute[75014]:   <devices>
Nov 08 03:45:23 user nova-compute[75014]:     <disk supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='diskDevice'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>disk</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>cdrom</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>floppy</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>lun</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='bus'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>fdc</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>scsi</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>usb</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>sata</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='model'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio-transitional</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio-non-transitional</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </disk>
Nov 08 03:45:23 user nova-compute[75014]:     <graphics supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='type'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>sdl</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>vnc</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>spice</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>egl-headless</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </graphics>
Nov 08 03:45:23 user nova-compute[75014]:     <video supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='modelType'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>vga</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>cirrus</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>vmvga</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>qxl</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>none</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>bochs</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>ramfb</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </video>
Nov 08 03:45:23 user nova-compute[75014]:     <hostdev supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='mode'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>subsystem</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='startupPolicy'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>default</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>mandatory</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>requisite</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>optional</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='subsysType'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>usb</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>pci</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>scsi</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='capsType'/>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='pciBackend'/>
Nov 08 03:45:23 user nova-compute[75014]:     </hostdev>
Nov 08 03:45:23 user nova-compute[75014]:     <rng supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='model'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio-transitional</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio-non-transitional</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='backendModel'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>random</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>egd</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>builtin</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </rng>
Nov 08 03:45:23 user nova-compute[75014]:     <filesystem supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='driverType'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>path</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>handle</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtiofs</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </filesystem>
Nov 08 03:45:23 user nova-compute[75014]:     <tpm supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='model'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>tpm-tis</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>tpm-crb</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='backendModel'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>passthrough</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>emulator</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </tpm>
Nov 08 03:45:23 user nova-compute[75014]:   </devices>
Nov 08 03:45:23 user nova-compute[75014]:   <features>
Nov 08 03:45:23 user nova-compute[75014]:     <gic supported='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     <vmcoreinfo supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:     <genid supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:     <backingStoreInput supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:     <backup supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:     <sev supported='no'/>
Nov 08 03:45:23 user nova-compute[75014]:   </features>
Nov 08 03:45:23 user nova-compute[75014]: </domainCapabilities>
Nov 08 03:45:23 user nova-compute[75014]:  {{(pid=75014) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75014) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75014) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75014) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75014) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75014) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75014) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75014) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75014) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75014) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75014) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75014) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75014) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75014) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75014) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75014) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75014) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75014) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=75014) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75014) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75014) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75014) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75014) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75014) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75014) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75014) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75014) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75014) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75014) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75014) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75014) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75014) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75014) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75014) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75014) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75014) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75014) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75014) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75014) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'pc', 'ubuntu-q35', 'q35'} {{(pid=75014) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 08 03:45:23 user nova-compute[75014]: <domainCapabilities>
Nov 08 03:45:23 user nova-compute[75014]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 03:45:23 user nova-compute[75014]:   <domain>kvm</domain>
Nov 08 03:45:23 user nova-compute[75014]:   <machine>pc-i440fx-jammy</machine>
Nov 08 03:45:23 user nova-compute[75014]:   <arch>x86_64</arch>
Nov 08 03:45:23 user nova-compute[75014]:   <vcpu max='255'/>
Nov 08 03:45:23 user nova-compute[75014]:   <iothreads supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:   <os supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:     <enum name='firmware'>
Nov 08 03:45:23 user nova-compute[75014]:       <value>efi</value>
Nov 08 03:45:23 user nova-compute[75014]:     </enum>
Nov 08 03:45:23 user nova-compute[75014]:     <loader supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='type'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>rom</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>pflash</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='readonly'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>yes</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>no</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='secure'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>no</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </loader>
Nov 08 03:45:23 user nova-compute[75014]:   </os>
Nov 08 03:45:23 user nova-compute[75014]:   <cpu>
Nov 08 03:45:23 user nova-compute[75014]:     <mode name='host-passthrough' supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='hostPassthroughMigratable'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>on</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>off</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </mode>
Nov 08 03:45:23 user nova-compute[75014]:     <mode name='maximum' supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='maximumMigratable'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>on</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>off</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </mode>
Nov 08 03:45:23 user nova-compute[75014]:     <mode name='host-model' supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <vendor>Intel</vendor>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='ss'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='vmx'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='pcid'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='hypervisor'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='arat'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='umip'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='md-clear'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='stibp'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='ssbd'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='invtsc'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='ibpb'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='ibrs'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='amd-stibp'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='rsba'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='disable' name='erms'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 03:45:23 user nova-compute[75014]:     </mode>
Nov 08 03:45:23 user nova-compute[75014]:     <mode name='custom' supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>qemu64</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>qemu32</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>phenom</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>pentium3</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>pentium2</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>pentium</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>n270</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>kvm64</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>kvm32</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>coreduo</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>core2duo</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>athlon</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>Westmere</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Snowridge</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Server</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Client</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>SandyBridge</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>Penryn</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G5</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G4</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G3</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G2</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>Opteron_G1</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>Nehalem</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>IvyBridge</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Icelake-Server</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Haswell</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>EPYC-Rome</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>EPYC-Milan</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>EPYC</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Dhyana</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Cooperlake</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>Conroe</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Broadwell</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>486</model>
Nov 08 03:45:23 user nova-compute[75014]:     </mode>
Nov 08 03:45:23 user nova-compute[75014]:   </cpu>
Nov 08 03:45:23 user nova-compute[75014]:   <memoryBacking supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:     <enum name='sourceType'>
Nov 08 03:45:23 user nova-compute[75014]:       <value>file</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>anonymous</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>memfd</value>
Nov 08 03:45:23 user nova-compute[75014]:     </enum>
Nov 08 03:45:23 user nova-compute[75014]:   </memoryBacking>
Nov 08 03:45:23 user nova-compute[75014]:   <devices>
Nov 08 03:45:23 user nova-compute[75014]:     <disk supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='diskDevice'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>disk</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>cdrom</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>floppy</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>lun</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='bus'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>ide</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>fdc</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>scsi</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>usb</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>sata</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='model'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio-transitional</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio-non-transitional</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </disk>
Nov 08 03:45:23 user nova-compute[75014]:     <graphics supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='type'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>sdl</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>vnc</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>spice</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>egl-headless</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </graphics>
Nov 08 03:45:23 user nova-compute[75014]:     <video supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='modelType'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>vga</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>cirrus</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>vmvga</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>qxl</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>none</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>bochs</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>ramfb</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </video>
Nov 08 03:45:23 user nova-compute[75014]:     <hostdev supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='mode'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>subsystem</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='startupPolicy'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>default</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>mandatory</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>requisite</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>optional</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='subsysType'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>usb</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>pci</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>scsi</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='capsType'/>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='pciBackend'/>
Nov 08 03:45:23 user nova-compute[75014]:     </hostdev>
Nov 08 03:45:23 user nova-compute[75014]:     <rng supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='model'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio-transitional</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio-non-transitional</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='backendModel'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>random</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>egd</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>builtin</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </rng>
Nov 08 03:45:23 user nova-compute[75014]:     <filesystem supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='driverType'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>path</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>handle</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtiofs</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </filesystem>
Nov 08 03:45:23 user nova-compute[75014]:     <tpm supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='model'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>tpm-tis</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>tpm-crb</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='backendModel'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>passthrough</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>emulator</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </tpm>
Nov 08 03:45:23 user nova-compute[75014]:   </devices>
Nov 08 03:45:23 user nova-compute[75014]:   <features>
Nov 08 03:45:23 user nova-compute[75014]:     <gic supported='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     <vmcoreinfo supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:     <genid supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:     <backingStoreInput supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:     <backup supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:     <sev supported='no'/>
Nov 08 03:45:23 user nova-compute[75014]:   </features>
Nov 08 03:45:23 user nova-compute[75014]: </domainCapabilities>
Nov 08 03:45:23 user nova-compute[75014]:  {{(pid=75014) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 08 03:45:23 user nova-compute[75014]: <domainCapabilities>
Nov 08 03:45:23 user nova-compute[75014]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 03:45:23 user nova-compute[75014]:   <domain>kvm</domain>
Nov 08 03:45:23 user nova-compute[75014]:   <machine>pc-i440fx-6.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:   <arch>x86_64</arch>
Nov 08 03:45:23 user nova-compute[75014]:   <vcpu max='255'/>
Nov 08 03:45:23 user nova-compute[75014]:   <iothreads supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:   <os supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:     <enum name='firmware'>
Nov 08 03:45:23 user nova-compute[75014]:       <value>efi</value>
Nov 08 03:45:23 user nova-compute[75014]:     </enum>
Nov 08 03:45:23 user nova-compute[75014]:     <loader supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='type'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>rom</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>pflash</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='readonly'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>yes</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>no</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='secure'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>no</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </loader>
Nov 08 03:45:23 user nova-compute[75014]:   </os>
Nov 08 03:45:23 user nova-compute[75014]:   <cpu>
Nov 08 03:45:23 user nova-compute[75014]:     <mode name='host-passthrough' supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='hostPassthroughMigratable'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>on</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>off</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </mode>
Nov 08 03:45:23 user nova-compute[75014]:     <mode name='maximum' supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='maximumMigratable'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>on</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>off</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </mode>
Nov 08 03:45:23 user nova-compute[75014]:     <mode name='host-model' supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <vendor>Intel</vendor>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='ss'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='vmx'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='pcid'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='hypervisor'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='arat'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='umip'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='md-clear'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='stibp'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='ssbd'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='invtsc'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='ibpb'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='ibrs'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='amd-stibp'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='rsba'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='disable' name='erms'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 03:45:23 user nova-compute[75014]:     </mode>
Nov 08 03:45:23 user nova-compute[75014]:     <mode name='custom' supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>qemu64</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>qemu32</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>phenom</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>pentium3</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>pentium2</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>pentium</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>n270</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>kvm64</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>kvm32</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>coreduo</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>core2duo</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>athlon</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>Westmere</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Snowridge</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Server</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Client</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>SandyBridge</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>Penryn</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G5</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G4</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G3</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G2</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>Opteron_G1</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>Nehalem</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>IvyBridge</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Icelake-Server</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Haswell</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>EPYC-Rome</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>EPYC-Milan</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>EPYC</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Dhyana</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Cooperlake</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>Conroe</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Broadwell</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>486</model>
Nov 08 03:45:23 user nova-compute[75014]:     </mode>
Nov 08 03:45:23 user nova-compute[75014]:   </cpu>
Nov 08 03:45:23 user nova-compute[75014]:   <memoryBacking supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:     <enum name='sourceType'>
Nov 08 03:45:23 user nova-compute[75014]:       <value>file</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>anonymous</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>memfd</value>
Nov 08 03:45:23 user nova-compute[75014]:     </enum>
Nov 08 03:45:23 user nova-compute[75014]:   </memoryBacking>
Nov 08 03:45:23 user nova-compute[75014]:   <devices>
Nov 08 03:45:23 user nova-compute[75014]:     <disk supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='diskDevice'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>disk</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>cdrom</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>floppy</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>lun</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='bus'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>ide</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>fdc</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>scsi</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>usb</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>sata</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='model'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio-transitional</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio-non-transitional</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </disk>
Nov 08 03:45:23 user nova-compute[75014]:     <graphics supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='type'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>sdl</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>vnc</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>spice</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>egl-headless</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </graphics>
Nov 08 03:45:23 user nova-compute[75014]:     <video supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='modelType'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>vga</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>cirrus</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>vmvga</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>qxl</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>none</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>bochs</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>ramfb</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </video>
Nov 08 03:45:23 user nova-compute[75014]:     <hostdev supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='mode'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>subsystem</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='startupPolicy'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>default</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>mandatory</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>requisite</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>optional</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='subsysType'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>usb</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>pci</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>scsi</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='capsType'/>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='pciBackend'/>
Nov 08 03:45:23 user nova-compute[75014]:     </hostdev>
Nov 08 03:45:23 user nova-compute[75014]:     <rng supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='model'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio-transitional</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio-non-transitional</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='backendModel'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>random</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>egd</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>builtin</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </rng>
Nov 08 03:45:23 user nova-compute[75014]:     <filesystem supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='driverType'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>path</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>handle</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtiofs</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </filesystem>
Nov 08 03:45:23 user nova-compute[75014]:     <tpm supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='model'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>tpm-tis</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>tpm-crb</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='backendModel'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>passthrough</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>emulator</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </tpm>
Nov 08 03:45:23 user nova-compute[75014]:   </devices>
Nov 08 03:45:23 user nova-compute[75014]:   <features>
Nov 08 03:45:23 user nova-compute[75014]:     <gic supported='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     <vmcoreinfo supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:     <genid supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:     <backingStoreInput supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:     <backup supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:     <sev supported='no'/>
Nov 08 03:45:23 user nova-compute[75014]:   </features>
Nov 08 03:45:23 user nova-compute[75014]: </domainCapabilities>
Nov 08 03:45:23 user nova-compute[75014]:  {{(pid=75014) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 08 03:45:23 user nova-compute[75014]: <domainCapabilities>
Nov 08 03:45:23 user nova-compute[75014]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 03:45:23 user nova-compute[75014]:   <domain>kvm</domain>
Nov 08 03:45:23 user nova-compute[75014]:   <machine>pc-q35-jammy</machine>
Nov 08 03:45:23 user nova-compute[75014]:   <arch>x86_64</arch>
Nov 08 03:45:23 user nova-compute[75014]:   <vcpu max='288'/>
Nov 08 03:45:23 user nova-compute[75014]:   <iothreads supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:   <os supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:     <enum name='firmware'>
Nov 08 03:45:23 user nova-compute[75014]:       <value>efi</value>
Nov 08 03:45:23 user nova-compute[75014]:     </enum>
Nov 08 03:45:23 user nova-compute[75014]:     <loader supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='type'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>rom</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>pflash</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='readonly'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>yes</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>no</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='secure'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>yes</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>no</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </loader>
Nov 08 03:45:23 user nova-compute[75014]:   </os>
Nov 08 03:45:23 user nova-compute[75014]:   <cpu>
Nov 08 03:45:23 user nova-compute[75014]:     <mode name='host-passthrough' supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='hostPassthroughMigratable'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>on</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>off</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </mode>
Nov 08 03:45:23 user nova-compute[75014]:     <mode name='maximum' supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='maximumMigratable'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>on</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>off</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </mode>
Nov 08 03:45:23 user nova-compute[75014]:     <mode name='host-model' supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <vendor>Intel</vendor>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='ss'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='vmx'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='pcid'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='hypervisor'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='arat'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='umip'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='md-clear'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='stibp'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='ssbd'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='invtsc'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='ibpb'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='ibrs'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='amd-stibp'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='rsba'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='disable' name='erms'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 03:45:23 user nova-compute[75014]:     </mode>
Nov 08 03:45:23 user nova-compute[75014]:     <mode name='custom' supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>qemu64</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>qemu32</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>phenom</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>pentium3</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>pentium2</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>pentium</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>n270</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>kvm64</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>kvm32</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>coreduo</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>core2duo</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>athlon</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>Westmere</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Snowridge</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Server</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Client</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>SandyBridge</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>Penryn</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G5</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G4</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G3</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G2</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>Opteron_G1</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>Nehalem</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>IvyBridge</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Icelake-Server</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Haswell</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>EPYC-Rome</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>EPYC-Milan</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>EPYC</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Dhyana</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Cooperlake</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>Conroe</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Broadwell</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>486</model>
Nov 08 03:45:23 user nova-compute[75014]:     </mode>
Nov 08 03:45:23 user nova-compute[75014]:   </cpu>
Nov 08 03:45:23 user nova-compute[75014]:   <memoryBacking supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:     <enum name='sourceType'>
Nov 08 03:45:23 user nova-compute[75014]:       <value>file</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>anonymous</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>memfd</value>
Nov 08 03:45:23 user nova-compute[75014]:     </enum>
Nov 08 03:45:23 user nova-compute[75014]:   </memoryBacking>
Nov 08 03:45:23 user nova-compute[75014]:   <devices>
Nov 08 03:45:23 user nova-compute[75014]:     <disk supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='diskDevice'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>disk</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>cdrom</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>floppy</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>lun</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='bus'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>fdc</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>scsi</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>usb</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>sata</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='model'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio-transitional</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio-non-transitional</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </disk>
Nov 08 03:45:23 user nova-compute[75014]:     <graphics supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='type'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>sdl</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>vnc</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>spice</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>egl-headless</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </graphics>
Nov 08 03:45:23 user nova-compute[75014]:     <video supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='modelType'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>vga</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>cirrus</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>vmvga</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>qxl</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>none</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>bochs</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>ramfb</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </video>
Nov 08 03:45:23 user nova-compute[75014]:     <hostdev supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='mode'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>subsystem</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='startupPolicy'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>default</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>mandatory</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>requisite</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>optional</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='subsysType'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>usb</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>pci</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>scsi</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='capsType'/>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='pciBackend'/>
Nov 08 03:45:23 user nova-compute[75014]:     </hostdev>
Nov 08 03:45:23 user nova-compute[75014]:     <rng supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='model'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio-transitional</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio-non-transitional</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='backendModel'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>random</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>egd</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>builtin</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </rng>
Nov 08 03:45:23 user nova-compute[75014]:     <filesystem supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='driverType'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>path</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>handle</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtiofs</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </filesystem>
Nov 08 03:45:23 user nova-compute[75014]:     <tpm supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='model'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>tpm-tis</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>tpm-crb</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='backendModel'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>passthrough</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>emulator</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </tpm>
Nov 08 03:45:23 user nova-compute[75014]:   </devices>
Nov 08 03:45:23 user nova-compute[75014]:   <features>
Nov 08 03:45:23 user nova-compute[75014]:     <gic supported='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     <vmcoreinfo supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:     <genid supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:     <backingStoreInput supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:     <backup supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:     <sev supported='no'/>
Nov 08 03:45:23 user nova-compute[75014]:   </features>
Nov 08 03:45:23 user nova-compute[75014]: </domainCapabilities>
Nov 08 03:45:23 user nova-compute[75014]:  {{(pid=75014) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 08 03:45:23 user nova-compute[75014]: <domainCapabilities>
Nov 08 03:45:23 user nova-compute[75014]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 03:45:23 user nova-compute[75014]:   <domain>kvm</domain>
Nov 08 03:45:23 user nova-compute[75014]:   <machine>pc-q35-6.2</machine>
Nov 08 03:45:23 user nova-compute[75014]:   <arch>x86_64</arch>
Nov 08 03:45:23 user nova-compute[75014]:   <vcpu max='288'/>
Nov 08 03:45:23 user nova-compute[75014]:   <iothreads supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:   <os supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:     <enum name='firmware'>
Nov 08 03:45:23 user nova-compute[75014]:       <value>efi</value>
Nov 08 03:45:23 user nova-compute[75014]:     </enum>
Nov 08 03:45:23 user nova-compute[75014]:     <loader supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='type'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>rom</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>pflash</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='readonly'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>yes</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>no</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='secure'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>yes</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>no</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </loader>
Nov 08 03:45:23 user nova-compute[75014]:   </os>
Nov 08 03:45:23 user nova-compute[75014]:   <cpu>
Nov 08 03:45:23 user nova-compute[75014]:     <mode name='host-passthrough' supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='hostPassthroughMigratable'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>on</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>off</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </mode>
Nov 08 03:45:23 user nova-compute[75014]:     <mode name='maximum' supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='maximumMigratable'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>on</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>off</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </mode>
Nov 08 03:45:23 user nova-compute[75014]:     <mode name='host-model' supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <vendor>Intel</vendor>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='ss'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='vmx'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='pcid'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='hypervisor'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='arat'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='umip'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='md-clear'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='stibp'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='ssbd'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='invtsc'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='ibpb'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='ibrs'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='amd-stibp'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='rsba'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='disable' name='erms'/>
Nov 08 03:45:23 user nova-compute[75014]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 03:45:23 user nova-compute[75014]:     </mode>
Nov 08 03:45:23 user nova-compute[75014]:     <mode name='custom' supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>qemu64</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>qemu32</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>phenom</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>pentium3</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>pentium2</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>pentium</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>n270</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>kvm64</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>kvm32</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>coreduo</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>core2duo</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>athlon</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>Westmere</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Snowridge</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Server</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Skylake-Client</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>SandyBridge</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>Penryn</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G5</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G4</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G3</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Opteron_G2</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>Opteron_G1</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>Nehalem</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>IvyBridge</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Icelake-Server</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Haswell</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>EPYC-Rome</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>EPYC-Milan</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>EPYC</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Dhyana</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Cooperlake</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>Conroe</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='no'>Broadwell</model>
Nov 08 03:45:23 user nova-compute[75014]:       <model usable='yes'>486</model>
Nov 08 03:45:23 user nova-compute[75014]:     </mode>
Nov 08 03:45:23 user nova-compute[75014]:   </cpu>
Nov 08 03:45:23 user nova-compute[75014]:   <memoryBacking supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:     <enum name='sourceType'>
Nov 08 03:45:23 user nova-compute[75014]:       <value>file</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>anonymous</value>
Nov 08 03:45:23 user nova-compute[75014]:       <value>memfd</value>
Nov 08 03:45:23 user nova-compute[75014]:     </enum>
Nov 08 03:45:23 user nova-compute[75014]:   </memoryBacking>
Nov 08 03:45:23 user nova-compute[75014]:   <devices>
Nov 08 03:45:23 user nova-compute[75014]:     <disk supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='diskDevice'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>disk</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>cdrom</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>floppy</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>lun</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='bus'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>fdc</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>scsi</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>usb</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>sata</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='model'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio-transitional</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio-non-transitional</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </disk>
Nov 08 03:45:23 user nova-compute[75014]:     <graphics supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='type'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>sdl</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>vnc</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>spice</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>egl-headless</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </graphics>
Nov 08 03:45:23 user nova-compute[75014]:     <video supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='modelType'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>vga</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>cirrus</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>vmvga</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>qxl</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>none</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>bochs</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>ramfb</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </video>
Nov 08 03:45:23 user nova-compute[75014]:     <hostdev supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='mode'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>subsystem</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='startupPolicy'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>default</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>mandatory</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>requisite</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>optional</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='subsysType'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>usb</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>pci</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>scsi</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='capsType'/>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='pciBackend'/>
Nov 08 03:45:23 user nova-compute[75014]:     </hostdev>
Nov 08 03:45:23 user nova-compute[75014]:     <rng supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='model'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio-transitional</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtio-non-transitional</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='backendModel'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>random</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>egd</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>builtin</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </rng>
Nov 08 03:45:23 user nova-compute[75014]:     <filesystem supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='driverType'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>path</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>handle</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>virtiofs</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </filesystem>
Nov 08 03:45:23 user nova-compute[75014]:     <tpm supported='yes'>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='model'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>tpm-tis</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>tpm-crb</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:       <enum name='backendModel'>
Nov 08 03:45:23 user nova-compute[75014]:         <value>passthrough</value>
Nov 08 03:45:23 user nova-compute[75014]:         <value>emulator</value>
Nov 08 03:45:23 user nova-compute[75014]:       </enum>
Nov 08 03:45:23 user nova-compute[75014]:     </tpm>
Nov 08 03:45:23 user nova-compute[75014]:   </devices>
Nov 08 03:45:23 user nova-compute[75014]:   <features>
Nov 08 03:45:23 user nova-compute[75014]:     <gic supported='no'/>
Nov 08 03:45:23 user nova-compute[75014]:     <vmcoreinfo supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:     <genid supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:     <backingStoreInput supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:     <backup supported='yes'/>
Nov 08 03:45:23 user nova-compute[75014]:     <sev supported='no'/>
Nov 08 03:45:23 user nova-compute[75014]:   </features>
Nov 08 03:45:23 user nova-compute[75014]: </domainCapabilities>
Nov 08 03:45:23 user nova-compute[75014]:  {{(pid=75014) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75014) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75014) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75014) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75014) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Checking secure boot support for host arch (x86_64) {{(pid=75014) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Checking secure boot support for host arch (x86_64) {{(pid=75014) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Checking secure boot support for host arch (x86_64) {{(pid=75014) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Checking secure boot support for host arch (x86_64) {{(pid=75014) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Checking secure boot support for host arch (x86_64) {{(pid=75014) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 08 03:45:23 user nova-compute[75014]: INFO nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Secure Boot support detected
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] cpu compare xml: <cpu match="exact">
Nov 08 03:45:23 user nova-compute[75014]:   <model>Nehalem</model>
Nov 08 03:45:23 user nova-compute[75014]: </cpu>
Nov 08 03:45:23 user nova-compute[75014]:  {{(pid=75014) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 08 03:45:23 user nova-compute[75014]: INFO nova.virt.node [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Generated node identity 46f4e8be-6fb4-40ac-b067-370499bbfbf0
Nov 08 03:45:23 user nova-compute[75014]: INFO nova.virt.node [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Wrote node identity 46f4e8be-6fb4-40ac-b067-370499bbfbf0 to /opt/stack/data/nova/compute_id
Nov 08 03:45:23 user nova-compute[75014]: WARNING nova.compute.manager [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Compute nodes ['46f4e8be-6fb4-40ac-b067-370499bbfbf0'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 08 03:45:23 user nova-compute[75014]: INFO nova.compute.manager [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 08 03:45:23 user nova-compute[75014]: WARNING nova.compute.manager [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 08 03:45:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 03:45:23 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:45:23 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Hypervisor/Node resource view: name=user free_ram=10987MB free_disk=26.034114837646484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:45:23 user nova-compute[75014]: WARNING nova.compute.resource_tracker [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] No compute node record for user:46f4e8be-6fb4-40ac-b067-370499bbfbf0: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 46f4e8be-6fb4-40ac-b067-370499bbfbf0 could not be found.
Nov 08 03:45:23 user nova-compute[75014]: INFO nova.compute.resource_tracker [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Compute node record created for user:user with uuid: 46f4e8be-6fb4-40ac-b067-370499bbfbf0
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 03:45:23 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 03:45:24 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] [req-e6269ceb-c152-4401-abd9-76d31c9c44b1] Created resource provider record via placement API for resource provider with UUID 46f4e8be-6fb4-40ac-b067-370499bbfbf0 and name user.
Nov 08 03:45:24 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75014) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 08 03:45:24 user nova-compute[75014]: INFO nova.virt.libvirt.host [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] kernel doesn't support AMD SEV
Nov 08 03:45:24 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Updating inventory in ProviderTree for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 03:45:24 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 03:45:24 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Libvirt baseline CPU <cpu>
Nov 08 03:45:24 user nova-compute[75014]:   <arch>x86_64</arch>
Nov 08 03:45:24 user nova-compute[75014]:   <model>Nehalem</model>
Nov 08 03:45:24 user nova-compute[75014]:   <vendor>Intel</vendor>
Nov 08 03:45:24 user nova-compute[75014]:   <topology sockets="6" cores="1" threads="1"/>
Nov 08 03:45:24 user nova-compute[75014]: </cpu>
Nov 08 03:45:24 user nova-compute[75014]:  {{(pid=75014) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 08 03:45:24 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Updated inventory for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 08 03:45:24 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Updating resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 generation from 0 to 1 during operation: update_inventory {{(pid=75014) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 08 03:45:24 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Updating inventory in ProviderTree for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 03:45:24 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Updating resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 generation from 1 to 2 during operation: update_traits {{(pid=75014) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 08 03:45:24 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 03:45:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.641s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:45:24 user nova-compute[75014]: DEBUG nova.service [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Creating RPC server for service compute {{(pid=75014) start /opt/stack/nova/nova/service.py:182}}
Nov 08 03:45:24 user nova-compute[75014]: DEBUG nova.service [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] Join ServiceGroup membership for this service compute {{(pid=75014) start /opt/stack/nova/nova/service.py:199}}
Nov 08 03:45:24 user nova-compute[75014]: DEBUG nova.servicegroup.drivers.db [None req-94a1ce24-226b-4213-98cf-1be04d0aa83d None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75014) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 08 03:46:16 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:46:16 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:46:16 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 03:46:16 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Rebuilding the list of instances to heal {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 03:46:16 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Didn't find any instances for network info cache update. {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 03:46:16 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:46:16 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:46:16 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:46:16 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:46:16 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:46:16 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_power_states {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:46:16 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:46:16 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 03:46:16 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:46:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:46:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:46:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:46:16 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 03:46:16 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:46:16 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:46:16 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=10374MB free_disk=25.93795394897461GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 03:46:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:46:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:46:16 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 03:46:16 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 03:46:16 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:46:16 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:46:17 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 03:46:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:46:17 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:47:15 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:47:15 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:47:16 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:47:16 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 03:47:16 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Rebuilding the list of instances to heal {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 03:47:16 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Didn't find any instances for network info cache update. {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 03:47:16 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:47:16 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:47:16 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:47:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:47:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:47:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:47:16 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 03:47:16 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:47:16 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:47:16 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=10344MB free_disk=26.002090454101562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 03:47:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:47:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:47:16 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 03:47:16 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 03:47:16 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:47:16 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:47:16 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 03:47:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.110s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:47:17 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:47:17 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:47:17 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:47:17 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:47:17 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 03:48:15 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:48:16 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:48:16 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 03:48:16 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Rebuilding the list of instances to heal {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 03:48:16 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Didn't find any instances for network info cache update. {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 03:48:16 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:48:17 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:48:17 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:48:17 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 03:48:18 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:48:18 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:48:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:48:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:48:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:48:18 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 03:48:18 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:48:18 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:48:18 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=10349MB free_disk=25.754718780517578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 03:48:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:48:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:48:18 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 03:48:18 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 03:48:18 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:48:18 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:48:18 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 03:48:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.122s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:48:19 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:48:19 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:49:16 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:49:16 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:49:17 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:49:17 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 03:49:17 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Rebuilding the list of instances to heal {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 03:49:17 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Didn't find any instances for network info cache update. {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 03:49:18 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:49:18 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:49:19 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:49:19 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:49:19 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 03:49:19 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:49:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:19 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 03:49:19 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:49:19 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:49:19 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=9618MB free_disk=25.773963928222656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 03:49:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:19 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 03:49:19 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 03:49:19 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:49:19 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:49:19 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 03:49:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:20 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:49:21 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:49:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "9f205fe5-576f-4ef0-874b-1544c0307a7e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:24 user nova-compute[75014]: DEBUG nova.compute.manager [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 03:49:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:25 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 03:49:25 user nova-compute[75014]: INFO nova.compute.claims [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Claim successful on node user
Nov 08 03:49:25 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:49:25 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:49:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.564s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:25 user nova-compute[75014]: DEBUG nova.compute.manager [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 03:49:25 user nova-compute[75014]: DEBUG nova.compute.manager [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 03:49:25 user nova-compute[75014]: DEBUG nova.network.neutron [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 03:49:25 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 03:49:25 user nova-compute[75014]: DEBUG nova.compute.manager [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 03:49:26 user nova-compute[75014]: DEBUG nova.compute.manager [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 03:49:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 03:49:26 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Creating image(s)
Nov 08 03:49:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "/opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "/opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:26 user nova-compute[75014]: DEBUG nova.policy [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ffadb91b73464e559344658dd11bf60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48713cc3a8e4082b76fc0408088c607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 03:49:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9.part --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "5bfa6580-e0fe-46b0-b497-8db67806113a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "5bfa6580-e0fe-46b0-b497-8db67806113a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:26 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 03:49:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9.part --force-share --output=json" returned: 0 in 0.183s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:26 user nova-compute[75014]: DEBUG nova.virt.images [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] 877f8699-2084-427a-babd-cf4f98c3b417 was qcow2, converting to raw {{(pid=75014) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 03:49:26 user nova-compute[75014]: DEBUG nova.privsep.utils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75014) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 03:49:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9.part /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9.converted {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:26 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 03:49:26 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 03:49:26 user nova-compute[75014]: INFO nova.compute.claims [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Claim successful on node user
Nov 08 03:49:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Acquiring lock "30cf3d8d-a9e0-4b67-b2df-fafaeb616e89" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Lock "30cf3d8d-a9e0-4b67-b2df-fafaeb616e89" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:27 user nova-compute[75014]: DEBUG nova.compute.manager [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 03:49:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9.part /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9.converted" returned: 0 in 0.470s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9.converted --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.315s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:27 user nova-compute[75014]: INFO oslo.privsep.daemon [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpdpe0_iia/privsep.sock']
Nov 08 03:49:27 user sudo[84279]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpdpe0_iia/privsep.sock
Nov 08 03:49:27 user sudo[84279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 08 03:49:27 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:49:27 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:49:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.660s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:27 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 03:49:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.246s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:27 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 03:49:27 user nova-compute[75014]: INFO nova.compute.claims [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Claim successful on node user
Nov 08 03:49:27 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 03:49:27 user nova-compute[75014]: DEBUG nova.network.neutron [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 03:49:27 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 03:49:27 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 03:49:27 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 03:49:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 03:49:27 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Creating image(s)
Nov 08 03:49:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "/opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "/opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "/opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:27 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:49:27 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:49:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.381s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:27 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 03:49:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.557s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:27 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 03:49:27 user nova-compute[75014]: INFO nova.compute.claims [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Claim successful on node user
Nov 08 03:49:27 user nova-compute[75014]: DEBUG nova.policy [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '630b9ba8f1d9471f9cea51f74106381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a182cdeb8543fea1ab24326734991e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 03:49:27 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 03:49:27 user nova-compute[75014]: DEBUG nova.network.neutron [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 03:49:27 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 03:49:27 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 03:49:28 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 03:49:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 03:49:28 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Creating image(s)
Nov 08 03:49:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "/opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "/opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "/opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:28 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:49:28 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:49:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.339s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:28 user nova-compute[75014]: DEBUG nova.compute.manager [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 03:49:28 user nova-compute[75014]: DEBUG nova.policy [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ffadb91b73464e559344658dd11bf60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48713cc3a8e4082b76fc0408088c607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 03:49:28 user nova-compute[75014]: DEBUG nova.compute.manager [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 03:49:28 user nova-compute[75014]: DEBUG nova.network.neutron [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 03:49:28 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 03:49:28 user nova-compute[75014]: DEBUG nova.compute.manager [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 03:49:28 user nova-compute[75014]: DEBUG nova.compute.manager [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 03:49:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 03:49:28 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Creating image(s)
Nov 08 03:49:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Acquiring lock "/opt/stack/data/nova/instances/30cf3d8d-a9e0-4b67-b2df-fafaeb616e89/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Lock "/opt/stack/data/nova/instances/30cf3d8d-a9e0-4b67-b2df-fafaeb616e89/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Lock "/opt/stack/data/nova/instances/30cf3d8d-a9e0-4b67-b2df-fafaeb616e89/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:28 user nova-compute[75014]: DEBUG nova.policy [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb188835ab5c400ab9db33fd38e31920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa81674e9c2471e832ef12631f63abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 03:49:28 user sudo[84279]: pam_unix(sudo:session): session closed for user root
Nov 08 03:49:28 user nova-compute[75014]: INFO oslo.privsep.daemon [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Spawned new privsep daemon via rootwrap
Nov 08 03:49:28 user nova-compute[75014]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 08 03:49:28 user nova-compute[75014]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 08 03:49:28 user nova-compute[75014]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 08 03:49:28 user nova-compute[75014]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84282
Nov 08 03:49:28 user nova-compute[75014]: WARNING oslo_privsep.priv_context [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] privsep daemon already running
Nov 08 03:49:28 user nova-compute[75014]: WARNING oslo_privsep.priv_context [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] privsep daemon already running
Nov 08 03:49:28 user nova-compute[75014]: WARNING oslo_privsep.priv_context [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] privsep daemon already running
Nov 08 03:49:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:28 user nova-compute[75014]: DEBUG nova.network.neutron [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Successfully created port: 4979eddc-54c6-46e4-987a-640c4ccade99 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 03:49:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.187s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.178s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.184s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.176s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.208s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk 1073741824" returned: 0 in 0.042s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.244s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.195s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.197s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk 1073741824" returned: 0 in 0.038s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.479s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Cannot resize image /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Ensure instance console log exists: /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.178s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG nova.network.neutron [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Successfully created port: 3f08242a-d68d-4744-8b4c-49bdc29ea557 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.207s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Cannot resize image /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Ensure instance console log exists: /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.005s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk 1073741824" returned: 0 in 0.161s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.372s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.860s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.191s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.164s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/30cf3d8d-a9e0-4b67-b2df-fafaeb616e89/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/30cf3d8d-a9e0-4b67-b2df-fafaeb616e89/disk 1073741824" returned: 0 in 0.058s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Cannot resize image /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Ensure instance console log exists: /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.215s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Checking if we can resize image /opt/stack/data/nova/instances/30cf3d8d-a9e0-4b67-b2df-fafaeb616e89/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30cf3d8d-a9e0-4b67-b2df-fafaeb616e89/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30cf3d8d-a9e0-4b67-b2df-fafaeb616e89/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Cannot resize image /opt/stack/data/nova/instances/30cf3d8d-a9e0-4b67-b2df-fafaeb616e89/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Ensure instance console log exists: /opt/stack/data/nova/instances/30cf3d8d-a9e0-4b67-b2df-fafaeb616e89/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG nova.network.neutron [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Successfully created port: 5ccfbc09-b908-4eb3-9521-31289eb0641f {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 03:49:30 user nova-compute[75014]: DEBUG nova.network.neutron [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Successfully created port: a428a2cb-5b9c-44fc-bc45-94488f6812b6 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 03:49:31 user nova-compute[75014]: DEBUG nova.network.neutron [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Successfully updated port: a428a2cb-5b9c-44fc-bc45-94488f6812b6 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 03:49:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "refresh_cache-8527ee40-fb8a-469b-9696-d7bde8cc96f7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:49:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquired lock "refresh_cache-8527ee40-fb8a-469b-9696-d7bde8cc96f7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:49:31 user nova-compute[75014]: DEBUG nova.network.neutron [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG nova.network.neutron [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG nova.compute.manager [req-e845955f-d23a-443d-852c-dd46dcb7c821 req-59fb400b-e290-4ef3-b889-7785e373b082 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Received event network-changed-a428a2cb-5b9c-44fc-bc45-94488f6812b6 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG nova.compute.manager [req-e845955f-d23a-443d-852c-dd46dcb7c821 req-59fb400b-e290-4ef3-b889-7785e373b082 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Refreshing instance network info cache due to event network-changed-a428a2cb-5b9c-44fc-bc45-94488f6812b6. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e845955f-d23a-443d-852c-dd46dcb7c821 req-59fb400b-e290-4ef3-b889-7785e373b082 service nova] Acquiring lock "refresh_cache-8527ee40-fb8a-469b-9696-d7bde8cc96f7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG nova.network.neutron [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Updating instance_info_cache with network_info: [{"id": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "address": "fa:16:3e:eb:34:b6", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa428a2cb-5b", "ovs_interfaceid": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Releasing lock "refresh_cache-8527ee40-fb8a-469b-9696-d7bde8cc96f7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Instance network_info: |[{"id": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "address": "fa:16:3e:eb:34:b6", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa428a2cb-5b", "ovs_interfaceid": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e845955f-d23a-443d-852c-dd46dcb7c821 req-59fb400b-e290-4ef3-b889-7785e373b082 service nova] Acquired lock "refresh_cache-8527ee40-fb8a-469b-9696-d7bde8cc96f7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG nova.network.neutron [req-e845955f-d23a-443d-852c-dd46dcb7c821 req-59fb400b-e290-4ef3-b889-7785e373b082 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Refreshing network info cache for port a428a2cb-5b9c-44fc-bc45-94488f6812b6 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Start _get_guest_xml network_info=[{"id": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "address": "fa:16:3e:eb:34:b6", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa428a2cb-5b", "ovs_interfaceid": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 03:49:32 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:49:32 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:49:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG nova.privsep.utils [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75014) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:49:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1953351529',display_name='tempest-ServerRescueNegativeTestJSON-server-1953351529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1953351529',id=4,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b48713cc3a8e4082b76fc0408088c607',ramdisk_id='',reservation_id='r-31tv27la',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1450625183',owner_user_name='tempest-ServerRescueNegativeTestJSON-1450625183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:49:28Z,user_data=None,user_id='ffadb91b73464e559344658dd11bf60d',uuid=8527ee40-fb8a-469b-9696-d7bde8cc96f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "address": "fa:16:3e:eb:34:b6", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa428a2cb-5b", "ovs_interfaceid": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Converting VIF {"id": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "address": "fa:16:3e:eb:34:b6", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa428a2cb-5b", "ovs_interfaceid": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:34:b6,bridge_name='br-int',has_traffic_filtering=True,id=a428a2cb-5b9c-44fc-bc45-94488f6812b6,network=Network(982531ca-8a2f-41de-b62e-5b43b6a45a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa428a2cb-5b') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG nova.objects.instance [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lazy-loading 'pci_devices' on Instance uuid 8527ee40-fb8a-469b-9696-d7bde8cc96f7 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] End _get_guest_xml xml=<domain type="kvm">
Nov 08 03:49:32 user nova-compute[75014]:   <uuid>8527ee40-fb8a-469b-9696-d7bde8cc96f7</uuid>
Nov 08 03:49:32 user nova-compute[75014]:   <name>instance-00000004</name>
Nov 08 03:49:32 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 03:49:32 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 03:49:32 user nova-compute[75014]:   <metadata>
Nov 08 03:49:32 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 03:49:32 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 03:49:32 user nova-compute[75014]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1953351529</nova:name>
Nov 08 03:49:32 user nova-compute[75014]:       <nova:creationTime>2023-11-08 03:49:32</nova:creationTime>
Nov 08 03:49:32 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 03:49:32 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 03:49:32 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 03:49:32 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 03:49:32 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 03:49:32 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 03:49:32 user nova-compute[75014]:       </nova:flavor>
Nov 08 03:49:32 user nova-compute[75014]:       <nova:owner>
Nov 08 03:49:32 user nova-compute[75014]:         <nova:user uuid="ffadb91b73464e559344658dd11bf60d">tempest-ServerRescueNegativeTestJSON-1450625183-project-member</nova:user>
Nov 08 03:49:32 user nova-compute[75014]:         <nova:project uuid="b48713cc3a8e4082b76fc0408088c607">tempest-ServerRescueNegativeTestJSON-1450625183</nova:project>
Nov 08 03:49:32 user nova-compute[75014]:       </nova:owner>
Nov 08 03:49:32 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 03:49:32 user nova-compute[75014]:       <nova:ports>
Nov 08 03:49:32 user nova-compute[75014]:         <nova:port uuid="a428a2cb-5b9c-44fc-bc45-94488f6812b6">
Nov 08 03:49:32 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 03:49:32 user nova-compute[75014]:         </nova:port>
Nov 08 03:49:32 user nova-compute[75014]:       </nova:ports>
Nov 08 03:49:32 user nova-compute[75014]:     </nova:instance>
Nov 08 03:49:32 user nova-compute[75014]:   </metadata>
Nov 08 03:49:32 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 03:49:32 user nova-compute[75014]:     <system>
Nov 08 03:49:32 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 03:49:32 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 03:49:32 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 03:49:32 user nova-compute[75014]:       <entry name="serial">8527ee40-fb8a-469b-9696-d7bde8cc96f7</entry>
Nov 08 03:49:32 user nova-compute[75014]:       <entry name="uuid">8527ee40-fb8a-469b-9696-d7bde8cc96f7</entry>
Nov 08 03:49:32 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 03:49:32 user nova-compute[75014]:     </system>
Nov 08 03:49:32 user nova-compute[75014]:   </sysinfo>
Nov 08 03:49:32 user nova-compute[75014]:   <os>
Nov 08 03:49:32 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 03:49:32 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 03:49:32 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 03:49:32 user nova-compute[75014]:   </os>
Nov 08 03:49:32 user nova-compute[75014]:   <features>
Nov 08 03:49:32 user nova-compute[75014]:     <acpi/>
Nov 08 03:49:32 user nova-compute[75014]:     <apic/>
Nov 08 03:49:32 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 03:49:32 user nova-compute[75014]:   </features>
Nov 08 03:49:32 user nova-compute[75014]:   <clock offset="utc">
Nov 08 03:49:32 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 03:49:32 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 03:49:32 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 03:49:32 user nova-compute[75014]:   </clock>
Nov 08 03:49:32 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 03:49:32 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 03:49:32 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 03:49:32 user nova-compute[75014]:   </cpu>
Nov 08 03:49:32 user nova-compute[75014]:   <devices>
Nov 08 03:49:32 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 03:49:32 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 03:49:32 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk"/>
Nov 08 03:49:32 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 03:49:32 user nova-compute[75014]:     </disk>
Nov 08 03:49:32 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:49:32 user nova-compute[75014]:       <mac address="fa:16:3e:eb:34:b6"/>
Nov 08 03:49:32 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:49:32 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:49:32 user nova-compute[75014]:       <target dev="tapa428a2cb-5b"/>
Nov 08 03:49:32 user nova-compute[75014]:     </interface>
Nov 08 03:49:32 user nova-compute[75014]:     <serial type="pty">
Nov 08 03:49:32 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/console.log" append="off"/>
Nov 08 03:49:32 user nova-compute[75014]:     </serial>
Nov 08 03:49:32 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 03:49:32 user nova-compute[75014]:     <video>
Nov 08 03:49:32 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:49:32 user nova-compute[75014]:     </video>
Nov 08 03:49:32 user nova-compute[75014]:     <rng model="virtio">
Nov 08 03:49:32 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 03:49:32 user nova-compute[75014]:     </rng>
Nov 08 03:49:32 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 03:49:32 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 03:49:32 user nova-compute[75014]:       <stats period="10"/>
Nov 08 03:49:32 user nova-compute[75014]:     </memballoon>
Nov 08 03:49:32 user nova-compute[75014]:   </devices>
Nov 08 03:49:32 user nova-compute[75014]: </domain>
Nov 08 03:49:32 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:49:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1953351529',display_name='tempest-ServerRescueNegativeTestJSON-server-1953351529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1953351529',id=4,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b48713cc3a8e4082b76fc0408088c607',ramdisk_id='',reservation_id='r-31tv27la',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1450625183',owner_user_name='tempest-ServerRescueNegativeTestJSON-1450625183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:49:28Z,user_data=None,user_id='ffadb91b73464e559344658dd11bf60d',uuid=8527ee40-fb8a-469b-9696-d7bde8cc96f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "address": "fa:16:3e:eb:34:b6", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa428a2cb-5b", "ovs_interfaceid": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Converting VIF {"id": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "address": "fa:16:3e:eb:34:b6", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa428a2cb-5b", "ovs_interfaceid": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:34:b6,bridge_name='br-int',has_traffic_filtering=True,id=a428a2cb-5b9c-44fc-bc45-94488f6812b6,network=Network(982531ca-8a2f-41de-b62e-5b43b6a45a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa428a2cb-5b') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:49:32 user nova-compute[75014]: DEBUG os_vif [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:34:b6,bridge_name='br-int',has_traffic_filtering=True,id=a428a2cb-5b9c-44fc-bc45-94488f6812b6,network=Network(982531ca-8a2f-41de-b62e-5b43b6a45a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa428a2cb-5b') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Created schema index Interface.name {{(pid=75014) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Created schema index Port.name {{(pid=75014) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Created schema index Bridge.name {{(pid=75014) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [POLLOUT] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a5a3118-d502-5ae2-9aa7-f99783714b51', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:33 user nova-compute[75014]: INFO oslo.privsep.daemon [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp6nddua79/privsep.sock']
Nov 08 03:49:33 user nova-compute[75014]: DEBUG nova.network.neutron [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Successfully updated port: 3f08242a-d68d-4744-8b4c-49bdc29ea557 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 03:49:33 user sudo[84351]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp6nddua79/privsep.sock
Nov 08 03:49:33 user sudo[84351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 08 03:49:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "refresh_cache-5bfa6580-e0fe-46b0-b497-8db67806113a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquired lock "refresh_cache-5bfa6580-e0fe-46b0-b497-8db67806113a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG nova.network.neutron [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG nova.network.neutron [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Successfully updated port: 4979eddc-54c6-46e4-987a-640c4ccade99 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "refresh_cache-9f205fe5-576f-4ef0-874b-1544c0307a7e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquired lock "refresh_cache-9f205fe5-576f-4ef0-874b-1544c0307a7e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG nova.network.neutron [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG nova.network.neutron [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG nova.compute.manager [req-1a466816-e3d7-4a9e-acf7-f498be94f1ef req-64d4e4b1-d65c-4e13-81fd-cadff265a6d6 service nova] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Received event network-changed-3f08242a-d68d-4744-8b4c-49bdc29ea557 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG nova.compute.manager [req-1a466816-e3d7-4a9e-acf7-f498be94f1ef req-64d4e4b1-d65c-4e13-81fd-cadff265a6d6 service nova] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Refreshing instance network info cache due to event network-changed-3f08242a-d68d-4744-8b4c-49bdc29ea557. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1a466816-e3d7-4a9e-acf7-f498be94f1ef req-64d4e4b1-d65c-4e13-81fd-cadff265a6d6 service nova] Acquiring lock "refresh_cache-5bfa6580-e0fe-46b0-b497-8db67806113a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG nova.network.neutron [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG nova.compute.manager [req-cf90b3d0-887c-4a72-8214-6c3153cdd518 req-5943598f-9c5a-4f18-b314-21efa8a8baed service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Received event network-changed-4979eddc-54c6-46e4-987a-640c4ccade99 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG nova.compute.manager [req-cf90b3d0-887c-4a72-8214-6c3153cdd518 req-5943598f-9c5a-4f18-b314-21efa8a8baed service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Refreshing instance network info cache due to event network-changed-4979eddc-54c6-46e4-987a-640c4ccade99. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-cf90b3d0-887c-4a72-8214-6c3153cdd518 req-5943598f-9c5a-4f18-b314-21efa8a8baed service nova] Acquiring lock "refresh_cache-9f205fe5-576f-4ef0-874b-1544c0307a7e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG nova.network.neutron [req-e845955f-d23a-443d-852c-dd46dcb7c821 req-59fb400b-e290-4ef3-b889-7785e373b082 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Updated VIF entry in instance network info cache for port a428a2cb-5b9c-44fc-bc45-94488f6812b6. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG nova.network.neutron [req-e845955f-d23a-443d-852c-dd46dcb7c821 req-59fb400b-e290-4ef3-b889-7785e373b082 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Updating instance_info_cache with network_info: [{"id": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "address": "fa:16:3e:eb:34:b6", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa428a2cb-5b", "ovs_interfaceid": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:49:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e845955f-d23a-443d-852c-dd46dcb7c821 req-59fb400b-e290-4ef3-b889-7785e373b082 service nova] Releasing lock "refresh_cache-8527ee40-fb8a-469b-9696-d7bde8cc96f7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.compute.manager [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 03:49:34 user nova-compute[75014]: INFO nova.compute.claims [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Claim successful on node user
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.network.neutron [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Updating instance_info_cache with network_info: [{"id": "4979eddc-54c6-46e4-987a-640c4ccade99", "address": "fa:16:3e:4c:b6:69", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4979eddc-54", "ovs_interfaceid": "4979eddc-54c6-46e4-987a-640c4ccade99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Releasing lock "refresh_cache-9f205fe5-576f-4ef0-874b-1544c0307a7e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.compute.manager [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Instance network_info: |[{"id": "4979eddc-54c6-46e4-987a-640c4ccade99", "address": "fa:16:3e:4c:b6:69", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4979eddc-54", "ovs_interfaceid": "4979eddc-54c6-46e4-987a-640c4ccade99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-cf90b3d0-887c-4a72-8214-6c3153cdd518 req-5943598f-9c5a-4f18-b314-21efa8a8baed service nova] Acquired lock "refresh_cache-9f205fe5-576f-4ef0-874b-1544c0307a7e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.network.neutron [req-cf90b3d0-887c-4a72-8214-6c3153cdd518 req-5943598f-9c5a-4f18-b314-21efa8a8baed service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Refreshing network info cache for port 4979eddc-54c6-46e4-987a-640c4ccade99 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Start _get_guest_xml network_info=[{"id": "4979eddc-54c6-46e4-987a-640c4ccade99", "address": "fa:16:3e:4c:b6:69", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4979eddc-54", "ovs_interfaceid": "4979eddc-54c6-46e4-987a-640c4ccade99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 03:49:34 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:49:34 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.network.neutron [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Successfully updated port: 5ccfbc09-b908-4eb3-9521-31289eb0641f {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-577890555',display_name='tempest-ServerRescueNegativeTestJSON-server-577890555',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-577890555',id=1,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b48713cc3a8e4082b76fc0408088c607',ramdisk_id='',reservation_id='r-wy8e0crs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1450625183',owner_user_name='tempest-ServerRescueNegativeTestJSON-1450625183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:49:26Z,user_data=None,user_id='ffadb91b73464e559344658dd11bf60d',uuid=9f205fe5-576f-4ef0-874b-1544c0307a7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4979eddc-54c6-46e4-987a-640c4ccade99", "address": "fa:16:3e:4c:b6:69", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4979eddc-54", "ovs_interfaceid": "4979eddc-54c6-46e4-987a-640c4ccade99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Converting VIF {"id": "4979eddc-54c6-46e4-987a-640c4ccade99", "address": "fa:16:3e:4c:b6:69", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4979eddc-54", "ovs_interfaceid": "4979eddc-54c6-46e4-987a-640c4ccade99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:b6:69,bridge_name='br-int',has_traffic_filtering=True,id=4979eddc-54c6-46e4-987a-640c4ccade99,network=Network(982531ca-8a2f-41de-b62e-5b43b6a45a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4979eddc-54') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.objects.instance [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f205fe5-576f-4ef0-874b-1544c0307a7e {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Acquiring lock "refresh_cache-30cf3d8d-a9e0-4b67-b2df-fafaeb616e89" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Acquired lock "refresh_cache-30cf3d8d-a9e0-4b67-b2df-fafaeb616e89" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.network.neutron [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] End _get_guest_xml xml=<domain type="kvm">
Nov 08 03:49:34 user nova-compute[75014]:   <uuid>9f205fe5-576f-4ef0-874b-1544c0307a7e</uuid>
Nov 08 03:49:34 user nova-compute[75014]:   <name>instance-00000001</name>
Nov 08 03:49:34 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 03:49:34 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 03:49:34 user nova-compute[75014]:   <metadata>
Nov 08 03:49:34 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 03:49:34 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 03:49:34 user nova-compute[75014]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-577890555</nova:name>
Nov 08 03:49:34 user nova-compute[75014]:       <nova:creationTime>2023-11-08 03:49:34</nova:creationTime>
Nov 08 03:49:34 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 03:49:34 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 03:49:34 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 03:49:34 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 03:49:34 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 03:49:34 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 03:49:34 user nova-compute[75014]:       </nova:flavor>
Nov 08 03:49:34 user nova-compute[75014]:       <nova:owner>
Nov 08 03:49:34 user nova-compute[75014]:         <nova:user uuid="ffadb91b73464e559344658dd11bf60d">tempest-ServerRescueNegativeTestJSON-1450625183-project-member</nova:user>
Nov 08 03:49:34 user nova-compute[75014]:         <nova:project uuid="b48713cc3a8e4082b76fc0408088c607">tempest-ServerRescueNegativeTestJSON-1450625183</nova:project>
Nov 08 03:49:34 user nova-compute[75014]:       </nova:owner>
Nov 08 03:49:34 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 03:49:34 user nova-compute[75014]:       <nova:ports>
Nov 08 03:49:34 user nova-compute[75014]:         <nova:port uuid="4979eddc-54c6-46e4-987a-640c4ccade99">
Nov 08 03:49:34 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 03:49:34 user nova-compute[75014]:         </nova:port>
Nov 08 03:49:34 user nova-compute[75014]:       </nova:ports>
Nov 08 03:49:34 user nova-compute[75014]:     </nova:instance>
Nov 08 03:49:34 user nova-compute[75014]:   </metadata>
Nov 08 03:49:34 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 03:49:34 user nova-compute[75014]:     <system>
Nov 08 03:49:34 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 03:49:34 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 03:49:34 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 03:49:34 user nova-compute[75014]:       <entry name="serial">9f205fe5-576f-4ef0-874b-1544c0307a7e</entry>
Nov 08 03:49:34 user nova-compute[75014]:       <entry name="uuid">9f205fe5-576f-4ef0-874b-1544c0307a7e</entry>
Nov 08 03:49:34 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 03:49:34 user nova-compute[75014]:     </system>
Nov 08 03:49:34 user nova-compute[75014]:   </sysinfo>
Nov 08 03:49:34 user nova-compute[75014]:   <os>
Nov 08 03:49:34 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 03:49:34 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 03:49:34 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 03:49:34 user nova-compute[75014]:   </os>
Nov 08 03:49:34 user nova-compute[75014]:   <features>
Nov 08 03:49:34 user nova-compute[75014]:     <acpi/>
Nov 08 03:49:34 user nova-compute[75014]:     <apic/>
Nov 08 03:49:34 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 03:49:34 user nova-compute[75014]:   </features>
Nov 08 03:49:34 user nova-compute[75014]:   <clock offset="utc">
Nov 08 03:49:34 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 03:49:34 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 03:49:34 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 03:49:34 user nova-compute[75014]:   </clock>
Nov 08 03:49:34 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 03:49:34 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 03:49:34 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 03:49:34 user nova-compute[75014]:   </cpu>
Nov 08 03:49:34 user nova-compute[75014]:   <devices>
Nov 08 03:49:34 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 03:49:34 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 03:49:34 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk"/>
Nov 08 03:49:34 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 03:49:34 user nova-compute[75014]:     </disk>
Nov 08 03:49:34 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:49:34 user nova-compute[75014]:       <mac address="fa:16:3e:4c:b6:69"/>
Nov 08 03:49:34 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:49:34 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:49:34 user nova-compute[75014]:       <target dev="tap4979eddc-54"/>
Nov 08 03:49:34 user nova-compute[75014]:     </interface>
Nov 08 03:49:34 user nova-compute[75014]:     <serial type="pty">
Nov 08 03:49:34 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/console.log" append="off"/>
Nov 08 03:49:34 user nova-compute[75014]:     </serial>
Nov 08 03:49:34 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 03:49:34 user nova-compute[75014]:     <video>
Nov 08 03:49:34 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:49:34 user nova-compute[75014]:     </video>
Nov 08 03:49:34 user nova-compute[75014]:     <rng model="virtio">
Nov 08 03:49:34 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 03:49:34 user nova-compute[75014]:     </rng>
Nov 08 03:49:34 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 03:49:34 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 03:49:34 user nova-compute[75014]:       <stats period="10"/>
Nov 08 03:49:34 user nova-compute[75014]:     </memballoon>
Nov 08 03:49:34 user nova-compute[75014]:   </devices>
Nov 08 03:49:34 user nova-compute[75014]: </domain>
Nov 08 03:49:34 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-577890555',display_name='tempest-ServerRescueNegativeTestJSON-server-577890555',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-577890555',id=1,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b48713cc3a8e4082b76fc0408088c607',ramdisk_id='',reservation_id='r-wy8e0crs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1450625183',owner_user_name='tempest-ServerRescueNegativeTestJSON-1450625183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:49:26Z,user_data=None,user_id='ffadb91b73464e559344658dd11bf60d',uuid=9f205fe5-576f-4ef0-874b-1544c0307a7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4979eddc-54c6-46e4-987a-640c4ccade99", "address": "fa:16:3e:4c:b6:69", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4979eddc-54", "ovs_interfaceid": "4979eddc-54c6-46e4-987a-640c4ccade99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Converting VIF {"id": "4979eddc-54c6-46e4-987a-640c4ccade99", "address": "fa:16:3e:4c:b6:69", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4979eddc-54", "ovs_interfaceid": "4979eddc-54c6-46e4-987a-640c4ccade99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:b6:69,bridge_name='br-int',has_traffic_filtering=True,id=4979eddc-54c6-46e4-987a-640c4ccade99,network=Network(982531ca-8a2f-41de-b62e-5b43b6a45a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4979eddc-54') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG os_vif [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:b6:69,bridge_name='br-int',has_traffic_filtering=True,id=4979eddc-54c6-46e4-987a-640c4ccade99,network=Network(982531ca-8a2f-41de-b62e-5b43b6a45a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4979eddc-54') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '353a2e99-62cf-597b-9358-304afb87356a', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.compute.manager [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 03:49:34 user sudo[84351]: pam_unix(sudo:session): session closed for user root
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.network.neutron [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Updating instance_info_cache with network_info: [{"id": "3f08242a-d68d-4744-8b4c-49bdc29ea557", "address": "fa:16:3e:65:f5:c2", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f08242a-d6", "ovs_interfaceid": "3f08242a-d68d-4744-8b4c-49bdc29ea557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:49:34 user nova-compute[75014]: INFO oslo.privsep.daemon [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Spawned new privsep daemon via rootwrap
Nov 08 03:49:34 user nova-compute[75014]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 08 03:49:34 user nova-compute[75014]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 08 03:49:34 user nova-compute[75014]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 08 03:49:34 user nova-compute[75014]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84354
Nov 08 03:49:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Releasing lock "refresh_cache-5bfa6580-e0fe-46b0-b497-8db67806113a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Instance network_info: |[{"id": "3f08242a-d68d-4744-8b4c-49bdc29ea557", "address": "fa:16:3e:65:f5:c2", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f08242a-d6", "ovs_interfaceid": "3f08242a-d68d-4744-8b4c-49bdc29ea557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1a466816-e3d7-4a9e-acf7-f498be94f1ef req-64d4e4b1-d65c-4e13-81fd-cadff265a6d6 service nova] Acquired lock "refresh_cache-5bfa6580-e0fe-46b0-b497-8db67806113a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.network.neutron [req-1a466816-e3d7-4a9e-acf7-f498be94f1ef req-64d4e4b1-d65c-4e13-81fd-cadff265a6d6 service nova] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Refreshing network info cache for port 3f08242a-d68d-4744-8b4c-49bdc29ea557 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Start _get_guest_xml network_info=[{"id": "3f08242a-d68d-4744-8b4c-49bdc29ea557", "address": "fa:16:3e:65:f5:c2", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f08242a-d6", "ovs_interfaceid": "3f08242a-d68d-4744-8b4c-49bdc29ea557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.compute.manager [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.network.neutron [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 03:49:34 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:49:34 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:49:34 user nova-compute[75014]: WARNING oslo_privsep.priv_context [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] privsep daemon already running
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:49:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1651379021',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1651379021',id=2,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92a182cdeb8543fea1ab24326734991e',ramdisk_id='',reservation_id='r-zwcl00y6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648299000',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:49:28Z,user_data=None,user_id='630b9ba8f1d9471f9cea51f74106381a',uuid=5bfa6580-e0fe-46b0-b497-8db67806113a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f08242a-d68d-4744-8b4c-49bdc29ea557", "address": "fa:16:3e:65:f5:c2", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f08242a-d6", "ovs_interfaceid": "3f08242a-d68d-4744-8b4c-49bdc29ea557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Converting VIF {"id": "3f08242a-d68d-4744-8b4c-49bdc29ea557", "address": "fa:16:3e:65:f5:c2", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f08242a-d6", "ovs_interfaceid": "3f08242a-d68d-4744-8b4c-49bdc29ea557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:f5:c2,bridge_name='br-int',has_traffic_filtering=True,id=3f08242a-d68d-4744-8b4c-49bdc29ea557,network=Network(d45dbf14-9570-46c1-91a3-cbe2f7972b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f08242a-d6') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.objects.instance [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lazy-loading 'pci_devices' on Instance uuid 5bfa6580-e0fe-46b0-b497-8db67806113a {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.network.neutron [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 03:49:34 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] End _get_guest_xml xml=<domain type="kvm">
Nov 08 03:49:34 user nova-compute[75014]:   <uuid>5bfa6580-e0fe-46b0-b497-8db67806113a</uuid>
Nov 08 03:49:34 user nova-compute[75014]:   <name>instance-00000002</name>
Nov 08 03:49:34 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 03:49:34 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 03:49:34 user nova-compute[75014]:   <metadata>
Nov 08 03:49:34 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 03:49:34 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 03:49:34 user nova-compute[75014]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1651379021</nova:name>
Nov 08 03:49:34 user nova-compute[75014]:       <nova:creationTime>2023-11-08 03:49:34</nova:creationTime>
Nov 08 03:49:34 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 03:49:34 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 03:49:34 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 03:49:34 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 03:49:34 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 03:49:34 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 03:49:34 user nova-compute[75014]:       </nova:flavor>
Nov 08 03:49:34 user nova-compute[75014]:       <nova:owner>
Nov 08 03:49:34 user nova-compute[75014]:         <nova:user uuid="630b9ba8f1d9471f9cea51f74106381a">tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member</nova:user>
Nov 08 03:49:34 user nova-compute[75014]:         <nova:project uuid="92a182cdeb8543fea1ab24326734991e">tempest-ServerBootFromVolumeStableRescueTest-1648299000</nova:project>
Nov 08 03:49:34 user nova-compute[75014]:       </nova:owner>
Nov 08 03:49:34 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 03:49:34 user nova-compute[75014]:       <nova:ports>
Nov 08 03:49:34 user nova-compute[75014]:         <nova:port uuid="3f08242a-d68d-4744-8b4c-49bdc29ea557">
Nov 08 03:49:34 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 03:49:34 user nova-compute[75014]:         </nova:port>
Nov 08 03:49:34 user nova-compute[75014]:       </nova:ports>
Nov 08 03:49:34 user nova-compute[75014]:     </nova:instance>
Nov 08 03:49:34 user nova-compute[75014]:   </metadata>
Nov 08 03:49:34 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 03:49:34 user nova-compute[75014]:     <system>
Nov 08 03:49:34 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 03:49:34 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 03:49:34 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 03:49:34 user nova-compute[75014]:       <entry name="serial">5bfa6580-e0fe-46b0-b497-8db67806113a</entry>
Nov 08 03:49:34 user nova-compute[75014]:       <entry name="uuid">5bfa6580-e0fe-46b0-b497-8db67806113a</entry>
Nov 08 03:49:34 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 03:49:34 user nova-compute[75014]:     </system>
Nov 08 03:49:34 user nova-compute[75014]:   </sysinfo>
Nov 08 03:49:34 user nova-compute[75014]:   <os>
Nov 08 03:49:34 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 03:49:34 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 03:49:34 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 03:49:34 user nova-compute[75014]:   </os>
Nov 08 03:49:34 user nova-compute[75014]:   <features>
Nov 08 03:49:34 user nova-compute[75014]:     <acpi/>
Nov 08 03:49:34 user nova-compute[75014]:     <apic/>
Nov 08 03:49:34 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 03:49:34 user nova-compute[75014]:   </features>
Nov 08 03:49:34 user nova-compute[75014]:   <clock offset="utc">
Nov 08 03:49:34 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 03:49:34 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 03:49:34 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 03:49:34 user nova-compute[75014]:   </clock>
Nov 08 03:49:34 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 03:49:34 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 03:49:34 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 03:49:34 user nova-compute[75014]:   </cpu>
Nov 08 03:49:34 user nova-compute[75014]:   <devices>
Nov 08 03:49:34 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 03:49:34 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 03:49:34 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk"/>
Nov 08 03:49:34 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 03:49:34 user nova-compute[75014]:     </disk>
Nov 08 03:49:34 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:49:34 user nova-compute[75014]:       <mac address="fa:16:3e:65:f5:c2"/>
Nov 08 03:49:34 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:49:34 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:49:34 user nova-compute[75014]:       <target dev="tap3f08242a-d6"/>
Nov 08 03:49:34 user nova-compute[75014]:     </interface>
Nov 08 03:49:34 user nova-compute[75014]:     <serial type="pty">
Nov 08 03:49:34 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/console.log" append="off"/>
Nov 08 03:49:34 user nova-compute[75014]:     </serial>
Nov 08 03:49:34 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 03:49:34 user nova-compute[75014]:     <video>
Nov 08 03:49:34 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:49:34 user nova-compute[75014]:     </video>
Nov 08 03:49:34 user nova-compute[75014]:     <rng model="virtio">
Nov 08 03:49:34 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 03:49:34 user nova-compute[75014]:     </rng>
Nov 08 03:49:34 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 03:49:34 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 03:49:34 user nova-compute[75014]:       <stats period="10"/>
Nov 08 03:49:34 user nova-compute[75014]:     </memballoon>
Nov 08 03:49:34 user nova-compute[75014]:   </devices>
Nov 08 03:49:34 user nova-compute[75014]: </domain>
Nov 08 03:49:34 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:49:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1651379021',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1651379021',id=2,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92a182cdeb8543fea1ab24326734991e',ramdisk_id='',reservation_id='r-zwcl00y6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648299000',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:49:28Z,user_data=None,user_id='630b9ba8f1d9471f9cea51f74106381a',uuid=5bfa6580-e0fe-46b0-b497-8db67806113a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f08242a-d68d-4744-8b4c-49bdc29ea557", "address": "fa:16:3e:65:f5:c2", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f08242a-d6", "ovs_interfaceid": "3f08242a-d68d-4744-8b4c-49bdc29ea557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Converting VIF {"id": "3f08242a-d68d-4744-8b4c-49bdc29ea557", "address": "fa:16:3e:65:f5:c2", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f08242a-d6", "ovs_interfaceid": "3f08242a-d68d-4744-8b4c-49bdc29ea557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:f5:c2,bridge_name='br-int',has_traffic_filtering=True,id=3f08242a-d68d-4744-8b4c-49bdc29ea557,network=Network(d45dbf14-9570-46c1-91a3-cbe2f7972b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f08242a-d6') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG os_vif [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:f5:c2,bridge_name='br-int',has_traffic_filtering=True,id=3f08242a-d68d-4744-8b4c-49bdc29ea557,network=Network(d45dbf14-9570-46c1-91a3-cbe2f7972b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f08242a-d6') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e9ce9a8e-e7b0-5cff-b4f9-a563f4eaa64d', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:49:34 user nova-compute[75014]: DEBUG nova.compute.manager [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.compute.manager [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 03:49:35 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Creating image(s)
Nov 08 03:49:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "/opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "/opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.policy [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74a49a9155064771bd4e8a179f9111ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d70b55f2bb42e5b7123acfcd621b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.197s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa428a2cb-5b, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa428a2cb-5b, col_values=(('qos', UUID('1b156806-49f2-40f8-8aa8-d1bed3c4006e')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa428a2cb-5b, col_values=(('external_ids', {'iface-id': 'a428a2cb-5b9c-44fc-bc45-94488f6812b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:34:b6', 'vm-uuid': '8527ee40-fb8a-469b-9696-d7bde8cc96f7'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:35 user nova-compute[75014]: INFO os_vif [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:34:b6,bridge_name='br-int',has_traffic_filtering=True,id=a428a2cb-5b9c-44fc-bc45-94488f6812b6,network=Network(982531ca-8a2f-41de-b62e-5b43b6a45a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa428a2cb-5b')
Nov 08 03:49:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4979eddc-54, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4979eddc-54, col_values=(('qos', UUID('352c2593-d3d9-48e3-ae5c-986b97e9b2cb')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4979eddc-54, col_values=(('external_ids', {'iface-id': '4979eddc-54c6-46e4-987a-640c4ccade99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:b6:69', 'vm-uuid': '9f205fe5-576f-4ef0-874b-1544c0307a7e'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:35 user nova-compute[75014]: INFO os_vif [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:b6:69,bridge_name='br-int',has_traffic_filtering=True,id=4979eddc-54c6-46e4-987a-640c4ccade99,network=Network(982531ca-8a2f-41de-b62e-5b43b6a45a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4979eddc-54')
Nov 08 03:49:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f08242a-d6, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3f08242a-d6, col_values=(('qos', UUID('432183d8-d6c2-40f3-8ae2-848c2d270281')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3f08242a-d6, col_values=(('external_ids', {'iface-id': '3f08242a-d68d-4744-8b4c-49bdc29ea557', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:f5:c2', 'vm-uuid': '5bfa6580-e0fe-46b0-b497-8db67806113a'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:35 user nova-compute[75014]: INFO os_vif [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:f5:c2,bridge_name='br-int',has_traffic_filtering=True,id=3f08242a-d68d-4744-8b4c-49bdc29ea557,network=Network(d45dbf14-9570-46c1-91a3-cbe2f7972b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f08242a-d6')
Nov 08 03:49:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.224s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk 1073741824" returned: 0 in 0.054s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] No VIF found with MAC fa:16:3e:eb:34:b6, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] No VIF found with MAC fa:16:3e:4c:b6:69, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] No VIF found with MAC fa:16:3e:65:f5:c2, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.network.neutron [req-1a466816-e3d7-4a9e-acf7-f498be94f1ef req-64d4e4b1-d65c-4e13-81fd-cadff265a6d6 service nova] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Updated VIF entry in instance network info cache for port 3f08242a-d68d-4744-8b4c-49bdc29ea557. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.network.neutron [req-1a466816-e3d7-4a9e-acf7-f498be94f1ef req-64d4e4b1-d65c-4e13-81fd-cadff265a6d6 service nova] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Updating instance_info_cache with network_info: [{"id": "3f08242a-d68d-4744-8b4c-49bdc29ea557", "address": "fa:16:3e:65:f5:c2", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f08242a-d6", "ovs_interfaceid": "3f08242a-d68d-4744-8b4c-49bdc29ea557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1a466816-e3d7-4a9e-acf7-f498be94f1ef req-64d4e4b1-d65c-4e13-81fd-cadff265a6d6 service nova] Releasing lock "refresh_cache-5bfa6580-e0fe-46b0-b497-8db67806113a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.compute.manager [req-56aee0c6-1a80-4e55-80bd-88bd5a4a6f5a req-dd54b109-8bd8-44b3-a2c0-399e3ef2b0cb service nova] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Received event network-changed-5ccfbc09-b908-4eb3-9521-31289eb0641f {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.compute.manager [req-56aee0c6-1a80-4e55-80bd-88bd5a4a6f5a req-dd54b109-8bd8-44b3-a2c0-399e3ef2b0cb service nova] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Refreshing instance network info cache due to event network-changed-5ccfbc09-b908-4eb3-9521-31289eb0641f. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-56aee0c6-1a80-4e55-80bd-88bd5a4a6f5a req-dd54b109-8bd8-44b3-a2c0-399e3ef2b0cb service nova] Acquiring lock "refresh_cache-30cf3d8d-a9e0-4b67-b2df-fafaeb616e89" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.211s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.network.neutron [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Updating instance_info_cache with network_info: [{"id": "5ccfbc09-b908-4eb3-9521-31289eb0641f", "address": "fa:16:3e:d7:ed:d9", "network": {"id": "a8fa201e-8062-45a0-9403-bf153b0c406f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1481531992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa81674e9c2471e832ef12631f63abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccfbc09-b9", "ovs_interfaceid": "5ccfbc09-b908-4eb3-9521-31289eb0641f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.network.neutron [req-cf90b3d0-887c-4a72-8214-6c3153cdd518 req-5943598f-9c5a-4f18-b314-21efa8a8baed service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Updated VIF entry in instance network info cache for port 4979eddc-54c6-46e4-987a-640c4ccade99. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.network.neutron [req-cf90b3d0-887c-4a72-8214-6c3153cdd518 req-5943598f-9c5a-4f18-b314-21efa8a8baed service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Updating instance_info_cache with network_info: [{"id": "4979eddc-54c6-46e4-987a-640c4ccade99", "address": "fa:16:3e:4c:b6:69", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4979eddc-54", "ovs_interfaceid": "4979eddc-54c6-46e4-987a-640c4ccade99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Releasing lock "refresh_cache-30cf3d8d-a9e0-4b67-b2df-fafaeb616e89" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.compute.manager [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Instance network_info: |[{"id": "5ccfbc09-b908-4eb3-9521-31289eb0641f", "address": "fa:16:3e:d7:ed:d9", "network": {"id": "a8fa201e-8062-45a0-9403-bf153b0c406f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1481531992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa81674e9c2471e832ef12631f63abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccfbc09-b9", "ovs_interfaceid": "5ccfbc09-b908-4eb3-9521-31289eb0641f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-56aee0c6-1a80-4e55-80bd-88bd5a4a6f5a req-dd54b109-8bd8-44b3-a2c0-399e3ef2b0cb service nova] Acquired lock "refresh_cache-30cf3d8d-a9e0-4b67-b2df-fafaeb616e89" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.network.neutron [req-56aee0c6-1a80-4e55-80bd-88bd5a4a6f5a req-dd54b109-8bd8-44b3-a2c0-399e3ef2b0cb service nova] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Refreshing network info cache for port 5ccfbc09-b908-4eb3-9521-31289eb0641f {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Start _get_guest_xml network_info=[{"id": "5ccfbc09-b908-4eb3-9521-31289eb0641f", "address": "fa:16:3e:d7:ed:d9", "network": {"id": "a8fa201e-8062-45a0-9403-bf153b0c406f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1481531992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa81674e9c2471e832ef12631f63abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccfbc09-b9", "ovs_interfaceid": "5ccfbc09-b908-4eb3-9521-31289eb0641f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-cf90b3d0-887c-4a72-8214-6c3153cdd518 req-5943598f-9c5a-4f18-b314-21efa8a8baed service nova] Releasing lock "refresh_cache-9f205fe5-576f-4ef0-874b-1544c0307a7e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:49:35 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:49:35 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:49:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1623520668',display_name='tempest-DeleteServersTestJSON-server-1623520668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1623520668',id=3,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfa81674e9c2471e832ef12631f63abd',ramdisk_id='',reservation_id='r-yd19wts5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-219748252',owner_user_name='tempest-DeleteServersTestJSON-219748252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:49:28Z,user_data=None,user_id='fb188835ab5c400ab9db33fd38e31920',uuid=30cf3d8d-a9e0-4b67-b2df-fafaeb616e89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ccfbc09-b908-4eb3-9521-31289eb0641f", "address": "fa:16:3e:d7:ed:d9", "network": {"id": "a8fa201e-8062-45a0-9403-bf153b0c406f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1481531992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa81674e9c2471e832ef12631f63abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccfbc09-b9", "ovs_interfaceid": "5ccfbc09-b908-4eb3-9521-31289eb0641f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Converting VIF {"id": "5ccfbc09-b908-4eb3-9521-31289eb0641f", "address": "fa:16:3e:d7:ed:d9", "network": {"id": "a8fa201e-8062-45a0-9403-bf153b0c406f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1481531992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa81674e9c2471e832ef12631f63abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccfbc09-b9", "ovs_interfaceid": "5ccfbc09-b908-4eb3-9521-31289eb0641f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:ed:d9,bridge_name='br-int',has_traffic_filtering=True,id=5ccfbc09-b908-4eb3-9521-31289eb0641f,network=Network(a8fa201e-8062-45a0-9403-bf153b0c406f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccfbc09-b9') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.objects.instance [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Lazy-loading 'pci_devices' on Instance uuid 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Cannot resize image /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Ensure instance console log exists: /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] End _get_guest_xml xml=<domain type="kvm">
Nov 08 03:49:35 user nova-compute[75014]:   <uuid>30cf3d8d-a9e0-4b67-b2df-fafaeb616e89</uuid>
Nov 08 03:49:35 user nova-compute[75014]:   <name>instance-00000003</name>
Nov 08 03:49:35 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 03:49:35 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 03:49:35 user nova-compute[75014]:   <metadata>
Nov 08 03:49:35 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 03:49:35 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 03:49:35 user nova-compute[75014]:       <nova:name>tempest-DeleteServersTestJSON-server-1623520668</nova:name>
Nov 08 03:49:35 user nova-compute[75014]:       <nova:creationTime>2023-11-08 03:49:35</nova:creationTime>
Nov 08 03:49:35 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 03:49:35 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 03:49:35 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 03:49:35 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 03:49:35 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 03:49:35 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 03:49:35 user nova-compute[75014]:       </nova:flavor>
Nov 08 03:49:35 user nova-compute[75014]:       <nova:owner>
Nov 08 03:49:35 user nova-compute[75014]:         <nova:user uuid="fb188835ab5c400ab9db33fd38e31920">tempest-DeleteServersTestJSON-219748252-project-member</nova:user>
Nov 08 03:49:35 user nova-compute[75014]:         <nova:project uuid="dfa81674e9c2471e832ef12631f63abd">tempest-DeleteServersTestJSON-219748252</nova:project>
Nov 08 03:49:35 user nova-compute[75014]:       </nova:owner>
Nov 08 03:49:35 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 03:49:35 user nova-compute[75014]:       <nova:ports>
Nov 08 03:49:35 user nova-compute[75014]:         <nova:port uuid="5ccfbc09-b908-4eb3-9521-31289eb0641f">
Nov 08 03:49:35 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 03:49:35 user nova-compute[75014]:         </nova:port>
Nov 08 03:49:35 user nova-compute[75014]:       </nova:ports>
Nov 08 03:49:35 user nova-compute[75014]:     </nova:instance>
Nov 08 03:49:35 user nova-compute[75014]:   </metadata>
Nov 08 03:49:35 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 03:49:35 user nova-compute[75014]:     <system>
Nov 08 03:49:35 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 03:49:35 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 03:49:35 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 03:49:35 user nova-compute[75014]:       <entry name="serial">30cf3d8d-a9e0-4b67-b2df-fafaeb616e89</entry>
Nov 08 03:49:35 user nova-compute[75014]:       <entry name="uuid">30cf3d8d-a9e0-4b67-b2df-fafaeb616e89</entry>
Nov 08 03:49:35 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 03:49:35 user nova-compute[75014]:     </system>
Nov 08 03:49:35 user nova-compute[75014]:   </sysinfo>
Nov 08 03:49:35 user nova-compute[75014]:   <os>
Nov 08 03:49:35 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 03:49:35 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 03:49:35 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 03:49:35 user nova-compute[75014]:   </os>
Nov 08 03:49:35 user nova-compute[75014]:   <features>
Nov 08 03:49:35 user nova-compute[75014]:     <acpi/>
Nov 08 03:49:35 user nova-compute[75014]:     <apic/>
Nov 08 03:49:35 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 03:49:35 user nova-compute[75014]:   </features>
Nov 08 03:49:35 user nova-compute[75014]:   <clock offset="utc">
Nov 08 03:49:35 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 03:49:35 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 03:49:35 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 03:49:35 user nova-compute[75014]:   </clock>
Nov 08 03:49:35 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 03:49:35 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 03:49:35 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 03:49:35 user nova-compute[75014]:   </cpu>
Nov 08 03:49:35 user nova-compute[75014]:   <devices>
Nov 08 03:49:35 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 03:49:35 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 03:49:35 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/30cf3d8d-a9e0-4b67-b2df-fafaeb616e89/disk"/>
Nov 08 03:49:35 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 03:49:35 user nova-compute[75014]:     </disk>
Nov 08 03:49:35 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:49:35 user nova-compute[75014]:       <mac address="fa:16:3e:d7:ed:d9"/>
Nov 08 03:49:35 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:49:35 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:49:35 user nova-compute[75014]:       <target dev="tap5ccfbc09-b9"/>
Nov 08 03:49:35 user nova-compute[75014]:     </interface>
Nov 08 03:49:35 user nova-compute[75014]:     <serial type="pty">
Nov 08 03:49:35 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/30cf3d8d-a9e0-4b67-b2df-fafaeb616e89/console.log" append="off"/>
Nov 08 03:49:35 user nova-compute[75014]:     </serial>
Nov 08 03:49:35 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 03:49:35 user nova-compute[75014]:     <video>
Nov 08 03:49:35 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:49:35 user nova-compute[75014]:     </video>
Nov 08 03:49:35 user nova-compute[75014]:     <rng model="virtio">
Nov 08 03:49:35 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 03:49:35 user nova-compute[75014]:     </rng>
Nov 08 03:49:35 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 03:49:35 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 03:49:35 user nova-compute[75014]:       <stats period="10"/>
Nov 08 03:49:35 user nova-compute[75014]:     </memballoon>
Nov 08 03:49:35 user nova-compute[75014]:   </devices>
Nov 08 03:49:35 user nova-compute[75014]: </domain>
Nov 08 03:49:35 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:49:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1623520668',display_name='tempest-DeleteServersTestJSON-server-1623520668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1623520668',id=3,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfa81674e9c2471e832ef12631f63abd',ramdisk_id='',reservation_id='r-yd19wts5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-219748252',owner_user_name='tempest-DeleteServersTestJSON-219748252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:49:28Z,user_data=None,user_id='fb188835ab5c400ab9db33fd38e31920',uuid=30cf3d8d-a9e0-4b67-b2df-fafaeb616e89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ccfbc09-b908-4eb3-9521-31289eb0641f", "address": "fa:16:3e:d7:ed:d9", "network": {"id": "a8fa201e-8062-45a0-9403-bf153b0c406f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1481531992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa81674e9c2471e832ef12631f63abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccfbc09-b9", "ovs_interfaceid": "5ccfbc09-b908-4eb3-9521-31289eb0641f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Converting VIF {"id": "5ccfbc09-b908-4eb3-9521-31289eb0641f", "address": "fa:16:3e:d7:ed:d9", "network": {"id": "a8fa201e-8062-45a0-9403-bf153b0c406f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1481531992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa81674e9c2471e832ef12631f63abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccfbc09-b9", "ovs_interfaceid": "5ccfbc09-b908-4eb3-9521-31289eb0641f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:ed:d9,bridge_name='br-int',has_traffic_filtering=True,id=5ccfbc09-b908-4eb3-9521-31289eb0641f,network=Network(a8fa201e-8062-45a0-9403-bf153b0c406f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccfbc09-b9') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG os_vif [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:ed:d9,bridge_name='br-int',has_traffic_filtering=True,id=5ccfbc09-b908-4eb3-9521-31289eb0641f,network=Network(a8fa201e-8062-45a0-9403-bf153b0c406f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccfbc09-b9') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48e4500f-139d-5198-bada-77f0d0100c68', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:49:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ccfbc09-b9, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ccfbc09-b9, col_values=(('qos', UUID('7db61505-6e80-449f-8380-9f8a08841d82')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ccfbc09-b9, col_values=(('external_ids', {'iface-id': '5ccfbc09-b908-4eb3-9521-31289eb0641f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:ed:d9', 'vm-uuid': '30cf3d8d-a9e0-4b67-b2df-fafaeb616e89'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:49:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:36 user nova-compute[75014]: INFO os_vif [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:ed:d9,bridge_name='br-int',has_traffic_filtering=True,id=5ccfbc09-b908-4eb3-9521-31289eb0641f,network=Network(a8fa201e-8062-45a0-9403-bf153b0c406f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccfbc09-b9')
Nov 08 03:49:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:49:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] No VIF found with MAC fa:16:3e:d7:ed:d9, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:49:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:37 user nova-compute[75014]: DEBUG nova.network.neutron [req-56aee0c6-1a80-4e55-80bd-88bd5a4a6f5a req-dd54b109-8bd8-44b3-a2c0-399e3ef2b0cb service nova] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Updated VIF entry in instance network info cache for port 5ccfbc09-b908-4eb3-9521-31289eb0641f. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:49:37 user nova-compute[75014]: DEBUG nova.network.neutron [req-56aee0c6-1a80-4e55-80bd-88bd5a4a6f5a req-dd54b109-8bd8-44b3-a2c0-399e3ef2b0cb service nova] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Updating instance_info_cache with network_info: [{"id": "5ccfbc09-b908-4eb3-9521-31289eb0641f", "address": "fa:16:3e:d7:ed:d9", "network": {"id": "a8fa201e-8062-45a0-9403-bf153b0c406f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1481531992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa81674e9c2471e832ef12631f63abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccfbc09-b9", "ovs_interfaceid": "5ccfbc09-b908-4eb3-9521-31289eb0641f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:49:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-56aee0c6-1a80-4e55-80bd-88bd5a4a6f5a req-dd54b109-8bd8-44b3-a2c0-399e3ef2b0cb service nova] Releasing lock "refresh_cache-30cf3d8d-a9e0-4b67-b2df-fafaeb616e89" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:49:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:37 user nova-compute[75014]: DEBUG nova.network.neutron [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Successfully created port: 2dd443c9-89d2-4a7c-b2fe-e842507e24d7 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 03:49:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:39 user nova-compute[75014]: DEBUG nova.network.neutron [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Successfully updated port: 2dd443c9-89d2-4a7c-b2fe-e842507e24d7 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 03:49:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "refresh_cache-f1d49f43-145b-4a9e-acbc-ca3759be49d5" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:49:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquired lock "refresh_cache-f1d49f43-145b-4a9e-acbc-ca3759be49d5" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:49:39 user nova-compute[75014]: DEBUG nova.network.neutron [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 03:49:39 user nova-compute[75014]: DEBUG nova.compute.manager [req-feb25e78-9744-4c2a-a2df-857ee20df7f5 req-04701e1b-6dbf-47e8-afc3-86b9d3b63bf9 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Received event network-changed-2dd443c9-89d2-4a7c-b2fe-e842507e24d7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:49:39 user nova-compute[75014]: DEBUG nova.compute.manager [req-feb25e78-9744-4c2a-a2df-857ee20df7f5 req-04701e1b-6dbf-47e8-afc3-86b9d3b63bf9 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Refreshing instance network info cache due to event network-changed-2dd443c9-89d2-4a7c-b2fe-e842507e24d7. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:49:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-feb25e78-9744-4c2a-a2df-857ee20df7f5 req-04701e1b-6dbf-47e8-afc3-86b9d3b63bf9 service nova] Acquiring lock "refresh_cache-f1d49f43-145b-4a9e-acbc-ca3759be49d5" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:49:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:39 user nova-compute[75014]: DEBUG nova.network.neutron [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 03:49:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG nova.network.neutron [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Updating instance_info_cache with network_info: [{"id": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "address": "fa:16:3e:32:e2:a4", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd443c9-89", "ovs_interfaceid": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Releasing lock "refresh_cache-f1d49f43-145b-4a9e-acbc-ca3759be49d5" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG nova.compute.manager [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Instance network_info: |[{"id": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "address": "fa:16:3e:32:e2:a4", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd443c9-89", "ovs_interfaceid": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-feb25e78-9744-4c2a-a2df-857ee20df7f5 req-04701e1b-6dbf-47e8-afc3-86b9d3b63bf9 service nova] Acquired lock "refresh_cache-f1d49f43-145b-4a9e-acbc-ca3759be49d5" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG nova.network.neutron [req-feb25e78-9744-4c2a-a2df-857ee20df7f5 req-04701e1b-6dbf-47e8-afc3-86b9d3b63bf9 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Refreshing network info cache for port 2dd443c9-89d2-4a7c-b2fe-e842507e24d7 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Start _get_guest_xml network_info=[{"id": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "address": "fa:16:3e:32:e2:a4", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd443c9-89", "ovs_interfaceid": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 03:49:40 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:49:40 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:49:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:49:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-937810668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-937810668',id=5,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDl11M5avo9bT73kKWpL6ROj4Uc6XogM4W8W1Z+wRJrUz7HXPDFtCISzN1nICvOyAaJUURT7jmmDoJ68zd4dmaLkYUzlRePt20TD2aaKSvy0qPri0GSokXbun02g+I7Vg==',key_name='tempest-keypair-1162981834',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1d70b55f2bb42e5b7123acfcd621b2f',ramdisk_id='',reservation_id='r-0ts9n0ef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-650261566',owner_user_name='tempest-AttachVolumeShelveTestJSON-650261566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:49:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74a49a9155064771bd4e8a179f9111ac',uuid=f1d49f43-145b-4a9e-acbc-ca3759be49d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "address": "fa:16:3e:32:e2:a4", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd443c9-89", "ovs_interfaceid": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Converting VIF {"id": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "address": "fa:16:3e:32:e2:a4", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd443c9-89", "ovs_interfaceid": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:e2:a4,bridge_name='br-int',has_traffic_filtering=True,id=2dd443c9-89d2-4a7c-b2fe-e842507e24d7,network=Network(6ebf42ac-ab65-4622-8529-4c508f9d563c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd443c9-89') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG nova.objects.instance [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lazy-loading 'pci_devices' on Instance uuid f1d49f43-145b-4a9e-acbc-ca3759be49d5 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] End _get_guest_xml xml=<domain type="kvm">
Nov 08 03:49:40 user nova-compute[75014]:   <uuid>f1d49f43-145b-4a9e-acbc-ca3759be49d5</uuid>
Nov 08 03:49:40 user nova-compute[75014]:   <name>instance-00000005</name>
Nov 08 03:49:40 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 03:49:40 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 03:49:40 user nova-compute[75014]:   <metadata>
Nov 08 03:49:40 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 03:49:40 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 03:49:40 user nova-compute[75014]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-937810668</nova:name>
Nov 08 03:49:40 user nova-compute[75014]:       <nova:creationTime>2023-11-08 03:49:40</nova:creationTime>
Nov 08 03:49:40 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 03:49:40 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 03:49:40 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 03:49:40 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 03:49:40 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 03:49:40 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 03:49:40 user nova-compute[75014]:       </nova:flavor>
Nov 08 03:49:40 user nova-compute[75014]:       <nova:owner>
Nov 08 03:49:40 user nova-compute[75014]:         <nova:user uuid="74a49a9155064771bd4e8a179f9111ac">tempest-AttachVolumeShelveTestJSON-650261566-project-member</nova:user>
Nov 08 03:49:40 user nova-compute[75014]:         <nova:project uuid="a1d70b55f2bb42e5b7123acfcd621b2f">tempest-AttachVolumeShelveTestJSON-650261566</nova:project>
Nov 08 03:49:40 user nova-compute[75014]:       </nova:owner>
Nov 08 03:49:40 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 03:49:40 user nova-compute[75014]:       <nova:ports>
Nov 08 03:49:40 user nova-compute[75014]:         <nova:port uuid="2dd443c9-89d2-4a7c-b2fe-e842507e24d7">
Nov 08 03:49:40 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 03:49:40 user nova-compute[75014]:         </nova:port>
Nov 08 03:49:40 user nova-compute[75014]:       </nova:ports>
Nov 08 03:49:40 user nova-compute[75014]:     </nova:instance>
Nov 08 03:49:40 user nova-compute[75014]:   </metadata>
Nov 08 03:49:40 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 03:49:40 user nova-compute[75014]:     <system>
Nov 08 03:49:40 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 03:49:40 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 03:49:40 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 03:49:40 user nova-compute[75014]:       <entry name="serial">f1d49f43-145b-4a9e-acbc-ca3759be49d5</entry>
Nov 08 03:49:40 user nova-compute[75014]:       <entry name="uuid">f1d49f43-145b-4a9e-acbc-ca3759be49d5</entry>
Nov 08 03:49:40 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 03:49:40 user nova-compute[75014]:     </system>
Nov 08 03:49:40 user nova-compute[75014]:   </sysinfo>
Nov 08 03:49:40 user nova-compute[75014]:   <os>
Nov 08 03:49:40 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 03:49:40 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 03:49:40 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 03:49:40 user nova-compute[75014]:   </os>
Nov 08 03:49:40 user nova-compute[75014]:   <features>
Nov 08 03:49:40 user nova-compute[75014]:     <acpi/>
Nov 08 03:49:40 user nova-compute[75014]:     <apic/>
Nov 08 03:49:40 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 03:49:40 user nova-compute[75014]:   </features>
Nov 08 03:49:40 user nova-compute[75014]:   <clock offset="utc">
Nov 08 03:49:40 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 03:49:40 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 03:49:40 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 03:49:40 user nova-compute[75014]:   </clock>
Nov 08 03:49:40 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 03:49:40 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 03:49:40 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 03:49:40 user nova-compute[75014]:   </cpu>
Nov 08 03:49:40 user nova-compute[75014]:   <devices>
Nov 08 03:49:40 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 03:49:40 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 03:49:40 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk"/>
Nov 08 03:49:40 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 03:49:40 user nova-compute[75014]:     </disk>
Nov 08 03:49:40 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:49:40 user nova-compute[75014]:       <mac address="fa:16:3e:32:e2:a4"/>
Nov 08 03:49:40 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:49:40 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:49:40 user nova-compute[75014]:       <target dev="tap2dd443c9-89"/>
Nov 08 03:49:40 user nova-compute[75014]:     </interface>
Nov 08 03:49:40 user nova-compute[75014]:     <serial type="pty">
Nov 08 03:49:40 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/console.log" append="off"/>
Nov 08 03:49:40 user nova-compute[75014]:     </serial>
Nov 08 03:49:40 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 03:49:40 user nova-compute[75014]:     <video>
Nov 08 03:49:40 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:49:40 user nova-compute[75014]:     </video>
Nov 08 03:49:40 user nova-compute[75014]:     <rng model="virtio">
Nov 08 03:49:40 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 03:49:40 user nova-compute[75014]:     </rng>
Nov 08 03:49:40 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 03:49:40 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 03:49:40 user nova-compute[75014]:       <stats period="10"/>
Nov 08 03:49:40 user nova-compute[75014]:     </memballoon>
Nov 08 03:49:40 user nova-compute[75014]:   </devices>
Nov 08 03:49:40 user nova-compute[75014]: </domain>
Nov 08 03:49:40 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:49:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-937810668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-937810668',id=5,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDl11M5avo9bT73kKWpL6ROj4Uc6XogM4W8W1Z+wRJrUz7HXPDFtCISzN1nICvOyAaJUURT7jmmDoJ68zd4dmaLkYUzlRePt20TD2aaKSvy0qPri0GSokXbun02g+I7Vg==',key_name='tempest-keypair-1162981834',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1d70b55f2bb42e5b7123acfcd621b2f',ramdisk_id='',reservation_id='r-0ts9n0ef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-650261566',owner_user_name='tempest-AttachVolumeShelveTestJSON-650261566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:49:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74a49a9155064771bd4e8a179f9111ac',uuid=f1d49f43-145b-4a9e-acbc-ca3759be49d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "address": "fa:16:3e:32:e2:a4", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd443c9-89", "ovs_interfaceid": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Converting VIF {"id": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "address": "fa:16:3e:32:e2:a4", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd443c9-89", "ovs_interfaceid": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:e2:a4,bridge_name='br-int',has_traffic_filtering=True,id=2dd443c9-89d2-4a7c-b2fe-e842507e24d7,network=Network(6ebf42ac-ab65-4622-8529-4c508f9d563c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd443c9-89') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG os_vif [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:e2:a4,bridge_name='br-int',has_traffic_filtering=True,id=2dd443c9-89d2-4a7c-b2fe-e842507e24d7,network=Network(6ebf42ac-ab65-4622-8529-4c508f9d563c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd443c9-89') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db907eb9-1650-5017-a8d0-a1b615901978', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dd443c9-89, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2dd443c9-89, col_values=(('qos', UUID('db2ec738-f6ed-4b04-bd54-c7ce370df25c')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2dd443c9-89, col_values=(('external_ids', {'iface-id': '2dd443c9-89d2-4a7c-b2fe-e842507e24d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:e2:a4', 'vm-uuid': 'f1d49f43-145b-4a9e-acbc-ca3759be49d5'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:40 user nova-compute[75014]: INFO os_vif [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:e2:a4,bridge_name='br-int',has_traffic_filtering=True,id=2dd443c9-89d2-4a7c-b2fe-e842507e24d7,network=Network(6ebf42ac-ab65-4622-8529-4c508f9d563c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd443c9-89')
Nov 08 03:49:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:49:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] No VIF found with MAC fa:16:3e:32:e2:a4, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:49:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Acquiring lock "8a8d9f3c-1150-4306-8dc6-eedde92c7a35" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lock "8a8d9f3c-1150-4306-8dc6-eedde92c7a35" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:41 user nova-compute[75014]: DEBUG nova.compute.manager [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 03:49:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:41 user nova-compute[75014]: DEBUG nova.network.neutron [req-feb25e78-9744-4c2a-a2df-857ee20df7f5 req-04701e1b-6dbf-47e8-afc3-86b9d3b63bf9 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Updated VIF entry in instance network info cache for port 2dd443c9-89d2-4a7c-b2fe-e842507e24d7. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:49:41 user nova-compute[75014]: DEBUG nova.network.neutron [req-feb25e78-9744-4c2a-a2df-857ee20df7f5 req-04701e1b-6dbf-47e8-afc3-86b9d3b63bf9 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Updating instance_info_cache with network_info: [{"id": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "address": "fa:16:3e:32:e2:a4", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd443c9-89", "ovs_interfaceid": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:49:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-feb25e78-9744-4c2a-a2df-857ee20df7f5 req-04701e1b-6dbf-47e8-afc3-86b9d3b63bf9 service nova] Releasing lock "refresh_cache-f1d49f43-145b-4a9e-acbc-ca3759be49d5" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:49:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Acquiring lock "7dd0e158-473f-4785-a5cf-a75b2da85b29" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "7dd0e158-473f-4785-a5cf-a75b2da85b29" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:43 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 03:49:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 03:49:45 user nova-compute[75014]: INFO nova.compute.claims [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Claim successful on node user
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 03:49:45 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Instance spawned successfully.
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 03:49:45 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Instance spawned successfully.
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:45 user nova-compute[75014]: INFO nova.compute.manager [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Took 17.60 seconds to spawn the instance on the hypervisor.
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:49:45 user nova-compute[75014]: INFO nova.compute.manager [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Took 17.21 seconds to spawn the instance on the hypervisor.
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:49:45 user nova-compute[75014]: INFO nova.compute.manager [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Took 18.37 seconds to build instance.
Nov 08 03:49:45 user nova-compute[75014]: INFO nova.compute.manager [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Took 18.77 seconds to build instance.
Nov 08 03:49:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5aab7a2-7ee4-4f70-a9bd-20e9d7c65ec1 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.815s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f1799d32-fcd5-4284-8f44-b2e93213fab2 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "5bfa6580-e0fe-46b0-b497-8db67806113a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.019s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.compute.manager [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 03:49:45 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Instance spawned successfully.
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 4.252s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.compute.manager [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.709s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 03:49:45 user nova-compute[75014]: INFO nova.compute.claims [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Claim successful on node user
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.compute.manager [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:45 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Instance spawned successfully.
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:46 user nova-compute[75014]: INFO nova.compute.manager [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Took 20.00 seconds to spawn the instance on the hypervisor.
Nov 08 03:49:46 user nova-compute[75014]: DEBUG nova.compute.manager [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:49:46 user nova-compute[75014]: DEBUG nova.compute.manager [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 03:49:46 user nova-compute[75014]: DEBUG nova.network.neutron [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 03:49:46 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 08 03:49:46 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:46 user nova-compute[75014]: DEBUG nova.compute.manager [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 03:49:46 user nova-compute[75014]: DEBUG nova.policy [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '270af1c402db435fbd851feef3d30693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73af3d7f9cbd46c6b08449dde0ef83cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 03:49:46 user nova-compute[75014]: INFO nova.compute.manager [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Took 21.33 seconds to build instance.
Nov 08 03:49:46 user nova-compute[75014]: INFO nova.compute.manager [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Took 17.96 seconds to spawn the instance on the hypervisor.
Nov 08 03:49:46 user nova-compute[75014]: DEBUG nova.compute.manager [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:49:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-64990dee-430f-48a9-8b47-c0fb3222fc40 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.626s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:46 user nova-compute[75014]: DEBUG nova.compute.manager [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 03:49:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 03:49:46 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Creating image(s)
Nov 08 03:49:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lock "/opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lock "/opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Acquiring lock "89c2815c291483866799f9b949731714d1878ff9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lock "89c2815c291483866799f9b949731714d1878ff9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.005s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:46 user nova-compute[75014]: INFO nova.compute.manager [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Took 19.45 seconds to build instance.
Nov 08 03:49:46 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:49:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-261d73c9-16b0-4a20-b41e-2b5a63e6f82a tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Lock "30cf3d8d-a9e0-4b67-b2df-fafaeb616e89" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.821s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:46 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:49:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89c2815c291483866799f9b949731714d1878ff9.part --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.573s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:47 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 03:49:47 user nova-compute[75014]: DEBUG nova.compute.manager [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 03:49:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 03:49:47 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Instance spawned successfully.
Nov 08 03:49:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 03:49:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:47 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 03:49:47 user nova-compute[75014]: DEBUG nova.network.neutron [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 03:49:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89c2815c291483866799f9b949731714d1878ff9.part --force-share --output=json" returned: 0 in 0.352s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:47 user nova-compute[75014]: DEBUG nova.virt.images [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] bf066b05-2bf7-4337-a362-db1202224114 was qcow2, converting to raw {{(pid=75014) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 03:49:47 user nova-compute[75014]: DEBUG nova.privsep.utils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75014) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 03:49:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/89c2815c291483866799f9b949731714d1878ff9.part /opt/stack/data/nova/instances/_base/89c2815c291483866799f9b949731714d1878ff9.converted {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:47 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 03:49:47 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 03:49:47 user nova-compute[75014]: INFO nova.compute.manager [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Took 12.75 seconds to spawn the instance on the hypervisor.
Nov 08 03:49:47 user nova-compute[75014]: DEBUG nova.compute.manager [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:49:47 user nova-compute[75014]: DEBUG nova.policy [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e82b4bdb6a464a06ac0afb07401a0ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4e7f2292f74b0a88221144ad5220f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 03:49:48 user nova-compute[75014]: INFO nova.compute.manager [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Took 13.84 seconds to build instance.
Nov 08 03:49:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/89c2815c291483866799f9b949731714d1878ff9.part /opt/stack/data/nova/instances/_base/89c2815c291483866799f9b949731714d1878ff9.converted" returned: 0 in 0.400s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-10a6cf9f-d4dd-4d8d-807c-a43d406f3f61 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.988s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89c2815c291483866799f9b949731714d1878ff9.converted --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:48 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 03:49:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 03:49:48 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Creating image(s)
Nov 08 03:49:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Acquiring lock "/opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "/opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "/opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:48 user nova-compute[75014]: DEBUG nova.network.neutron [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Successfully created port: 12d06985-404f-4ffb-98b2-4967d82e45ca {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 03:49:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89c2815c291483866799f9b949731714d1878ff9.converted --force-share --output=json" returned: 0 in 0.292s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lock "89c2815c291483866799f9b949731714d1878ff9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.927s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89c2815c291483866799f9b949731714d1878ff9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.334s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.029s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89c2815c291483866799f9b949731714d1878ff9 --force-share --output=json" returned: 0 in 0.434s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Acquiring lock "89c2815c291483866799f9b949731714d1878ff9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lock "89c2815c291483866799f9b949731714d1878ff9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89c2815c291483866799f9b949731714d1878ff9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.357s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk 1073741824" returned: 0 in 0.103s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.482s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89c2815c291483866799f9b949731714d1878ff9 --force-share --output=json" returned: 0 in 0.318s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/89c2815c291483866799f9b949731714d1878ff9,backing_fmt=raw /opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/89c2815c291483866799f9b949731714d1878ff9,backing_fmt=raw /opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35/disk 1073741824" returned: 0 in 0.103s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lock "89c2815c291483866799f9b949731714d1878ff9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.432s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89c2815c291483866799f9b949731714d1878ff9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:49 user nova-compute[75014]: DEBUG nova.network.neutron [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Successfully created port: 81345e21-7bc0-451c-950d-30053a7181d3 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 03:49:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.484s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:49 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 03:49:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89c2815c291483866799f9b949731714d1878ff9 --force-share --output=json" returned: 0 in 0.410s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:49 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 03:49:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json" returned: 0 in 0.414s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:50 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Cannot resize image /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 03:49:50 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 03:49:50 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Ensure instance console log exists: /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 03:49:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.006s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35/disk --force-share --output=json" returned: 0 in 0.343s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:50 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Cannot resize image /opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 03:49:50 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 03:49:50 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Ensure instance console log exists: /opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 03:49:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:50 user nova-compute[75014]: DEBUG nova.compute.manager [req-c35d13d7-5e47-4eee-b133-053bbd9edef5 req-bfa61a1e-538f-4e49-9b72-e9d8e5b53000 service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Received event network-vif-plugged-4979eddc-54c6-46e4-987a-640c4ccade99 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:49:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c35d13d7-5e47-4eee-b133-053bbd9edef5 req-bfa61a1e-538f-4e49-9b72-e9d8e5b53000 service nova] Acquiring lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c35d13d7-5e47-4eee-b133-053bbd9edef5 req-bfa61a1e-538f-4e49-9b72-e9d8e5b53000 service nova] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c35d13d7-5e47-4eee-b133-053bbd9edef5 req-bfa61a1e-538f-4e49-9b72-e9d8e5b53000 service nova] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:50 user nova-compute[75014]: DEBUG nova.compute.manager [req-c35d13d7-5e47-4eee-b133-053bbd9edef5 req-bfa61a1e-538f-4e49-9b72-e9d8e5b53000 service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] No waiting events found dispatching network-vif-plugged-4979eddc-54c6-46e4-987a-640c4ccade99 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:49:50 user nova-compute[75014]: WARNING nova.compute.manager [req-c35d13d7-5e47-4eee-b133-053bbd9edef5 req-bfa61a1e-538f-4e49-9b72-e9d8e5b53000 service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Received unexpected event network-vif-plugged-4979eddc-54c6-46e4-987a-640c4ccade99 for instance with vm_state active and task_state None.
Nov 08 03:49:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:50 user nova-compute[75014]: DEBUG nova.network.neutron [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Successfully updated port: 12d06985-404f-4ffb-98b2-4967d82e45ca {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 03:49:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Acquiring lock "refresh_cache-8a8d9f3c-1150-4306-8dc6-eedde92c7a35" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:49:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Acquired lock "refresh_cache-8a8d9f3c-1150-4306-8dc6-eedde92c7a35" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:49:50 user nova-compute[75014]: DEBUG nova.network.neutron [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 03:49:50 user nova-compute[75014]: DEBUG nova.network.neutron [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Successfully updated port: 81345e21-7bc0-451c-950d-30053a7181d3 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 03:49:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Acquiring lock "refresh_cache-7dd0e158-473f-4785-a5cf-a75b2da85b29" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:49:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Acquired lock "refresh_cache-7dd0e158-473f-4785-a5cf-a75b2da85b29" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:49:50 user nova-compute[75014]: DEBUG nova.network.neutron [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 03:49:50 user nova-compute[75014]: DEBUG nova.network.neutron [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG nova.compute.manager [req-7aa17770-c113-4928-9d1d-8b9687ea1f12 req-44a696b7-4ce7-40c4-abed-74cd9af53580 service nova] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Received event network-changed-81345e21-7bc0-451c-950d-30053a7181d3 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG nova.compute.manager [req-7aa17770-c113-4928-9d1d-8b9687ea1f12 req-44a696b7-4ce7-40c4-abed-74cd9af53580 service nova] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Refreshing instance network info cache due to event network-changed-81345e21-7bc0-451c-950d-30053a7181d3. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-7aa17770-c113-4928-9d1d-8b9687ea1f12 req-44a696b7-4ce7-40c4-abed-74cd9af53580 service nova] Acquiring lock "refresh_cache-7dd0e158-473f-4785-a5cf-a75b2da85b29" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG nova.network.neutron [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG nova.network.neutron [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Updating instance_info_cache with network_info: [{"id": "81345e21-7bc0-451c-950d-30053a7181d3", "address": "fa:16:3e:66:a0:f5", "network": {"id": "24ff600e-3d1c-49d0-90cf-84e1aa25d978", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1636920770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4e7f2292f74b0a88221144ad5220f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81345e21-7b", "ovs_interfaceid": "81345e21-7bc0-451c-950d-30053a7181d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Releasing lock "refresh_cache-7dd0e158-473f-4785-a5cf-a75b2da85b29" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Instance network_info: |[{"id": "81345e21-7bc0-451c-950d-30053a7181d3", "address": "fa:16:3e:66:a0:f5", "network": {"id": "24ff600e-3d1c-49d0-90cf-84e1aa25d978", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1636920770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4e7f2292f74b0a88221144ad5220f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81345e21-7b", "ovs_interfaceid": "81345e21-7bc0-451c-950d-30053a7181d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-7aa17770-c113-4928-9d1d-8b9687ea1f12 req-44a696b7-4ce7-40c4-abed-74cd9af53580 service nova] Acquired lock "refresh_cache-7dd0e158-473f-4785-a5cf-a75b2da85b29" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG nova.network.neutron [req-7aa17770-c113-4928-9d1d-8b9687ea1f12 req-44a696b7-4ce7-40c4-abed-74cd9af53580 service nova] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Refreshing network info cache for port 81345e21-7bc0-451c-950d-30053a7181d3 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Start _get_guest_xml network_info=[{"id": "81345e21-7bc0-451c-950d-30053a7181d3", "address": "fa:16:3e:66:a0:f5", "network": {"id": "24ff600e-3d1c-49d0-90cf-84e1aa25d978", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1636920770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4e7f2292f74b0a88221144ad5220f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81345e21-7b", "ovs_interfaceid": "81345e21-7bc0-451c-950d-30053a7181d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 03:49:51 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:49:51 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:49:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG nova.network.neutron [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Updating instance_info_cache with network_info: [{"id": "12d06985-404f-4ffb-98b2-4967d82e45ca", "address": "fa:16:3e:c3:48:cb", "network": {"id": "ad32e55b-9579-41dd-b98f-e962ac63433a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1118133511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73af3d7f9cbd46c6b08449dde0ef83cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d06985-40", "ovs_interfaceid": "12d06985-404f-4ffb-98b2-4967d82e45ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:49:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-999650202',display_name='tempest-VolumesAdminNegativeTest-server-999650202',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-999650202',id=7,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJV1ozyb0Vn6Slm1TLSDTAU5Jdq+/eo/GjyfNGlKMe5sz3EBsmsPBUrvp8r0DSp1CH0PVuOINaTj9GyMMeHOusYtPI0rUwCq7ikOYveBgFIuIvTYiQSiS3SQXCBxiv2oGw==',key_name='tempest-keypair-1201034514',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca4e7f2292f74b0a88221144ad5220f5',ramdisk_id='',reservation_id='r-vmen5rpd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-730381045',owner_user_name='tempest-VolumesAdminNegativeTest-730381045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:49:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e82b4bdb6a464a06ac0afb07401a0ff1',uuid=7dd0e158-473f-4785-a5cf-a75b2da85b29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81345e21-7bc0-451c-950d-30053a7181d3", "address": "fa:16:3e:66:a0:f5", "network": {"id": "24ff600e-3d1c-49d0-90cf-84e1aa25d978", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1636920770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4e7f2292f74b0a88221144ad5220f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81345e21-7b", "ovs_interfaceid": "81345e21-7bc0-451c-950d-30053a7181d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Converting VIF {"id": "81345e21-7bc0-451c-950d-30053a7181d3", "address": "fa:16:3e:66:a0:f5", "network": {"id": "24ff600e-3d1c-49d0-90cf-84e1aa25d978", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1636920770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4e7f2292f74b0a88221144ad5220f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81345e21-7b", "ovs_interfaceid": "81345e21-7bc0-451c-950d-30053a7181d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:a0:f5,bridge_name='br-int',has_traffic_filtering=True,id=81345e21-7bc0-451c-950d-30053a7181d3,network=Network(24ff600e-3d1c-49d0-90cf-84e1aa25d978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81345e21-7b') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG nova.objects.instance [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lazy-loading 'pci_devices' on Instance uuid 7dd0e158-473f-4785-a5cf-a75b2da85b29 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Releasing lock "refresh_cache-8a8d9f3c-1150-4306-8dc6-eedde92c7a35" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG nova.compute.manager [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Instance network_info: |[{"id": "12d06985-404f-4ffb-98b2-4967d82e45ca", "address": "fa:16:3e:c3:48:cb", "network": {"id": "ad32e55b-9579-41dd-b98f-e962ac63433a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1118133511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73af3d7f9cbd46c6b08449dde0ef83cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d06985-40", "ovs_interfaceid": "12d06985-404f-4ffb-98b2-4967d82e45ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 03:49:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Start _get_guest_xml network_info=[{"id": "12d06985-404f-4ffb-98b2-4967d82e45ca", "address": "fa:16:3e:c3:48:cb", "network": {"id": "ad32e55b-9579-41dd-b98f-e962ac63433a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1118133511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73af3d7f9cbd46c6b08449dde0ef83cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d06985-40", "ovs_interfaceid": "12d06985-404f-4ffb-98b2-4967d82e45ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:49:32Z,direct_url=<?>,disk_format='qcow2',id=bf066b05-2bf7-4337-a362-db1202224114,min_disk=0,min_ram=0,name='',owner='79ab15cbc8ef489fbb885603e948b9f6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:49:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'scsi', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'bf066b05-2bf7-4337-a362-db1202224114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] End _get_guest_xml xml=<domain type="kvm">
Nov 08 03:49:52 user nova-compute[75014]:   <uuid>7dd0e158-473f-4785-a5cf-a75b2da85b29</uuid>
Nov 08 03:49:52 user nova-compute[75014]:   <name>instance-00000007</name>
Nov 08 03:49:52 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 03:49:52 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 03:49:52 user nova-compute[75014]:   <metadata>
Nov 08 03:49:52 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 03:49:52 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 03:49:52 user nova-compute[75014]:       <nova:name>tempest-VolumesAdminNegativeTest-server-999650202</nova:name>
Nov 08 03:49:52 user nova-compute[75014]:       <nova:creationTime>2023-11-08 03:49:51</nova:creationTime>
Nov 08 03:49:52 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 03:49:52 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 03:49:52 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 03:49:52 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 03:49:52 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 03:49:52 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 03:49:52 user nova-compute[75014]:       </nova:flavor>
Nov 08 03:49:52 user nova-compute[75014]:       <nova:owner>
Nov 08 03:49:52 user nova-compute[75014]:         <nova:user uuid="e82b4bdb6a464a06ac0afb07401a0ff1">tempest-VolumesAdminNegativeTest-730381045-project-member</nova:user>
Nov 08 03:49:52 user nova-compute[75014]:         <nova:project uuid="ca4e7f2292f74b0a88221144ad5220f5">tempest-VolumesAdminNegativeTest-730381045</nova:project>
Nov 08 03:49:52 user nova-compute[75014]:       </nova:owner>
Nov 08 03:49:52 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 03:49:52 user nova-compute[75014]:       <nova:ports>
Nov 08 03:49:52 user nova-compute[75014]:         <nova:port uuid="81345e21-7bc0-451c-950d-30053a7181d3">
Nov 08 03:49:52 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 03:49:52 user nova-compute[75014]:         </nova:port>
Nov 08 03:49:52 user nova-compute[75014]:       </nova:ports>
Nov 08 03:49:52 user nova-compute[75014]:     </nova:instance>
Nov 08 03:49:52 user nova-compute[75014]:   </metadata>
Nov 08 03:49:52 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 03:49:52 user nova-compute[75014]:     <system>
Nov 08 03:49:52 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 03:49:52 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 03:49:52 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 03:49:52 user nova-compute[75014]:       <entry name="serial">7dd0e158-473f-4785-a5cf-a75b2da85b29</entry>
Nov 08 03:49:52 user nova-compute[75014]:       <entry name="uuid">7dd0e158-473f-4785-a5cf-a75b2da85b29</entry>
Nov 08 03:49:52 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 03:49:52 user nova-compute[75014]:     </system>
Nov 08 03:49:52 user nova-compute[75014]:   </sysinfo>
Nov 08 03:49:52 user nova-compute[75014]:   <os>
Nov 08 03:49:52 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 03:49:52 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 03:49:52 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 03:49:52 user nova-compute[75014]:   </os>
Nov 08 03:49:52 user nova-compute[75014]:   <features>
Nov 08 03:49:52 user nova-compute[75014]:     <acpi/>
Nov 08 03:49:52 user nova-compute[75014]:     <apic/>
Nov 08 03:49:52 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 03:49:52 user nova-compute[75014]:   </features>
Nov 08 03:49:52 user nova-compute[75014]:   <clock offset="utc">
Nov 08 03:49:52 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 03:49:52 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 03:49:52 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 03:49:52 user nova-compute[75014]:   </clock>
Nov 08 03:49:52 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 03:49:52 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 03:49:52 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 03:49:52 user nova-compute[75014]:   </cpu>
Nov 08 03:49:52 user nova-compute[75014]:   <devices>
Nov 08 03:49:52 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 03:49:52 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 03:49:52 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk"/>
Nov 08 03:49:52 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 03:49:52 user nova-compute[75014]:     </disk>
Nov 08 03:49:52 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:49:52 user nova-compute[75014]:       <mac address="fa:16:3e:66:a0:f5"/>
Nov 08 03:49:52 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:49:52 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:49:52 user nova-compute[75014]:       <target dev="tap81345e21-7b"/>
Nov 08 03:49:52 user nova-compute[75014]:     </interface>
Nov 08 03:49:52 user nova-compute[75014]:     <serial type="pty">
Nov 08 03:49:52 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/console.log" append="off"/>
Nov 08 03:49:52 user nova-compute[75014]:     </serial>
Nov 08 03:49:52 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 03:49:52 user nova-compute[75014]:     <video>
Nov 08 03:49:52 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:49:52 user nova-compute[75014]:     </video>
Nov 08 03:49:52 user nova-compute[75014]:     <rng model="virtio">
Nov 08 03:49:52 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 03:49:52 user nova-compute[75014]:     </rng>
Nov 08 03:49:52 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 03:49:52 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 03:49:52 user nova-compute[75014]:       <stats period="10"/>
Nov 08 03:49:52 user nova-compute[75014]:     </memballoon>
Nov 08 03:49:52 user nova-compute[75014]:   </devices>
Nov 08 03:49:52 user nova-compute[75014]: </domain>
Nov 08 03:49:52 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:49:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-999650202',display_name='tempest-VolumesAdminNegativeTest-server-999650202',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-999650202',id=7,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJV1ozyb0Vn6Slm1TLSDTAU5Jdq+/eo/GjyfNGlKMe5sz3EBsmsPBUrvp8r0DSp1CH0PVuOINaTj9GyMMeHOusYtPI0rUwCq7ikOYveBgFIuIvTYiQSiS3SQXCBxiv2oGw==',key_name='tempest-keypair-1201034514',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca4e7f2292f74b0a88221144ad5220f5',ramdisk_id='',reservation_id='r-vmen5rpd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-730381045',owner_user_name='tempest-VolumesAdminNegativeTest-730381045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:49:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e82b4bdb6a464a06ac0afb07401a0ff1',uuid=7dd0e158-473f-4785-a5cf-a75b2da85b29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81345e21-7bc0-451c-950d-30053a7181d3", "address": "fa:16:3e:66:a0:f5", "network": {"id": "24ff600e-3d1c-49d0-90cf-84e1aa25d978", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1636920770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4e7f2292f74b0a88221144ad5220f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81345e21-7b", "ovs_interfaceid": "81345e21-7bc0-451c-950d-30053a7181d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Converting VIF {"id": "81345e21-7bc0-451c-950d-30053a7181d3", "address": "fa:16:3e:66:a0:f5", "network": {"id": "24ff600e-3d1c-49d0-90cf-84e1aa25d978", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1636920770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4e7f2292f74b0a88221144ad5220f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81345e21-7b", "ovs_interfaceid": "81345e21-7bc0-451c-950d-30053a7181d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:a0:f5,bridge_name='br-int',has_traffic_filtering=True,id=81345e21-7bc0-451c-950d-30053a7181d3,network=Network(24ff600e-3d1c-49d0-90cf-84e1aa25d978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81345e21-7b') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG os_vif [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:a0:f5,bridge_name='br-int',has_traffic_filtering=True,id=81345e21-7bc0-451c-950d-30053a7181d3,network=Network(24ff600e-3d1c-49d0-90cf-84e1aa25d978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81345e21-7b') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31676d2d-1094-5312-8635-a30d1ae56725', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81345e21-7b, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81345e21-7b, col_values=(('qos', UUID('6c65ed37-e5a0-4958-ac02-b0da5dc2570e')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81345e21-7b, col_values=(('external_ids', {'iface-id': '81345e21-7bc0-451c-950d-30053a7181d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:a0:f5', 'vm-uuid': '7dd0e158-473f-4785-a5cf-a75b2da85b29'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:52 user nova-compute[75014]: INFO os_vif [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:a0:f5,bridge_name='br-int',has_traffic_filtering=True,id=81345e21-7bc0-451c-950d-30053a7181d3,network=Network(24ff600e-3d1c-49d0-90cf-84e1aa25d978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81345e21-7b')
Nov 08 03:49:52 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:49:52 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:49:32Z,direct_url=<?>,disk_format='qcow2',id=bf066b05-2bf7-4337-a362-db1202224114,min_disk=0,min_ram=0,name='',owner='79ab15cbc8ef489fbb885603e948b9f6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:49:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:49:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1751896276',display_name='tempest-AttachSCSIVolumeTestJSON-server-1751896276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1751896276',id=6,image_ref='bf066b05-2bf7-4337-a362-db1202224114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+px21gyGxCyg8YXyhCYpThpjcf0ZiZIgyJZ8yfitrhz4DFHIMzDgh8jo4gaToI4Tbk9OSkVjj99XuUpPToStW3+DSzuijtTaPClBOrVw8jY8INyF6hpiGZoE7f98N+7A==',key_name='tempest-keypair-1364196698',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73af3d7f9cbd46c6b08449dde0ef83cf',ramdisk_id='',reservation_id='r-fh7u0nla',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf066b05-2bf7-4337-a362-db1202224114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-381314217',owner_user_name='tempest-AttachSCSIVolumeTestJSON-381314217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:49:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270af1c402db435fbd851feef3d30693',uuid=8a8d9f3c-1150-4306-8dc6-eedde92c7a35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12d06985-404f-4ffb-98b2-4967d82e45ca", "address": "fa:16:3e:c3:48:cb", "network": {"id": "ad32e55b-9579-41dd-b98f-e962ac63433a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1118133511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73af3d7f9cbd46c6b08449dde0ef83cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d06985-40", "ovs_interfaceid": "12d06985-404f-4ffb-98b2-4967d82e45ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Converting VIF {"id": "12d06985-404f-4ffb-98b2-4967d82e45ca", "address": "fa:16:3e:c3:48:cb", "network": {"id": "ad32e55b-9579-41dd-b98f-e962ac63433a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1118133511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73af3d7f9cbd46c6b08449dde0ef83cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d06985-40", "ovs_interfaceid": "12d06985-404f-4ffb-98b2-4967d82e45ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:48:cb,bridge_name='br-int',has_traffic_filtering=True,id=12d06985-404f-4ffb-98b2-4967d82e45ca,network=Network(ad32e55b-9579-41dd-b98f-e962ac63433a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12d06985-40') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.objects.instance [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a8d9f3c-1150-4306-8dc6-eedde92c7a35 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] End _get_guest_xml xml=<domain type="kvm">
Nov 08 03:49:52 user nova-compute[75014]:   <uuid>8a8d9f3c-1150-4306-8dc6-eedde92c7a35</uuid>
Nov 08 03:49:52 user nova-compute[75014]:   <name>instance-00000006</name>
Nov 08 03:49:52 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 03:49:52 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 03:49:52 user nova-compute[75014]:   <metadata>
Nov 08 03:49:52 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 03:49:52 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 03:49:52 user nova-compute[75014]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1751896276</nova:name>
Nov 08 03:49:52 user nova-compute[75014]:       <nova:creationTime>2023-11-08 03:49:52</nova:creationTime>
Nov 08 03:49:52 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 03:49:52 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 03:49:52 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 03:49:52 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 03:49:52 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 03:49:52 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 03:49:52 user nova-compute[75014]:       </nova:flavor>
Nov 08 03:49:52 user nova-compute[75014]:       <nova:owner>
Nov 08 03:49:52 user nova-compute[75014]:         <nova:user uuid="270af1c402db435fbd851feef3d30693">tempest-AttachSCSIVolumeTestJSON-381314217-project-member</nova:user>
Nov 08 03:49:52 user nova-compute[75014]:         <nova:project uuid="73af3d7f9cbd46c6b08449dde0ef83cf">tempest-AttachSCSIVolumeTestJSON-381314217</nova:project>
Nov 08 03:49:52 user nova-compute[75014]:       </nova:owner>
Nov 08 03:49:52 user nova-compute[75014]:       <nova:root type="image" uuid="bf066b05-2bf7-4337-a362-db1202224114"/>
Nov 08 03:49:52 user nova-compute[75014]:       <nova:ports>
Nov 08 03:49:52 user nova-compute[75014]:         <nova:port uuid="12d06985-404f-4ffb-98b2-4967d82e45ca">
Nov 08 03:49:52 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 03:49:52 user nova-compute[75014]:         </nova:port>
Nov 08 03:49:52 user nova-compute[75014]:       </nova:ports>
Nov 08 03:49:52 user nova-compute[75014]:     </nova:instance>
Nov 08 03:49:52 user nova-compute[75014]:   </metadata>
Nov 08 03:49:52 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 03:49:52 user nova-compute[75014]:     <system>
Nov 08 03:49:52 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 03:49:52 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 03:49:52 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 03:49:52 user nova-compute[75014]:       <entry name="serial">8a8d9f3c-1150-4306-8dc6-eedde92c7a35</entry>
Nov 08 03:49:52 user nova-compute[75014]:       <entry name="uuid">8a8d9f3c-1150-4306-8dc6-eedde92c7a35</entry>
Nov 08 03:49:52 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 03:49:52 user nova-compute[75014]:     </system>
Nov 08 03:49:52 user nova-compute[75014]:   </sysinfo>
Nov 08 03:49:52 user nova-compute[75014]:   <os>
Nov 08 03:49:52 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 03:49:52 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 03:49:52 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 03:49:52 user nova-compute[75014]:   </os>
Nov 08 03:49:52 user nova-compute[75014]:   <features>
Nov 08 03:49:52 user nova-compute[75014]:     <acpi/>
Nov 08 03:49:52 user nova-compute[75014]:     <apic/>
Nov 08 03:49:52 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 03:49:52 user nova-compute[75014]:   </features>
Nov 08 03:49:52 user nova-compute[75014]:   <clock offset="utc">
Nov 08 03:49:52 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 03:49:52 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 03:49:52 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 03:49:52 user nova-compute[75014]:   </clock>
Nov 08 03:49:52 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 03:49:52 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 03:49:52 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 03:49:52 user nova-compute[75014]:   </cpu>
Nov 08 03:49:52 user nova-compute[75014]:   <devices>
Nov 08 03:49:52 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 03:49:52 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 03:49:52 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35/disk"/>
Nov 08 03:49:52 user nova-compute[75014]:       <target dev="sda" bus="scsi"/>
Nov 08 03:49:52 user nova-compute[75014]:       <address type="drive" controller="0" unit="0"/>
Nov 08 03:49:52 user nova-compute[75014]:     </disk>
Nov 08 03:49:52 user nova-compute[75014]:     <disk type="file" device="cdrom">
Nov 08 03:49:52 user nova-compute[75014]:       <driver name="qemu" type="raw" cache="none"/>
Nov 08 03:49:52 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35/disk.config"/>
Nov 08 03:49:52 user nova-compute[75014]:       <target dev="sdb" bus="scsi"/>
Nov 08 03:49:52 user nova-compute[75014]:       <address type="drive" controller="0" unit="1"/>
Nov 08 03:49:52 user nova-compute[75014]:     </disk>
Nov 08 03:49:52 user nova-compute[75014]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 08 03:49:52 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:49:52 user nova-compute[75014]:       <mac address="fa:16:3e:c3:48:cb"/>
Nov 08 03:49:52 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:49:52 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:49:52 user nova-compute[75014]:       <target dev="tap12d06985-40"/>
Nov 08 03:49:52 user nova-compute[75014]:     </interface>
Nov 08 03:49:52 user nova-compute[75014]:     <serial type="pty">
Nov 08 03:49:52 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35/console.log" append="off"/>
Nov 08 03:49:52 user nova-compute[75014]:     </serial>
Nov 08 03:49:52 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 03:49:52 user nova-compute[75014]:     <video>
Nov 08 03:49:52 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:49:52 user nova-compute[75014]:     </video>
Nov 08 03:49:52 user nova-compute[75014]:     <rng model="virtio">
Nov 08 03:49:52 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 03:49:52 user nova-compute[75014]:     </rng>
Nov 08 03:49:52 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 03:49:52 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 03:49:52 user nova-compute[75014]:       <stats period="10"/>
Nov 08 03:49:52 user nova-compute[75014]:     </memballoon>
Nov 08 03:49:52 user nova-compute[75014]:   </devices>
Nov 08 03:49:52 user nova-compute[75014]: </domain>
Nov 08 03:49:52 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:49:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1751896276',display_name='tempest-AttachSCSIVolumeTestJSON-server-1751896276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1751896276',id=6,image_ref='bf066b05-2bf7-4337-a362-db1202224114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+px21gyGxCyg8YXyhCYpThpjcf0ZiZIgyJZ8yfitrhz4DFHIMzDgh8jo4gaToI4Tbk9OSkVjj99XuUpPToStW3+DSzuijtTaPClBOrVw8jY8INyF6hpiGZoE7f98N+7A==',key_name='tempest-keypair-1364196698',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73af3d7f9cbd46c6b08449dde0ef83cf',ramdisk_id='',reservation_id='r-fh7u0nla',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf066b05-2bf7-4337-a362-db1202224114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-381314217',owner_user_name='tempest-AttachSCSIVolumeTestJSON-381314217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:49:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270af1c402db435fbd851feef3d30693',uuid=8a8d9f3c-1150-4306-8dc6-eedde92c7a35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12d06985-404f-4ffb-98b2-4967d82e45ca", "address": "fa:16:3e:c3:48:cb", "network": {"id": "ad32e55b-9579-41dd-b98f-e962ac63433a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1118133511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73af3d7f9cbd46c6b08449dde0ef83cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d06985-40", "ovs_interfaceid": "12d06985-404f-4ffb-98b2-4967d82e45ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Converting VIF {"id": "12d06985-404f-4ffb-98b2-4967d82e45ca", "address": "fa:16:3e:c3:48:cb", "network": {"id": "ad32e55b-9579-41dd-b98f-e962ac63433a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1118133511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73af3d7f9cbd46c6b08449dde0ef83cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d06985-40", "ovs_interfaceid": "12d06985-404f-4ffb-98b2-4967d82e45ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:48:cb,bridge_name='br-int',has_traffic_filtering=True,id=12d06985-404f-4ffb-98b2-4967d82e45ca,network=Network(ad32e55b-9579-41dd-b98f-e962ac63433a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12d06985-40') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG os_vif [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:48:cb,bridge_name='br-int',has_traffic_filtering=True,id=12d06985-404f-4ffb-98b2-4967d82e45ca,network=Network(ad32e55b-9579-41dd-b98f-e962ac63433a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12d06985-40') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aafad36f-92f2-5d25-b7fd-ad53b325ea18', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12d06985-40, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap12d06985-40, col_values=(('qos', UUID('d693d0b4-0c6d-4baa-8a98-fed7434a0720')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap12d06985-40, col_values=(('external_ids', {'iface-id': '12d06985-404f-4ffb-98b2-4967d82e45ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:48:cb', 'vm-uuid': '8a8d9f3c-1150-4306-8dc6-eedde92c7a35'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] No VIF found with MAC fa:16:3e:66:a0:f5, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:52 user nova-compute[75014]: INFO os_vif [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:48:cb,bridge_name='br-int',has_traffic_filtering=True,id=12d06985-404f-4ffb-98b2-4967d82e45ca,network=Network(ad32e55b-9579-41dd-b98f-e962ac63433a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12d06985-40')
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.compute.manager [req-d8886fd1-eaca-43f4-90a3-de881abdac2b req-0a688e5c-5603-4ed3-9fe4-556b8da0f54e service nova] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Received event network-changed-12d06985-404f-4ffb-98b2-4967d82e45ca {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.compute.manager [req-d8886fd1-eaca-43f4-90a3-de881abdac2b req-0a688e5c-5603-4ed3-9fe4-556b8da0f54e service nova] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Refreshing instance network info cache due to event network-changed-12d06985-404f-4ffb-98b2-4967d82e45ca. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d8886fd1-eaca-43f4-90a3-de881abdac2b req-0a688e5c-5603-4ed3-9fe4-556b8da0f54e service nova] Acquiring lock "refresh_cache-8a8d9f3c-1150-4306-8dc6-eedde92c7a35" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d8886fd1-eaca-43f4-90a3-de881abdac2b req-0a688e5c-5603-4ed3-9fe4-556b8da0f54e service nova] Acquired lock "refresh_cache-8a8d9f3c-1150-4306-8dc6-eedde92c7a35" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.network.neutron [req-d8886fd1-eaca-43f4-90a3-de881abdac2b req-0a688e5c-5603-4ed3-9fe4-556b8da0f54e service nova] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Refreshing network info cache for port 12d06985-404f-4ffb-98b2-4967d82e45ca {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] No BDM found with device name sda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] No VIF found with MAC fa:16:3e:c3:48:cb, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:49:52 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Using config drive
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:53 user nova-compute[75014]: DEBUG nova.network.neutron [req-7aa17770-c113-4928-9d1d-8b9687ea1f12 req-44a696b7-4ce7-40c4-abed-74cd9af53580 service nova] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Updated VIF entry in instance network info cache for port 81345e21-7bc0-451c-950d-30053a7181d3. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:49:53 user nova-compute[75014]: DEBUG nova.network.neutron [req-7aa17770-c113-4928-9d1d-8b9687ea1f12 req-44a696b7-4ce7-40c4-abed-74cd9af53580 service nova] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Updating instance_info_cache with network_info: [{"id": "81345e21-7bc0-451c-950d-30053a7181d3", "address": "fa:16:3e:66:a0:f5", "network": {"id": "24ff600e-3d1c-49d0-90cf-84e1aa25d978", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1636920770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4e7f2292f74b0a88221144ad5220f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81345e21-7b", "ovs_interfaceid": "81345e21-7bc0-451c-950d-30053a7181d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:49:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-7aa17770-c113-4928-9d1d-8b9687ea1f12 req-44a696b7-4ce7-40c4-abed-74cd9af53580 service nova] Releasing lock "refresh_cache-7dd0e158-473f-4785-a5cf-a75b2da85b29" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:49:53 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Creating config drive at /opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35/disk.config
Nov 08 03:49:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnjd97j0j {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:49:54 user nova-compute[75014]: DEBUG nova.network.neutron [req-d8886fd1-eaca-43f4-90a3-de881abdac2b req-0a688e5c-5603-4ed3-9fe4-556b8da0f54e service nova] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Updated VIF entry in instance network info cache for port 12d06985-404f-4ffb-98b2-4967d82e45ca. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:49:54 user nova-compute[75014]: DEBUG nova.network.neutron [req-d8886fd1-eaca-43f4-90a3-de881abdac2b req-0a688e5c-5603-4ed3-9fe4-556b8da0f54e service nova] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Updating instance_info_cache with network_info: [{"id": "12d06985-404f-4ffb-98b2-4967d82e45ca", "address": "fa:16:3e:c3:48:cb", "network": {"id": "ad32e55b-9579-41dd-b98f-e962ac63433a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1118133511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73af3d7f9cbd46c6b08449dde0ef83cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d06985-40", "ovs_interfaceid": "12d06985-404f-4ffb-98b2-4967d82e45ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:49:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnjd97j0j" returned: 0 in 0.075s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:49:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d8886fd1-eaca-43f4-90a3-de881abdac2b req-0a688e5c-5603-4ed3-9fe4-556b8da0f54e service nova] Releasing lock "refresh_cache-8a8d9f3c-1150-4306-8dc6-eedde92c7a35" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:49:54 user nova-compute[75014]: DEBUG nova.compute.manager [req-d8886fd1-eaca-43f4-90a3-de881abdac2b req-0a688e5c-5603-4ed3-9fe4-556b8da0f54e service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Received event network-vif-plugged-4979eddc-54c6-46e4-987a-640c4ccade99 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:49:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d8886fd1-eaca-43f4-90a3-de881abdac2b req-0a688e5c-5603-4ed3-9fe4-556b8da0f54e service nova] Acquiring lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d8886fd1-eaca-43f4-90a3-de881abdac2b req-0a688e5c-5603-4ed3-9fe4-556b8da0f54e service nova] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d8886fd1-eaca-43f4-90a3-de881abdac2b req-0a688e5c-5603-4ed3-9fe4-556b8da0f54e service nova] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:54 user nova-compute[75014]: DEBUG nova.compute.manager [req-d8886fd1-eaca-43f4-90a3-de881abdac2b req-0a688e5c-5603-4ed3-9fe4-556b8da0f54e service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] No waiting events found dispatching network-vif-plugged-4979eddc-54c6-46e4-987a-640c4ccade99 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:49:54 user nova-compute[75014]: WARNING nova.compute.manager [req-d8886fd1-eaca-43f4-90a3-de881abdac2b req-0a688e5c-5603-4ed3-9fe4-556b8da0f54e service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Received unexpected event network-vif-plugged-4979eddc-54c6-46e4-987a-640c4ccade99 for instance with vm_state active and task_state None.
Nov 08 03:49:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:54 user nova-compute[75014]: DEBUG nova.compute.manager [req-01cb4cf7-7f39-4246-8f9b-c275b674ffdb req-0b04fa4b-fcef-44c6-8281-6e047067552f service nova] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Received event network-vif-plugged-81345e21-7bc0-451c-950d-30053a7181d3 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:49:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-01cb4cf7-7f39-4246-8f9b-c275b674ffdb req-0b04fa4b-fcef-44c6-8281-6e047067552f service nova] Acquiring lock "7dd0e158-473f-4785-a5cf-a75b2da85b29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-01cb4cf7-7f39-4246-8f9b-c275b674ffdb req-0b04fa4b-fcef-44c6-8281-6e047067552f service nova] Lock "7dd0e158-473f-4785-a5cf-a75b2da85b29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-01cb4cf7-7f39-4246-8f9b-c275b674ffdb req-0b04fa4b-fcef-44c6-8281-6e047067552f service nova] Lock "7dd0e158-473f-4785-a5cf-a75b2da85b29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:54 user nova-compute[75014]: DEBUG nova.compute.manager [req-01cb4cf7-7f39-4246-8f9b-c275b674ffdb req-0b04fa4b-fcef-44c6-8281-6e047067552f service nova] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] No waiting events found dispatching network-vif-plugged-81345e21-7bc0-451c-950d-30053a7181d3 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:49:54 user nova-compute[75014]: WARNING nova.compute.manager [req-01cb4cf7-7f39-4246-8f9b-c275b674ffdb req-0b04fa4b-fcef-44c6-8281-6e047067552f service nova] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Received unexpected event network-vif-plugged-81345e21-7bc0-451c-950d-30053a7181d3 for instance with vm_state building and task_state spawning.
Nov 08 03:49:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:57 user nova-compute[75014]: DEBUG nova.compute.manager [req-26a919e7-6788-43de-a308-2366b1f9008d req-fe49d42c-3dee-42d3-a3a2-818ee7b6d1e5 service nova] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Received event network-vif-plugged-81345e21-7bc0-451c-950d-30053a7181d3 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:49:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-26a919e7-6788-43de-a308-2366b1f9008d req-fe49d42c-3dee-42d3-a3a2-818ee7b6d1e5 service nova] Acquiring lock "7dd0e158-473f-4785-a5cf-a75b2da85b29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-26a919e7-6788-43de-a308-2366b1f9008d req-fe49d42c-3dee-42d3-a3a2-818ee7b6d1e5 service nova] Lock "7dd0e158-473f-4785-a5cf-a75b2da85b29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-26a919e7-6788-43de-a308-2366b1f9008d req-fe49d42c-3dee-42d3-a3a2-818ee7b6d1e5 service nova] Lock "7dd0e158-473f-4785-a5cf-a75b2da85b29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:57 user nova-compute[75014]: DEBUG nova.compute.manager [req-26a919e7-6788-43de-a308-2366b1f9008d req-fe49d42c-3dee-42d3-a3a2-818ee7b6d1e5 service nova] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] No waiting events found dispatching network-vif-plugged-81345e21-7bc0-451c-950d-30053a7181d3 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:49:57 user nova-compute[75014]: WARNING nova.compute.manager [req-26a919e7-6788-43de-a308-2366b1f9008d req-fe49d42c-3dee-42d3-a3a2-818ee7b6d1e5 service nova] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Received unexpected event network-vif-plugged-81345e21-7bc0-451c-950d-30053a7181d3 for instance with vm_state building and task_state spawning.
Nov 08 03:49:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:49:57 user nova-compute[75014]: DEBUG nova.compute.manager [req-8fd0a0a0-429e-4198-8872-6ee315338342 req-8cf92890-5412-423c-903f-e911006e020b service nova] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Received event network-vif-plugged-5ccfbc09-b908-4eb3-9521-31289eb0641f {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:49:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8fd0a0a0-429e-4198-8872-6ee315338342 req-8cf92890-5412-423c-903f-e911006e020b service nova] Acquiring lock "30cf3d8d-a9e0-4b67-b2df-fafaeb616e89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:49:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8fd0a0a0-429e-4198-8872-6ee315338342 req-8cf92890-5412-423c-903f-e911006e020b service nova] Lock "30cf3d8d-a9e0-4b67-b2df-fafaeb616e89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:49:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8fd0a0a0-429e-4198-8872-6ee315338342 req-8cf92890-5412-423c-903f-e911006e020b service nova] Lock "30cf3d8d-a9e0-4b67-b2df-fafaeb616e89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:57 user nova-compute[75014]: DEBUG nova.compute.manager [req-8fd0a0a0-429e-4198-8872-6ee315338342 req-8cf92890-5412-423c-903f-e911006e020b service nova] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] No waiting events found dispatching network-vif-plugged-5ccfbc09-b908-4eb3-9521-31289eb0641f {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:49:57 user nova-compute[75014]: WARNING nova.compute.manager [req-8fd0a0a0-429e-4198-8872-6ee315338342 req-8cf92890-5412-423c-903f-e911006e020b service nova] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Received unexpected event network-vif-plugged-5ccfbc09-b908-4eb3-9521-31289eb0641f for instance with vm_state active and task_state None.
Nov 08 03:49:59 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 03:49:59 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 03:49:59 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Instance spawned successfully.
Nov 08 03:49:59 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 03:49:59 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:59 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:59 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:59 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:59 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:59 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:59 user nova-compute[75014]: INFO nova.compute.manager [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Took 11.17 seconds to spawn the instance on the hypervisor.
Nov 08 03:49:59 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:49:59 user nova-compute[75014]: INFO nova.compute.manager [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Took 15.57 seconds to build instance.
Nov 08 03:49:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a20e76c8-cc2b-46e8-943c-066e0120045c tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "7dd0e158-473f-4785-a5cf-a75b2da85b29" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.858s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:49:59 user nova-compute[75014]: DEBUG nova.compute.manager [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 03:49:59 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 03:49:59 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Instance spawned successfully.
Nov 08 03:49:59 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 03:49:59 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:59 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:59 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:59 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:49:59 user nova-compute[75014]: INFO nova.compute.manager [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Took 13.34 seconds to spawn the instance on the hypervisor.
Nov 08 03:49:59 user nova-compute[75014]: DEBUG nova.compute.manager [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:50:00 user nova-compute[75014]: DEBUG nova.compute.manager [req-8413edb1-cf26-4044-9a97-34467c1ff80d req-e38d08d3-e4a6-474c-8694-6e8b19674257 service nova] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Received event network-vif-plugged-5ccfbc09-b908-4eb3-9521-31289eb0641f {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:50:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8413edb1-cf26-4044-9a97-34467c1ff80d req-e38d08d3-e4a6-474c-8694-6e8b19674257 service nova] Acquiring lock "30cf3d8d-a9e0-4b67-b2df-fafaeb616e89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:50:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8413edb1-cf26-4044-9a97-34467c1ff80d req-e38d08d3-e4a6-474c-8694-6e8b19674257 service nova] Lock "30cf3d8d-a9e0-4b67-b2df-fafaeb616e89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:50:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8413edb1-cf26-4044-9a97-34467c1ff80d req-e38d08d3-e4a6-474c-8694-6e8b19674257 service nova] Lock "30cf3d8d-a9e0-4b67-b2df-fafaeb616e89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:50:00 user nova-compute[75014]: DEBUG nova.compute.manager [req-8413edb1-cf26-4044-9a97-34467c1ff80d req-e38d08d3-e4a6-474c-8694-6e8b19674257 service nova] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] No waiting events found dispatching network-vif-plugged-5ccfbc09-b908-4eb3-9521-31289eb0641f {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:50:00 user nova-compute[75014]: WARNING nova.compute.manager [req-8413edb1-cf26-4044-9a97-34467c1ff80d req-e38d08d3-e4a6-474c-8694-6e8b19674257 service nova] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Received unexpected event network-vif-plugged-5ccfbc09-b908-4eb3-9521-31289eb0641f for instance with vm_state active and task_state None.
Nov 08 03:50:00 user nova-compute[75014]: DEBUG nova.compute.manager [req-8413edb1-cf26-4044-9a97-34467c1ff80d req-e38d08d3-e4a6-474c-8694-6e8b19674257 service nova] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Received event network-vif-plugged-12d06985-404f-4ffb-98b2-4967d82e45ca {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:50:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8413edb1-cf26-4044-9a97-34467c1ff80d req-e38d08d3-e4a6-474c-8694-6e8b19674257 service nova] Acquiring lock "8a8d9f3c-1150-4306-8dc6-eedde92c7a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:50:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8413edb1-cf26-4044-9a97-34467c1ff80d req-e38d08d3-e4a6-474c-8694-6e8b19674257 service nova] Lock "8a8d9f3c-1150-4306-8dc6-eedde92c7a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:50:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8413edb1-cf26-4044-9a97-34467c1ff80d req-e38d08d3-e4a6-474c-8694-6e8b19674257 service nova] Lock "8a8d9f3c-1150-4306-8dc6-eedde92c7a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:50:00 user nova-compute[75014]: DEBUG nova.compute.manager [req-8413edb1-cf26-4044-9a97-34467c1ff80d req-e38d08d3-e4a6-474c-8694-6e8b19674257 service nova] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] No waiting events found dispatching network-vif-plugged-12d06985-404f-4ffb-98b2-4967d82e45ca {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:50:00 user nova-compute[75014]: WARNING nova.compute.manager [req-8413edb1-cf26-4044-9a97-34467c1ff80d req-e38d08d3-e4a6-474c-8694-6e8b19674257 service nova] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Received unexpected event network-vif-plugged-12d06985-404f-4ffb-98b2-4967d82e45ca for instance with vm_state building and task_state spawning.
Nov 08 03:50:00 user nova-compute[75014]: DEBUG nova.compute.manager [req-8413edb1-cf26-4044-9a97-34467c1ff80d req-e38d08d3-e4a6-474c-8694-6e8b19674257 service nova] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Received event network-vif-plugged-12d06985-404f-4ffb-98b2-4967d82e45ca {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:50:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8413edb1-cf26-4044-9a97-34467c1ff80d req-e38d08d3-e4a6-474c-8694-6e8b19674257 service nova] Acquiring lock "8a8d9f3c-1150-4306-8dc6-eedde92c7a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:50:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8413edb1-cf26-4044-9a97-34467c1ff80d req-e38d08d3-e4a6-474c-8694-6e8b19674257 service nova] Lock "8a8d9f3c-1150-4306-8dc6-eedde92c7a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:50:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8413edb1-cf26-4044-9a97-34467c1ff80d req-e38d08d3-e4a6-474c-8694-6e8b19674257 service nova] Lock "8a8d9f3c-1150-4306-8dc6-eedde92c7a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:50:00 user nova-compute[75014]: DEBUG nova.compute.manager [req-8413edb1-cf26-4044-9a97-34467c1ff80d req-e38d08d3-e4a6-474c-8694-6e8b19674257 service nova] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] No waiting events found dispatching network-vif-plugged-12d06985-404f-4ffb-98b2-4967d82e45ca {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:50:00 user nova-compute[75014]: WARNING nova.compute.manager [req-8413edb1-cf26-4044-9a97-34467c1ff80d req-e38d08d3-e4a6-474c-8694-6e8b19674257 service nova] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Received unexpected event network-vif-plugged-12d06985-404f-4ffb-98b2-4967d82e45ca for instance with vm_state building and task_state spawning.
Nov 08 03:50:00 user nova-compute[75014]: INFO nova.compute.manager [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Took 18.58 seconds to build instance.
Nov 08 03:50:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0d1b696a-dccd-47dc-8055-694cf8a65714 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lock "8a8d9f3c-1150-4306-8dc6-eedde92c7a35" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.777s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:50:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Acquiring lock "2ab81192-8890-499c-ad4b-b93664da45fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:50:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Lock "2ab81192-8890-499c-ad4b-b93664da45fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:50:01 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 03:50:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:50:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:50:01 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 03:50:01 user nova-compute[75014]: INFO nova.compute.claims [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Claim successful on node user
Nov 08 03:50:02 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:50:02 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:50:02 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.703s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:50:02 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 03:50:02 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 03:50:02 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 03:50:02 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 03:50:02 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 03:50:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:02 user nova-compute[75014]: DEBUG nova.policy [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd4cafe48fe574e2995a86e80d3df89d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ed0da9041f4975940636f88112cce2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 03:50:02 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 03:50:02 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 03:50:02 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Creating image(s)
Nov 08 03:50:02 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:50:02 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Lock "/opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:50:02 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Lock "/opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:50:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:50:03 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.381s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:50:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:50:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:50:03 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:50:03 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.246s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:50:03 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:50:03 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb/disk 1073741824" returned: 0 in 0.074s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:50:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.339s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:50:03 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:50:03 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.267s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:50:03 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 03:50:03 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:50:03 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Successfully created port: 9560a102-ba69-4b8d-a190-4c328fd75152 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 03:50:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:50:04 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Cannot resize image /opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 03:50:04 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 03:50:04 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Ensure instance console log exists: /opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 03:50:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:50:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:50:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:50:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:04 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Successfully updated port: 9560a102-ba69-4b8d-a190-4c328fd75152 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Acquiring lock "refresh_cache-2ab81192-8890-499c-ad4b-b93664da45fb" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Acquired lock "refresh_cache-2ab81192-8890-499c-ad4b-b93664da45fb" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.compute.manager [req-082d0694-24a5-44d6-976f-23a87b410476 req-e9e4f395-d47c-4a34-bdac-4cd5d3d4316c service nova] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Received event network-changed-9560a102-ba69-4b8d-a190-4c328fd75152 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.compute.manager [req-082d0694-24a5-44d6-976f-23a87b410476 req-e9e4f395-d47c-4a34-bdac-4cd5d3d4316c service nova] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Refreshing instance network info cache due to event network-changed-9560a102-ba69-4b8d-a190-4c328fd75152. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-082d0694-24a5-44d6-976f-23a87b410476 req-e9e4f395-d47c-4a34-bdac-4cd5d3d4316c service nova] Acquiring lock "refresh_cache-2ab81192-8890-499c-ad4b-b93664da45fb" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Updating instance_info_cache with network_info: [{"id": "9560a102-ba69-4b8d-a190-4c328fd75152", "address": "fa:16:3e:ac:c2:d9", "network": {"id": "cd4479bd-ef72-411c-bbab-3738ca8d79d4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1925691320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ed0da9041f4975940636f88112cce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9560a102-ba", "ovs_interfaceid": "9560a102-ba69-4b8d-a190-4c328fd75152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Releasing lock "refresh_cache-2ab81192-8890-499c-ad4b-b93664da45fb" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Instance network_info: |[{"id": "9560a102-ba69-4b8d-a190-4c328fd75152", "address": "fa:16:3e:ac:c2:d9", "network": {"id": "cd4479bd-ef72-411c-bbab-3738ca8d79d4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1925691320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ed0da9041f4975940636f88112cce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9560a102-ba", "ovs_interfaceid": "9560a102-ba69-4b8d-a190-4c328fd75152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-082d0694-24a5-44d6-976f-23a87b410476 req-e9e4f395-d47c-4a34-bdac-4cd5d3d4316c service nova] Acquired lock "refresh_cache-2ab81192-8890-499c-ad4b-b93664da45fb" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.network.neutron [req-082d0694-24a5-44d6-976f-23a87b410476 req-e9e4f395-d47c-4a34-bdac-4cd5d3d4316c service nova] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Refreshing network info cache for port 9560a102-ba69-4b8d-a190-4c328fd75152 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Start _get_guest_xml network_info=[{"id": "9560a102-ba69-4b8d-a190-4c328fd75152", "address": "fa:16:3e:ac:c2:d9", "network": {"id": "cd4479bd-ef72-411c-bbab-3738ca8d79d4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1925691320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ed0da9041f4975940636f88112cce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9560a102-ba", "ovs_interfaceid": "9560a102-ba69-4b8d-a190-4c328fd75152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 03:50:05 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:50:05 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:50:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2120142222',display_name='tempest-TestVolumeSwap-server-2120142222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2120142222',id=8,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDee/x44gpD2qveGqI7Qnm2TSqrDL9M5FYEuNzopTlXXeUxC021f24dXpE8MXDY01Y5w3Ocjwb28WoK9Q7qQAdKM8xH9kSlunDbA0znyPbkHZV30sxR/CXudoLgVMepBZQ==',key_name='tempest-keypair-1918879649',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29ed0da9041f4975940636f88112cce2',ramdisk_id='',reservation_id='r-usrzxfo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1359819208',owner_user_name='tempest-TestVolumeSwap-1359819208-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:50:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4cafe48fe574e2995a86e80d3df89d3',uuid=2ab81192-8890-499c-ad4b-b93664da45fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9560a102-ba69-4b8d-a190-4c328fd75152", "address": "fa:16:3e:ac:c2:d9", "network": {"id": "cd4479bd-ef72-411c-bbab-3738ca8d79d4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1925691320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ed0da9041f4975940636f88112cce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9560a102-ba", "ovs_interfaceid": "9560a102-ba69-4b8d-a190-4c328fd75152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Converting VIF {"id": "9560a102-ba69-4b8d-a190-4c328fd75152", "address": "fa:16:3e:ac:c2:d9", "network": {"id": "cd4479bd-ef72-411c-bbab-3738ca8d79d4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1925691320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ed0da9041f4975940636f88112cce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9560a102-ba", "ovs_interfaceid": "9560a102-ba69-4b8d-a190-4c328fd75152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:c2:d9,bridge_name='br-int',has_traffic_filtering=True,id=9560a102-ba69-4b8d-a190-4c328fd75152,network=Network(cd4479bd-ef72-411c-bbab-3738ca8d79d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9560a102-ba') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.objects.instance [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ab81192-8890-499c-ad4b-b93664da45fb {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] End _get_guest_xml xml=<domain type="kvm">
Nov 08 03:50:05 user nova-compute[75014]:   <uuid>2ab81192-8890-499c-ad4b-b93664da45fb</uuid>
Nov 08 03:50:05 user nova-compute[75014]:   <name>instance-00000008</name>
Nov 08 03:50:05 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 03:50:05 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 03:50:05 user nova-compute[75014]:   <metadata>
Nov 08 03:50:05 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 03:50:05 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 03:50:05 user nova-compute[75014]:       <nova:name>tempest-TestVolumeSwap-server-2120142222</nova:name>
Nov 08 03:50:05 user nova-compute[75014]:       <nova:creationTime>2023-11-08 03:50:05</nova:creationTime>
Nov 08 03:50:05 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 03:50:05 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 03:50:05 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 03:50:05 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 03:50:05 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 03:50:05 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 03:50:05 user nova-compute[75014]:       </nova:flavor>
Nov 08 03:50:05 user nova-compute[75014]:       <nova:owner>
Nov 08 03:50:05 user nova-compute[75014]:         <nova:user uuid="d4cafe48fe574e2995a86e80d3df89d3">tempest-TestVolumeSwap-1359819208-project-member</nova:user>
Nov 08 03:50:05 user nova-compute[75014]:         <nova:project uuid="29ed0da9041f4975940636f88112cce2">tempest-TestVolumeSwap-1359819208</nova:project>
Nov 08 03:50:05 user nova-compute[75014]:       </nova:owner>
Nov 08 03:50:05 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 03:50:05 user nova-compute[75014]:       <nova:ports>
Nov 08 03:50:05 user nova-compute[75014]:         <nova:port uuid="9560a102-ba69-4b8d-a190-4c328fd75152">
Nov 08 03:50:05 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 03:50:05 user nova-compute[75014]:         </nova:port>
Nov 08 03:50:05 user nova-compute[75014]:       </nova:ports>
Nov 08 03:50:05 user nova-compute[75014]:     </nova:instance>
Nov 08 03:50:05 user nova-compute[75014]:   </metadata>
Nov 08 03:50:05 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 03:50:05 user nova-compute[75014]:     <system>
Nov 08 03:50:05 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 03:50:05 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 03:50:05 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 03:50:05 user nova-compute[75014]:       <entry name="serial">2ab81192-8890-499c-ad4b-b93664da45fb</entry>
Nov 08 03:50:05 user nova-compute[75014]:       <entry name="uuid">2ab81192-8890-499c-ad4b-b93664da45fb</entry>
Nov 08 03:50:05 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 03:50:05 user nova-compute[75014]:     </system>
Nov 08 03:50:05 user nova-compute[75014]:   </sysinfo>
Nov 08 03:50:05 user nova-compute[75014]:   <os>
Nov 08 03:50:05 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 03:50:05 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 03:50:05 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 03:50:05 user nova-compute[75014]:   </os>
Nov 08 03:50:05 user nova-compute[75014]:   <features>
Nov 08 03:50:05 user nova-compute[75014]:     <acpi/>
Nov 08 03:50:05 user nova-compute[75014]:     <apic/>
Nov 08 03:50:05 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 03:50:05 user nova-compute[75014]:   </features>
Nov 08 03:50:05 user nova-compute[75014]:   <clock offset="utc">
Nov 08 03:50:05 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 03:50:05 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 03:50:05 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 03:50:05 user nova-compute[75014]:   </clock>
Nov 08 03:50:05 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 03:50:05 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 03:50:05 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 03:50:05 user nova-compute[75014]:   </cpu>
Nov 08 03:50:05 user nova-compute[75014]:   <devices>
Nov 08 03:50:05 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 03:50:05 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 03:50:05 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb/disk"/>
Nov 08 03:50:05 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 03:50:05 user nova-compute[75014]:     </disk>
Nov 08 03:50:05 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:50:05 user nova-compute[75014]:       <mac address="fa:16:3e:ac:c2:d9"/>
Nov 08 03:50:05 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:50:05 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:50:05 user nova-compute[75014]:       <target dev="tap9560a102-ba"/>
Nov 08 03:50:05 user nova-compute[75014]:     </interface>
Nov 08 03:50:05 user nova-compute[75014]:     <serial type="pty">
Nov 08 03:50:05 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb/console.log" append="off"/>
Nov 08 03:50:05 user nova-compute[75014]:     </serial>
Nov 08 03:50:05 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 03:50:05 user nova-compute[75014]:     <video>
Nov 08 03:50:05 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:50:05 user nova-compute[75014]:     </video>
Nov 08 03:50:05 user nova-compute[75014]:     <rng model="virtio">
Nov 08 03:50:05 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 03:50:05 user nova-compute[75014]:     </rng>
Nov 08 03:50:05 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 03:50:05 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 03:50:05 user nova-compute[75014]:       <stats period="10"/>
Nov 08 03:50:05 user nova-compute[75014]:     </memballoon>
Nov 08 03:50:05 user nova-compute[75014]:   </devices>
Nov 08 03:50:05 user nova-compute[75014]: </domain>
Nov 08 03:50:05 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:50:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2120142222',display_name='tempest-TestVolumeSwap-server-2120142222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2120142222',id=8,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDee/x44gpD2qveGqI7Qnm2TSqrDL9M5FYEuNzopTlXXeUxC021f24dXpE8MXDY01Y5w3Ocjwb28WoK9Q7qQAdKM8xH9kSlunDbA0znyPbkHZV30sxR/CXudoLgVMepBZQ==',key_name='tempest-keypair-1918879649',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29ed0da9041f4975940636f88112cce2',ramdisk_id='',reservation_id='r-usrzxfo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1359819208',owner_user_name='tempest-TestVolumeSwap-1359819208-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:50:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4cafe48fe574e2995a86e80d3df89d3',uuid=2ab81192-8890-499c-ad4b-b93664da45fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9560a102-ba69-4b8d-a190-4c328fd75152", "address": "fa:16:3e:ac:c2:d9", "network": {"id": "cd4479bd-ef72-411c-bbab-3738ca8d79d4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1925691320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ed0da9041f4975940636f88112cce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9560a102-ba", "ovs_interfaceid": "9560a102-ba69-4b8d-a190-4c328fd75152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Converting VIF {"id": "9560a102-ba69-4b8d-a190-4c328fd75152", "address": "fa:16:3e:ac:c2:d9", "network": {"id": "cd4479bd-ef72-411c-bbab-3738ca8d79d4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1925691320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ed0da9041f4975940636f88112cce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9560a102-ba", "ovs_interfaceid": "9560a102-ba69-4b8d-a190-4c328fd75152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:c2:d9,bridge_name='br-int',has_traffic_filtering=True,id=9560a102-ba69-4b8d-a190-4c328fd75152,network=Network(cd4479bd-ef72-411c-bbab-3738ca8d79d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9560a102-ba') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG os_vif [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:c2:d9,bridge_name='br-int',has_traffic_filtering=True,id=9560a102-ba69-4b8d-a190-4c328fd75152,network=Network(cd4479bd-ef72-411c-bbab-3738ca8d79d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9560a102-ba') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '128ef769-f48b-544e-bf42-8d257960b594', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9560a102-ba, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9560a102-ba, col_values=(('qos', UUID('d8752877-3a03-40ae-befb-e4729fc5cc61')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9560a102-ba, col_values=(('external_ids', {'iface-id': '9560a102-ba69-4b8d-a190-4c328fd75152', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:c2:d9', 'vm-uuid': '2ab81192-8890-499c-ad4b-b93664da45fb'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:05 user nova-compute[75014]: INFO os_vif [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:c2:d9,bridge_name='br-int',has_traffic_filtering=True,id=9560a102-ba69-4b8d-a190-4c328fd75152,network=Network(cd4479bd-ef72-411c-bbab-3738ca8d79d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9560a102-ba')
Nov 08 03:50:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Acquiring lock "0f326d33-802d-4a4a-b2a2-a01b0fef36b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Lock "0f326d33-802d-4a4a-b2a2-a01b0fef36b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] No VIF found with MAC fa:16:3e:ac:c2:d9, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:50:05 user nova-compute[75014]: DEBUG nova.compute.manager [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 03:50:06 user nova-compute[75014]: DEBUG nova.network.neutron [req-082d0694-24a5-44d6-976f-23a87b410476 req-e9e4f395-d47c-4a34-bdac-4cd5d3d4316c service nova] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Updated VIF entry in instance network info cache for port 9560a102-ba69-4b8d-a190-4c328fd75152. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:50:06 user nova-compute[75014]: DEBUG nova.network.neutron [req-082d0694-24a5-44d6-976f-23a87b410476 req-e9e4f395-d47c-4a34-bdac-4cd5d3d4316c service nova] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Updating instance_info_cache with network_info: [{"id": "9560a102-ba69-4b8d-a190-4c328fd75152", "address": "fa:16:3e:ac:c2:d9", "network": {"id": "cd4479bd-ef72-411c-bbab-3738ca8d79d4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1925691320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ed0da9041f4975940636f88112cce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9560a102-ba", "ovs_interfaceid": "9560a102-ba69-4b8d-a190-4c328fd75152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:50:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-082d0694-24a5-44d6-976f-23a87b410476 req-e9e4f395-d47c-4a34-bdac-4cd5d3d4316c service nova] Releasing lock "refresh_cache-2ab81192-8890-499c-ad4b-b93664da45fb" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:50:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:50:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:50:06 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 03:50:06 user nova-compute[75014]: INFO nova.compute.claims [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Claim successful on node user
Nov 08 03:50:06 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:50:06 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:50:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:50:06 user nova-compute[75014]: DEBUG nova.compute.manager [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 03:50:06 user nova-compute[75014]: DEBUG nova.compute.manager [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 03:50:06 user nova-compute[75014]: DEBUG nova.network.neutron [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 03:50:06 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 03:50:06 user nova-compute[75014]: DEBUG nova.policy [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a5ffc25af624536989c4330a0c579ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd700a10920a240f5ba41ed032321e972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 03:50:06 user nova-compute[75014]: DEBUG nova.compute.manager [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 03:50:07 user nova-compute[75014]: DEBUG nova.compute.manager [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 03:50:07 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 03:50:07 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Creating image(s)
Nov 08 03:50:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f326d33-802d-4a4a-b2a2-a01b0fef36b4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:50:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Lock "/opt/stack/data/nova/instances/0f326d33-802d-4a4a-b2a2-a01b0fef36b4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:50:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Lock "/opt/stack/data/nova/instances/0f326d33-802d-4a4a-b2a2-a01b0fef36b4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:50:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:50:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.192s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:50:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:50:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:50:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:50:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.226s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:50:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/0f326d33-802d-4a4a-b2a2-a01b0fef36b4/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:50:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/0f326d33-802d-4a4a-b2a2-a01b0fef36b4/disk 1073741824" returned: 0 in 0.068s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:50:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:50:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:50:07 user nova-compute[75014]: DEBUG nova.network.neutron [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Successfully created port: 6a4fe909-e328-4b38-b695-6c555e1dd6d5 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 03:50:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.207s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:50:07 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0f326d33-802d-4a4a-b2a2-a01b0fef36b4/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 03:50:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f326d33-802d-4a4a-b2a2-a01b0fef36b4/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f326d33-802d-4a4a-b2a2-a01b0fef36b4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Cannot resize image /opt/stack/data/nova/instances/0f326d33-802d-4a4a-b2a2-a01b0fef36b4/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Ensure instance console log exists: /opt/stack/data/nova/instances/0f326d33-802d-4a4a-b2a2-a01b0fef36b4/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.network.neutron [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Successfully updated port: 6a4fe909-e328-4b38-b695-6c555e1dd6d5 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Acquiring lock "refresh_cache-0f326d33-802d-4a4a-b2a2-a01b0fef36b4" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Acquired lock "refresh_cache-0f326d33-802d-4a4a-b2a2-a01b0fef36b4" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.network.neutron [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.compute.manager [req-f2a9308e-ced6-49bc-9832-7d500399df4d req-22ab54ba-fdd5-4a99-91f2-0387093b6d14 service nova] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Received event network-changed-6a4fe909-e328-4b38-b695-6c555e1dd6d5 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.compute.manager [req-f2a9308e-ced6-49bc-9832-7d500399df4d req-22ab54ba-fdd5-4a99-91f2-0387093b6d14 service nova] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Refreshing instance network info cache due to event network-changed-6a4fe909-e328-4b38-b695-6c555e1dd6d5. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f2a9308e-ced6-49bc-9832-7d500399df4d req-22ab54ba-fdd5-4a99-91f2-0387093b6d14 service nova] Acquiring lock "refresh_cache-0f326d33-802d-4a4a-b2a2-a01b0fef36b4" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.network.neutron [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.network.neutron [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Updating instance_info_cache with network_info: [{"id": "6a4fe909-e328-4b38-b695-6c555e1dd6d5", "address": "fa:16:3e:12:02:8b", "network": {"id": "70074778-610f-4741-b871-65e344ac3986", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-298546593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a10920a240f5ba41ed032321e972", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4fe909-e3", "ovs_interfaceid": "6a4fe909-e328-4b38-b695-6c555e1dd6d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Releasing lock "refresh_cache-0f326d33-802d-4a4a-b2a2-a01b0fef36b4" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.compute.manager [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Instance network_info: |[{"id": "6a4fe909-e328-4b38-b695-6c555e1dd6d5", "address": "fa:16:3e:12:02:8b", "network": {"id": "70074778-610f-4741-b871-65e344ac3986", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-298546593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a10920a240f5ba41ed032321e972", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4fe909-e3", "ovs_interfaceid": "6a4fe909-e328-4b38-b695-6c555e1dd6d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f2a9308e-ced6-49bc-9832-7d500399df4d req-22ab54ba-fdd5-4a99-91f2-0387093b6d14 service nova] Acquired lock "refresh_cache-0f326d33-802d-4a4a-b2a2-a01b0fef36b4" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.network.neutron [req-f2a9308e-ced6-49bc-9832-7d500399df4d req-22ab54ba-fdd5-4a99-91f2-0387093b6d14 service nova] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Refreshing network info cache for port 6a4fe909-e328-4b38-b695-6c555e1dd6d5 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Start _get_guest_xml network_info=[{"id": "6a4fe909-e328-4b38-b695-6c555e1dd6d5", "address": "fa:16:3e:12:02:8b", "network": {"id": "70074778-610f-4741-b871-65e344ac3986", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-298546593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a10920a240f5ba41ed032321e972", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4fe909-e3", "ovs_interfaceid": "6a4fe909-e328-4b38-b695-6c555e1dd6d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 03:50:08 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:50:08 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2010445402',display_name='tempest-VolumesAssistedSnapshotsTest-server-2010445402',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2010445402',id=9,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+mESUz7g5auSz/9ZrPmvghEK/t4hSSw9Fs5/O+xQ74YjhSRZfXgtbrcBXqgDizauIEZ8FiY7AQCrNUqWlq5h2NlsJUptM41Nw4t9aov1vG71t8Sf8Dm0A1a+OpgIJCdQ==',key_name='tempest-keypair-1668063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d700a10920a240f5ba41ed032321e972',ramdisk_id='',reservation_id='r-anb4ateo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-519860353',owner_user_name='tempest-VolumesAssistedSnapshotsTest-519860353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:50:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a5ffc25af624536989c4330a0c579ee',uuid=0f326d33-802d-4a4a-b2a2-a01b0fef36b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a4fe909-e328-4b38-b695-6c555e1dd6d5", "address": "fa:16:3e:12:02:8b", "network": {"id": "70074778-610f-4741-b871-65e344ac3986", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-298546593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a10920a240f5ba41ed032321e972", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4fe909-e3", "ovs_interfaceid": "6a4fe909-e328-4b38-b695-6c555e1dd6d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Converting VIF {"id": "6a4fe909-e328-4b38-b695-6c555e1dd6d5", "address": "fa:16:3e:12:02:8b", "network": {"id": "70074778-610f-4741-b871-65e344ac3986", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-298546593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a10920a240f5ba41ed032321e972", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4fe909-e3", "ovs_interfaceid": "6a4fe909-e328-4b38-b695-6c555e1dd6d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:02:8b,bridge_name='br-int',has_traffic_filtering=True,id=6a4fe909-e328-4b38-b695-6c555e1dd6d5,network=Network(70074778-610f-4741-b871-65e344ac3986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4fe909-e3') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.objects.instance [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f326d33-802d-4a4a-b2a2-a01b0fef36b4 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] End _get_guest_xml xml=<domain type="kvm">
Nov 08 03:50:08 user nova-compute[75014]:   <uuid>0f326d33-802d-4a4a-b2a2-a01b0fef36b4</uuid>
Nov 08 03:50:08 user nova-compute[75014]:   <name>instance-00000009</name>
Nov 08 03:50:08 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 03:50:08 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 03:50:08 user nova-compute[75014]:   <metadata>
Nov 08 03:50:08 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 03:50:08 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 03:50:08 user nova-compute[75014]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-2010445402</nova:name>
Nov 08 03:50:08 user nova-compute[75014]:       <nova:creationTime>2023-11-08 03:50:08</nova:creationTime>
Nov 08 03:50:08 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 03:50:08 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 03:50:08 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 03:50:08 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 03:50:08 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 03:50:08 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 03:50:08 user nova-compute[75014]:       </nova:flavor>
Nov 08 03:50:08 user nova-compute[75014]:       <nova:owner>
Nov 08 03:50:08 user nova-compute[75014]:         <nova:user uuid="9a5ffc25af624536989c4330a0c579ee">tempest-VolumesAssistedSnapshotsTest-519860353-project-member</nova:user>
Nov 08 03:50:08 user nova-compute[75014]:         <nova:project uuid="d700a10920a240f5ba41ed032321e972">tempest-VolumesAssistedSnapshotsTest-519860353</nova:project>
Nov 08 03:50:08 user nova-compute[75014]:       </nova:owner>
Nov 08 03:50:08 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 03:50:08 user nova-compute[75014]:       <nova:ports>
Nov 08 03:50:08 user nova-compute[75014]:         <nova:port uuid="6a4fe909-e328-4b38-b695-6c555e1dd6d5">
Nov 08 03:50:08 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 03:50:08 user nova-compute[75014]:         </nova:port>
Nov 08 03:50:08 user nova-compute[75014]:       </nova:ports>
Nov 08 03:50:08 user nova-compute[75014]:     </nova:instance>
Nov 08 03:50:08 user nova-compute[75014]:   </metadata>
Nov 08 03:50:08 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 03:50:08 user nova-compute[75014]:     <system>
Nov 08 03:50:08 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 03:50:08 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 03:50:08 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 03:50:08 user nova-compute[75014]:       <entry name="serial">0f326d33-802d-4a4a-b2a2-a01b0fef36b4</entry>
Nov 08 03:50:08 user nova-compute[75014]:       <entry name="uuid">0f326d33-802d-4a4a-b2a2-a01b0fef36b4</entry>
Nov 08 03:50:08 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 03:50:08 user nova-compute[75014]:     </system>
Nov 08 03:50:08 user nova-compute[75014]:   </sysinfo>
Nov 08 03:50:08 user nova-compute[75014]:   <os>
Nov 08 03:50:08 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 03:50:08 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 03:50:08 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 03:50:08 user nova-compute[75014]:   </os>
Nov 08 03:50:08 user nova-compute[75014]:   <features>
Nov 08 03:50:08 user nova-compute[75014]:     <acpi/>
Nov 08 03:50:08 user nova-compute[75014]:     <apic/>
Nov 08 03:50:08 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 03:50:08 user nova-compute[75014]:   </features>
Nov 08 03:50:08 user nova-compute[75014]:   <clock offset="utc">
Nov 08 03:50:08 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 03:50:08 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 03:50:08 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 03:50:08 user nova-compute[75014]:   </clock>
Nov 08 03:50:08 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 03:50:08 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 03:50:08 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 03:50:08 user nova-compute[75014]:   </cpu>
Nov 08 03:50:08 user nova-compute[75014]:   <devices>
Nov 08 03:50:08 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 03:50:08 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 03:50:08 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/0f326d33-802d-4a4a-b2a2-a01b0fef36b4/disk"/>
Nov 08 03:50:08 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 03:50:08 user nova-compute[75014]:     </disk>
Nov 08 03:50:08 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:50:08 user nova-compute[75014]:       <mac address="fa:16:3e:12:02:8b"/>
Nov 08 03:50:08 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:50:08 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:50:08 user nova-compute[75014]:       <target dev="tap6a4fe909-e3"/>
Nov 08 03:50:08 user nova-compute[75014]:     </interface>
Nov 08 03:50:08 user nova-compute[75014]:     <serial type="pty">
Nov 08 03:50:08 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/0f326d33-802d-4a4a-b2a2-a01b0fef36b4/console.log" append="off"/>
Nov 08 03:50:08 user nova-compute[75014]:     </serial>
Nov 08 03:50:08 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 03:50:08 user nova-compute[75014]:     <video>
Nov 08 03:50:08 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:50:08 user nova-compute[75014]:     </video>
Nov 08 03:50:08 user nova-compute[75014]:     <rng model="virtio">
Nov 08 03:50:08 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 03:50:08 user nova-compute[75014]:     </rng>
Nov 08 03:50:08 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 03:50:08 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 03:50:08 user nova-compute[75014]:       <stats period="10"/>
Nov 08 03:50:08 user nova-compute[75014]:     </memballoon>
Nov 08 03:50:08 user nova-compute[75014]:   </devices>
Nov 08 03:50:08 user nova-compute[75014]: </domain>
Nov 08 03:50:08 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2010445402',display_name='tempest-VolumesAssistedSnapshotsTest-server-2010445402',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2010445402',id=9,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+mESUz7g5auSz/9ZrPmvghEK/t4hSSw9Fs5/O+xQ74YjhSRZfXgtbrcBXqgDizauIEZ8FiY7AQCrNUqWlq5h2NlsJUptM41Nw4t9aov1vG71t8Sf8Dm0A1a+OpgIJCdQ==',key_name='tempest-keypair-1668063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d700a10920a240f5ba41ed032321e972',ramdisk_id='',reservation_id='r-anb4ateo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-519860353',owner_user_name='tempest-VolumesAssistedSnapshotsTest-519860353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:50:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a5ffc25af624536989c4330a0c579ee',uuid=0f326d33-802d-4a4a-b2a2-a01b0fef36b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a4fe909-e328-4b38-b695-6c555e1dd6d5", "address": "fa:16:3e:12:02:8b", "network": {"id": "70074778-610f-4741-b871-65e344ac3986", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-298546593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a10920a240f5ba41ed032321e972", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4fe909-e3", "ovs_interfaceid": "6a4fe909-e328-4b38-b695-6c555e1dd6d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Converting VIF {"id": "6a4fe909-e328-4b38-b695-6c555e1dd6d5", "address": "fa:16:3e:12:02:8b", "network": {"id": "70074778-610f-4741-b871-65e344ac3986", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-298546593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a10920a240f5ba41ed032321e972", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4fe909-e3", "ovs_interfaceid": "6a4fe909-e328-4b38-b695-6c555e1dd6d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:02:8b,bridge_name='br-int',has_traffic_filtering=True,id=6a4fe909-e328-4b38-b695-6c555e1dd6d5,network=Network(70074778-610f-4741-b871-65e344ac3986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4fe909-e3') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG os_vif [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:02:8b,bridge_name='br-int',has_traffic_filtering=True,id=6a4fe909-e328-4b38-b695-6c555e1dd6d5,network=Network(70074778-610f-4741-b871-65e344ac3986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4fe909-e3') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '984daed4-d417-5f62-b952-f74f24a01dc7', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a4fe909-e3, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a4fe909-e3, col_values=(('qos', UUID('6c99a399-50c1-4bbb-9cea-764347d06873')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a4fe909-e3, col_values=(('external_ids', {'iface-id': '6a4fe909-e328-4b38-b695-6c555e1dd6d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:02:8b', 'vm-uuid': '0f326d33-802d-4a4a-b2a2-a01b0fef36b4'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:50:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:08 user nova-compute[75014]: INFO os_vif [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:02:8b,bridge_name='br-int',has_traffic_filtering=True,id=6a4fe909-e328-4b38-b695-6c555e1dd6d5,network=Network(70074778-610f-4741-b871-65e344ac3986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4fe909-e3')
Nov 08 03:50:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:50:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] No VIF found with MAC fa:16:3e:12:02:8b, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:50:09 user nova-compute[75014]: DEBUG nova.network.neutron [req-f2a9308e-ced6-49bc-9832-7d500399df4d req-22ab54ba-fdd5-4a99-91f2-0387093b6d14 service nova] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Updated VIF entry in instance network info cache for port 6a4fe909-e328-4b38-b695-6c555e1dd6d5. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:50:09 user nova-compute[75014]: DEBUG nova.network.neutron [req-f2a9308e-ced6-49bc-9832-7d500399df4d req-22ab54ba-fdd5-4a99-91f2-0387093b6d14 service nova] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Updating instance_info_cache with network_info: [{"id": "6a4fe909-e328-4b38-b695-6c555e1dd6d5", "address": "fa:16:3e:12:02:8b", "network": {"id": "70074778-610f-4741-b871-65e344ac3986", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-298546593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a10920a240f5ba41ed032321e972", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4fe909-e3", "ovs_interfaceid": "6a4fe909-e328-4b38-b695-6c555e1dd6d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:50:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f2a9308e-ced6-49bc-9832-7d500399df4d req-22ab54ba-fdd5-4a99-91f2-0387093b6d14 service nova] Releasing lock "refresh_cache-0f326d33-802d-4a4a-b2a2-a01b0fef36b4" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:50:09 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 03:50:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 03:50:09 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Instance spawned successfully.
Nov 08 03:50:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 03:50:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:50:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:50:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:50:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:50:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:50:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:50:09 user nova-compute[75014]: INFO nova.compute.manager [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Took 7.00 seconds to spawn the instance on the hypervisor.
Nov 08 03:50:09 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:50:09 user nova-compute[75014]: INFO nova.compute.manager [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Took 8.32 seconds to build instance.
Nov 08 03:50:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4e9ad002-c1f5-4bd9-9640-1b6c3b4b6417 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Lock "2ab81192-8890-499c-ad4b-b93664da45fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.500s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:50:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:12 user nova-compute[75014]: DEBUG nova.compute.manager [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 03:50:12 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 03:50:12 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Instance spawned successfully.
Nov 08 03:50:12 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 03:50:13 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:50:13 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:50:13 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:50:13 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:50:13 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:50:13 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:50:13 user nova-compute[75014]: INFO nova.compute.manager [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Took 5.97 seconds to spawn the instance on the hypervisor.
Nov 08 03:50:13 user nova-compute[75014]: DEBUG nova.compute.manager [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:50:13 user nova-compute[75014]: INFO nova.compute.manager [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Took 7.17 seconds to build instance.
Nov 08 03:50:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3da3e8b6-18e9-44f4-a0c3-538de99de2d8 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Lock "0f326d33-802d-4a4a-b2a2-a01b0fef36b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.509s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:50:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:15 user nova-compute[75014]: DEBUG nova.compute.manager [req-735d2264-0441-48ce-a645-d29f7d60783d req-648b039f-77db-4fcc-836c-a269a3700709 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Received event network-vif-plugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:50:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-735d2264-0441-48ce-a645-d29f7d60783d req-648b039f-77db-4fcc-836c-a269a3700709 service nova] Acquiring lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:50:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-735d2264-0441-48ce-a645-d29f7d60783d req-648b039f-77db-4fcc-836c-a269a3700709 service nova] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:50:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-735d2264-0441-48ce-a645-d29f7d60783d req-648b039f-77db-4fcc-836c-a269a3700709 service nova] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:50:15 user nova-compute[75014]: DEBUG nova.compute.manager [req-735d2264-0441-48ce-a645-d29f7d60783d req-648b039f-77db-4fcc-836c-a269a3700709 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] No waiting events found dispatching network-vif-plugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:50:15 user nova-compute[75014]: WARNING nova.compute.manager [req-735d2264-0441-48ce-a645-d29f7d60783d req-648b039f-77db-4fcc-836c-a269a3700709 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Received unexpected event network-vif-plugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 for instance with vm_state active and task_state None.
Nov 08 03:50:15 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:50:15 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Cleaning up deleted instances {{(pid=75014) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 03:50:15 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] There are 0 instances to clean {{(pid=75014) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 03:50:15 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:50:15 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=75014) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 03:50:15 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:50:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:17 user nova-compute[75014]: DEBUG nova.compute.manager [req-87249340-bb4b-4ea6-bc16-7eb684a3b838 req-e57b16d1-6b59-431e-b9ea-a76938ea8a30 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Received event network-vif-plugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:50:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-87249340-bb4b-4ea6-bc16-7eb684a3b838 req-e57b16d1-6b59-431e-b9ea-a76938ea8a30 service nova] Acquiring lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:50:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-87249340-bb4b-4ea6-bc16-7eb684a3b838 req-e57b16d1-6b59-431e-b9ea-a76938ea8a30 service nova] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:50:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-87249340-bb4b-4ea6-bc16-7eb684a3b838 req-e57b16d1-6b59-431e-b9ea-a76938ea8a30 service nova] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:50:17 user nova-compute[75014]: DEBUG nova.compute.manager [req-87249340-bb4b-4ea6-bc16-7eb684a3b838 req-e57b16d1-6b59-431e-b9ea-a76938ea8a30 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] No waiting events found dispatching network-vif-plugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:50:17 user nova-compute[75014]: WARNING nova.compute.manager [req-87249340-bb4b-4ea6-bc16-7eb684a3b838 req-e57b16d1-6b59-431e-b9ea-a76938ea8a30 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Received unexpected event network-vif-plugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 for instance with vm_state active and task_state None.
Nov 08 03:50:17 user nova-compute[75014]: DEBUG nova.compute.manager [req-87249340-bb4b-4ea6-bc16-7eb684a3b838 req-e57b16d1-6b59-431e-b9ea-a76938ea8a30 service nova] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Received event network-vif-plugged-3f08242a-d68d-4744-8b4c-49bdc29ea557 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:50:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-87249340-bb4b-4ea6-bc16-7eb684a3b838 req-e57b16d1-6b59-431e-b9ea-a76938ea8a30 service nova] Acquiring lock "5bfa6580-e0fe-46b0-b497-8db67806113a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:50:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-87249340-bb4b-4ea6-bc16-7eb684a3b838 req-e57b16d1-6b59-431e-b9ea-a76938ea8a30 service nova] Lock "5bfa6580-e0fe-46b0-b497-8db67806113a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:50:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-87249340-bb4b-4ea6-bc16-7eb684a3b838 req-e57b16d1-6b59-431e-b9ea-a76938ea8a30 service nova] Lock "5bfa6580-e0fe-46b0-b497-8db67806113a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:50:17 user nova-compute[75014]: DEBUG nova.compute.manager [req-87249340-bb4b-4ea6-bc16-7eb684a3b838 req-e57b16d1-6b59-431e-b9ea-a76938ea8a30 service nova] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] No waiting events found dispatching network-vif-plugged-3f08242a-d68d-4744-8b4c-49bdc29ea557 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:50:17 user nova-compute[75014]: WARNING nova.compute.manager [req-87249340-bb4b-4ea6-bc16-7eb684a3b838 req-e57b16d1-6b59-431e-b9ea-a76938ea8a30 service nova] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Received unexpected event network-vif-plugged-3f08242a-d68d-4744-8b4c-49bdc29ea557 for instance with vm_state active and task_state None.
Nov 08 03:50:17 user nova-compute[75014]: DEBUG nova.compute.manager [req-87249340-bb4b-4ea6-bc16-7eb684a3b838 req-e57b16d1-6b59-431e-b9ea-a76938ea8a30 service nova] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Received event network-vif-plugged-3f08242a-d68d-4744-8b4c-49bdc29ea557 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:50:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-87249340-bb4b-4ea6-bc16-7eb684a3b838 req-e57b16d1-6b59-431e-b9ea-a76938ea8a30 service nova] Acquiring lock "5bfa6580-e0fe-46b0-b497-8db67806113a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:50:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-87249340-bb4b-4ea6-bc16-7eb684a3b838 req-e57b16d1-6b59-431e-b9ea-a76938ea8a30 service nova] Lock "5bfa6580-e0fe-46b0-b497-8db67806113a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:50:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-87249340-bb4b-4ea6-bc16-7eb684a3b838 req-e57b16d1-6b59-431e-b9ea-a76938ea8a30 service nova] Lock "5bfa6580-e0fe-46b0-b497-8db67806113a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:50:17 user nova-compute[75014]: DEBUG nova.compute.manager [req-87249340-bb4b-4ea6-bc16-7eb684a3b838 req-e57b16d1-6b59-431e-b9ea-a76938ea8a30 service nova] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] No waiting events found dispatching network-vif-plugged-3f08242a-d68d-4744-8b4c-49bdc29ea557 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:50:17 user nova-compute[75014]: WARNING nova.compute.manager [req-87249340-bb4b-4ea6-bc16-7eb684a3b838 req-e57b16d1-6b59-431e-b9ea-a76938ea8a30 service nova] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Received unexpected event network-vif-plugged-3f08242a-d68d-4744-8b4c-49bdc29ea557 for instance with vm_state active and task_state None.
Nov 08 03:50:17 user nova-compute[75014]: DEBUG nova.compute.manager [req-87249340-bb4b-4ea6-bc16-7eb684a3b838 req-e57b16d1-6b59-431e-b9ea-a76938ea8a30 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Received event network-vif-plugged-2dd443c9-89d2-4a7c-b2fe-e842507e24d7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:50:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-87249340-bb4b-4ea6-bc16-7eb684a3b838 req-e57b16d1-6b59-431e-b9ea-a76938ea8a30 service nova] Acquiring lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:50:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-87249340-bb4b-4ea6-bc16-7eb684a3b838 req-e57b16d1-6b59-431e-b9ea-a76938ea8a30 service nova] Lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:50:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-87249340-bb4b-4ea6-bc16-7eb684a3b838 req-e57b16d1-6b59-431e-b9ea-a76938ea8a30 service nova] Lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:50:17 user nova-compute[75014]: DEBUG nova.compute.manager [req-87249340-bb4b-4ea6-bc16-7eb684a3b838 req-e57b16d1-6b59-431e-b9ea-a76938ea8a30 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] No waiting events found dispatching network-vif-plugged-2dd443c9-89d2-4a7c-b2fe-e842507e24d7 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:50:17 user nova-compute[75014]: WARNING nova.compute.manager [req-87249340-bb4b-4ea6-bc16-7eb684a3b838 req-e57b16d1-6b59-431e-b9ea-a76938ea8a30 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Received unexpected event network-vif-plugged-2dd443c9-89d2-4a7c-b2fe-e842507e24d7 for instance with vm_state active and task_state None.
Nov 08 03:50:17 user nova-compute[75014]: DEBUG nova.compute.manager [req-87249340-bb4b-4ea6-bc16-7eb684a3b838 req-e57b16d1-6b59-431e-b9ea-a76938ea8a30 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Received event network-vif-plugged-2dd443c9-89d2-4a7c-b2fe-e842507e24d7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:50:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-87249340-bb4b-4ea6-bc16-7eb684a3b838 req-e57b16d1-6b59-431e-b9ea-a76938ea8a30 service nova] Acquiring lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:50:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-87249340-bb4b-4ea6-bc16-7eb684a3b838 req-e57b16d1-6b59-431e-b9ea-a76938ea8a30 service nova] Lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:50:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-87249340-bb4b-4ea6-bc16-7eb684a3b838 req-e57b16d1-6b59-431e-b9ea-a76938ea8a30 service nova] Lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:50:17 user nova-compute[75014]: DEBUG nova.compute.manager [req-87249340-bb4b-4ea6-bc16-7eb684a3b838 req-e57b16d1-6b59-431e-b9ea-a76938ea8a30 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] No waiting events found dispatching network-vif-plugged-2dd443c9-89d2-4a7c-b2fe-e842507e24d7 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:50:17 user nova-compute[75014]: WARNING nova.compute.manager [req-87249340-bb4b-4ea6-bc16-7eb684a3b838 req-e57b16d1-6b59-431e-b9ea-a76938ea8a30 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Received unexpected event network-vif-plugged-2dd443c9-89d2-4a7c-b2fe-e842507e24d7 for instance with vm_state active and task_state None.
Nov 08 03:50:17 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:50:17 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:50:18 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:50:18 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 03:50:18 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Rebuilding the list of instances to heal {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 03:50:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-9f205fe5-576f-4ef0-874b-1544c0307a7e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:50:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-9f205fe5-576f-4ef0-874b-1544c0307a7e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:50:18 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 03:50:18 user nova-compute[75014]: DEBUG nova.objects.instance [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lazy-loading 'info_cache' on Instance uuid 9f205fe5-576f-4ef0-874b-1544c0307a7e {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:50:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:19 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Updating instance_info_cache with network_info: [{"id": "4979eddc-54c6-46e4-987a-640c4ccade99", "address": "fa:16:3e:4c:b6:69", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4979eddc-54", "ovs_interfaceid": "4979eddc-54c6-46e4-987a-640c4ccade99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:50:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-9f205fe5-576f-4ef0-874b-1544c0307a7e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:50:19 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 03:50:19 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:50:20 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:50:20 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:50:20 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 03:50:21 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:21 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:50:21 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:50:21 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:50:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:50:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:50:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:50:21 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 03:50:21 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:50:21 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:50:21 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:50:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:50:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:50:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:50:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:50:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:50:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:50:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:50:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:50:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:50:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:50:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:50:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:50:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:50:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30cf3d8d-a9e0-4b67-b2df-fafaeb616e89/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:50:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30cf3d8d-a9e0-4b67-b2df-fafaeb616e89/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:50:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30cf3d8d-a9e0-4b67-b2df-fafaeb616e89/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:50:23 user nova-compute[75014]: DEBUG nova.compute.manager [req-fe2fe7b7-b51b-444f-99e2-82ac250f3f7b req-b563e60c-60c6-469e-a671-a6a45e203bd0 service nova] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Received event network-vif-plugged-9560a102-ba69-4b8d-a190-4c328fd75152 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:50:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-fe2fe7b7-b51b-444f-99e2-82ac250f3f7b req-b563e60c-60c6-469e-a671-a6a45e203bd0 service nova] Acquiring lock "2ab81192-8890-499c-ad4b-b93664da45fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:50:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-fe2fe7b7-b51b-444f-99e2-82ac250f3f7b req-b563e60c-60c6-469e-a671-a6a45e203bd0 service nova] Lock "2ab81192-8890-499c-ad4b-b93664da45fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:50:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-fe2fe7b7-b51b-444f-99e2-82ac250f3f7b req-b563e60c-60c6-469e-a671-a6a45e203bd0 service nova] Lock "2ab81192-8890-499c-ad4b-b93664da45fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:50:23 user nova-compute[75014]: DEBUG nova.compute.manager [req-fe2fe7b7-b51b-444f-99e2-82ac250f3f7b req-b563e60c-60c6-469e-a671-a6a45e203bd0 service nova] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] No waiting events found dispatching network-vif-plugged-9560a102-ba69-4b8d-a190-4c328fd75152 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:50:23 user nova-compute[75014]: WARNING nova.compute.manager [req-fe2fe7b7-b51b-444f-99e2-82ac250f3f7b req-b563e60c-60c6-469e-a671-a6a45e203bd0 service nova] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Received unexpected event network-vif-plugged-9560a102-ba69-4b8d-a190-4c328fd75152 for instance with vm_state active and task_state None.
Nov 08 03:50:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30cf3d8d-a9e0-4b67-b2df-fafaeb616e89/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:50:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:50:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:50:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:50:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:50:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:50:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:50:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:50:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:50:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:50:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:50:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:50:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:50:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f326d33-802d-4a4a-b2a2-a01b0fef36b4/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:50:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f326d33-802d-4a4a-b2a2-a01b0fef36b4/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:50:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f326d33-802d-4a4a-b2a2-a01b0fef36b4/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:50:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f326d33-802d-4a4a-b2a2-a01b0fef36b4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:50:25 user nova-compute[75014]: DEBUG nova.compute.manager [req-c124a0f8-5e04-4b32-a68f-a7b4946e0544 req-45717508-6e0a-4cdb-b897-283009fca7a5 service nova] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Received event network-vif-plugged-9560a102-ba69-4b8d-a190-4c328fd75152 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:50:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c124a0f8-5e04-4b32-a68f-a7b4946e0544 req-45717508-6e0a-4cdb-b897-283009fca7a5 service nova] Acquiring lock "2ab81192-8890-499c-ad4b-b93664da45fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:50:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c124a0f8-5e04-4b32-a68f-a7b4946e0544 req-45717508-6e0a-4cdb-b897-283009fca7a5 service nova] Lock "2ab81192-8890-499c-ad4b-b93664da45fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:50:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c124a0f8-5e04-4b32-a68f-a7b4946e0544 req-45717508-6e0a-4cdb-b897-283009fca7a5 service nova] Lock "2ab81192-8890-499c-ad4b-b93664da45fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:50:25 user nova-compute[75014]: DEBUG nova.compute.manager [req-c124a0f8-5e04-4b32-a68f-a7b4946e0544 req-45717508-6e0a-4cdb-b897-283009fca7a5 service nova] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] No waiting events found dispatching network-vif-plugged-9560a102-ba69-4b8d-a190-4c328fd75152 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:50:25 user nova-compute[75014]: WARNING nova.compute.manager [req-c124a0f8-5e04-4b32-a68f-a7b4946e0544 req-45717508-6e0a-4cdb-b897-283009fca7a5 service nova] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Received unexpected event network-vif-plugged-9560a102-ba69-4b8d-a190-4c328fd75152 for instance with vm_state active and task_state None.
Nov 08 03:50:25 user nova-compute[75014]: DEBUG nova.compute.manager [req-c124a0f8-5e04-4b32-a68f-a7b4946e0544 req-45717508-6e0a-4cdb-b897-283009fca7a5 service nova] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Received event network-vif-plugged-6a4fe909-e328-4b38-b695-6c555e1dd6d5 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:50:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c124a0f8-5e04-4b32-a68f-a7b4946e0544 req-45717508-6e0a-4cdb-b897-283009fca7a5 service nova] Acquiring lock "0f326d33-802d-4a4a-b2a2-a01b0fef36b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:50:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c124a0f8-5e04-4b32-a68f-a7b4946e0544 req-45717508-6e0a-4cdb-b897-283009fca7a5 service nova] Lock "0f326d33-802d-4a4a-b2a2-a01b0fef36b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:50:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c124a0f8-5e04-4b32-a68f-a7b4946e0544 req-45717508-6e0a-4cdb-b897-283009fca7a5 service nova] Lock "0f326d33-802d-4a4a-b2a2-a01b0fef36b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:50:25 user nova-compute[75014]: DEBUG nova.compute.manager [req-c124a0f8-5e04-4b32-a68f-a7b4946e0544 req-45717508-6e0a-4cdb-b897-283009fca7a5 service nova] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] No waiting events found dispatching network-vif-plugged-6a4fe909-e328-4b38-b695-6c555e1dd6d5 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:50:25 user nova-compute[75014]: WARNING nova.compute.manager [req-c124a0f8-5e04-4b32-a68f-a7b4946e0544 req-45717508-6e0a-4cdb-b897-283009fca7a5 service nova] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Received unexpected event network-vif-plugged-6a4fe909-e328-4b38-b695-6c555e1dd6d5 for instance with vm_state active and task_state None.
Nov 08 03:50:25 user nova-compute[75014]: DEBUG nova.compute.manager [req-c124a0f8-5e04-4b32-a68f-a7b4946e0544 req-45717508-6e0a-4cdb-b897-283009fca7a5 service nova] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Received event network-vif-plugged-6a4fe909-e328-4b38-b695-6c555e1dd6d5 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:50:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c124a0f8-5e04-4b32-a68f-a7b4946e0544 req-45717508-6e0a-4cdb-b897-283009fca7a5 service nova] Acquiring lock "0f326d33-802d-4a4a-b2a2-a01b0fef36b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:50:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c124a0f8-5e04-4b32-a68f-a7b4946e0544 req-45717508-6e0a-4cdb-b897-283009fca7a5 service nova] Lock "0f326d33-802d-4a4a-b2a2-a01b0fef36b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:50:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c124a0f8-5e04-4b32-a68f-a7b4946e0544 req-45717508-6e0a-4cdb-b897-283009fca7a5 service nova] Lock "0f326d33-802d-4a4a-b2a2-a01b0fef36b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:50:25 user nova-compute[75014]: DEBUG nova.compute.manager [req-c124a0f8-5e04-4b32-a68f-a7b4946e0544 req-45717508-6e0a-4cdb-b897-283009fca7a5 service nova] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] No waiting events found dispatching network-vif-plugged-6a4fe909-e328-4b38-b695-6c555e1dd6d5 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:50:25 user nova-compute[75014]: WARNING nova.compute.manager [req-c124a0f8-5e04-4b32-a68f-a7b4946e0544 req-45717508-6e0a-4cdb-b897-283009fca7a5 service nova] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Received unexpected event network-vif-plugged-6a4fe909-e328-4b38-b695-6c555e1dd6d5 for instance with vm_state active and task_state None.
Nov 08 03:50:25 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:50:25 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:50:25 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=7406MB free_disk=25.434402465820312GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 03:50:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:50:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:50:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:26 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9f205fe5-576f-4ef0-874b-1544c0307a7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:50:26 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 5bfa6580-e0fe-46b0-b497-8db67806113a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:50:26 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:50:26 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 8527ee40-fb8a-469b-9696-d7bde8cc96f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:50:26 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance f1d49f43-145b-4a9e-acbc-ca3759be49d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:50:26 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 8a8d9f3c-1150-4306-8dc6-eedde92c7a35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:50:26 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 7dd0e158-473f-4785-a5cf-a75b2da85b29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:50:26 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 2ab81192-8890-499c-ad4b-b93664da45fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:50:26 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 0f326d33-802d-4a4a-b2a2-a01b0fef36b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:50:26 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 03:50:26 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 03:50:26 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Refreshing inventories for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 03:50:26 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Updating ProviderTree inventory for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 03:50:26 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Updating inventory in ProviderTree for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 03:50:26 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Refreshing aggregate associations for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0, aggregates: None {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 03:50:26 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Refreshing trait associations for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 03:50:26 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:50:26 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:50:26 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 03:50:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.829s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:50:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:46 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:50:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 03:50:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 03:50:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 03:50:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:50:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:51:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 03:51:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 03:51:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 03:51:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:51:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:17 user nova-compute[75014]: INFO nova.compute.manager [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Rescuing
Nov 08 03:51:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "refresh_cache-8527ee40-fb8a-469b-9696-d7bde8cc96f7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:51:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquired lock "refresh_cache-8527ee40-fb8a-469b-9696-d7bde8cc96f7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:51:17 user nova-compute[75014]: DEBUG nova.network.neutron [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 03:51:17 user nova-compute[75014]: DEBUG nova.compute.manager [None req-b0a874c6-398d-4705-8ae7-039aa7b1660e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:51:17 user nova-compute[75014]: INFO nova.compute.manager [None req-b0a874c6-398d-4705-8ae7-039aa7b1660e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] instance snapshotting
Nov 08 03:51:17 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-b0a874c6-398d-4705-8ae7-039aa7b1660e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Beginning live snapshot process
Nov 08 03:51:17 user nova-compute[75014]: DEBUG nova.network.neutron [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Updating instance_info_cache with network_info: [{"id": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "address": "fa:16:3e:eb:34:b6", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa428a2cb-5b", "ovs_interfaceid": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:51:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Releasing lock "refresh_cache-8527ee40-fb8a-469b-9696-d7bde8cc96f7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:51:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b0a874c6-398d-4705-8ae7-039aa7b1660e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json -f qcow2 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b0a874c6-398d-4705-8ae7-039aa7b1660e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json -f qcow2" returned: 0 in 0.232s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b0a874c6-398d-4705-8ae7-039aa7b1660e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json -f qcow2 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:18 user nova-compute[75014]: DEBUG nova.compute.manager [req-116414f5-b969-4b38-8558-6c6190f47fe1 req-daf3d7c1-9df9-4bf8-9b46-a4804655d603 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Received event network-vif-unplugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:51:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-116414f5-b969-4b38-8558-6c6190f47fe1 req-daf3d7c1-9df9-4bf8-9b46-a4804655d603 service nova] Acquiring lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:51:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-116414f5-b969-4b38-8558-6c6190f47fe1 req-daf3d7c1-9df9-4bf8-9b46-a4804655d603 service nova] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:51:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-116414f5-b969-4b38-8558-6c6190f47fe1 req-daf3d7c1-9df9-4bf8-9b46-a4804655d603 service nova] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:51:18 user nova-compute[75014]: DEBUG nova.compute.manager [req-116414f5-b969-4b38-8558-6c6190f47fe1 req-daf3d7c1-9df9-4bf8-9b46-a4804655d603 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] No waiting events found dispatching network-vif-unplugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:51:18 user nova-compute[75014]: WARNING nova.compute.manager [req-116414f5-b969-4b38-8558-6c6190f47fe1 req-daf3d7c1-9df9-4bf8-9b46-a4804655d603 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Received unexpected event network-vif-unplugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 for instance with vm_state active and task_state rescuing.
Nov 08 03:51:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b0a874c6-398d-4705-8ae7-039aa7b1660e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b0a874c6-398d-4705-8ae7-039aa7b1660e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b0a874c6-398d-4705-8ae7-039aa7b1660e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.197s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b0a874c6-398d-4705-8ae7-039aa7b1660e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp901_kpb1/2ddf4da426a84e6fafb213da545418d9.delta 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b0a874c6-398d-4705-8ae7-039aa7b1660e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp901_kpb1/2ddf4da426a84e6fafb213da545418d9.delta 1073741824" returned: 0 in 0.054s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:18 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-b0a874c6-398d-4705-8ae7-039aa7b1660e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 03:51:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:18 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-b0a874c6-398d-4705-8ae7-039aa7b1660e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75014) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 08 03:51:18 user nova-compute[75014]: INFO nova.virt.libvirt.host [None req-b0a874c6-398d-4705-8ae7-039aa7b1660e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] UEFI support detected
Nov 08 03:51:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:19 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Instance destroyed successfully.
Nov 08 03:51:19 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Attempting rescue
Nov 08 03:51:19 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75014) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 03:51:19 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Instance directory exists: not creating {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 03:51:19 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Creating image(s)
Nov 08 03:51:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "/opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:51:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "/opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:51:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "/opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:51:19 user nova-compute[75014]: DEBUG nova.objects.instance [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8527ee40-fb8a-469b-9696-d7bde8cc96f7 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:51:19 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-b0a874c6-398d-4705-8ae7-039aa7b1660e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75014) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 03:51:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:51:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:51:19 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:19 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.170s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:19 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:19 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue" returned: 0 in 0.073s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:51:19 user nova-compute[75014]: DEBUG nova.objects.instance [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lazy-loading 'migration_context' on Instance uuid 8527ee40-fb8a-469b-9696-d7bde8cc96f7 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.objects.base [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Object Instance<8527ee40-fb8a-469b-9696-d7bde8cc96f7> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Start _get_guest_xml network_info=[{"id": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "address": "fa:16:3e:eb:34:b6", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "vif_mac": "fa:16:3e:eb:34:b6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa428a2cb-5b", "ovs_interfaceid": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '877f8699-2084-427a-babd-cf4f98c3b417', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.objects.instance [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lazy-loading 'resources' on Instance uuid 8527ee40-fb8a-469b-9696-d7bde8cc96f7 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.objects.base [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Object Instance<8527ee40-fb8a-469b-9696-d7bde8cc96f7> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.objects.instance [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lazy-loading 'numa_topology' on Instance uuid 8527ee40-fb8a-469b-9696-d7bde8cc96f7 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.objects.base [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Object Instance<8527ee40-fb8a-469b-9696-d7bde8cc96f7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 03:51:20 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:51:20 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.objects.instance [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8527ee40-fb8a-469b-9696-d7bde8cc96f7 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-b0a874c6-398d-4705-8ae7-039aa7b1660e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75014) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 03:51:20 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-b0a874c6-398d-4705-8ae7-039aa7b1660e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.objects.base [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Object Instance<8527ee40-fb8a-469b-9696-d7bde8cc96f7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:49:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1953351529',display_name='tempest-ServerRescueNegativeTestJSON-server-1953351529',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1953351529',id=4,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:49:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b48713cc3a8e4082b76fc0408088c607',ramdisk_id='',reservation_id='r-31tv27la',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1450625183',owner_user_name='tempest-ServerRescueNegativeTestJSON-1450625183-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:49:45Z,user_data=None,user_id='ffadb91b73464e559344658dd11bf60d',uuid=8527ee40-fb8a-469b-9696-d7bde8cc96f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "address": "fa:16:3e:eb:34:b6", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "vif_mac": "fa:16:3e:eb:34:b6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa428a2cb-5b", "ovs_interfaceid": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Converting VIF {"id": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "address": "fa:16:3e:eb:34:b6", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "vif_mac": "fa:16:3e:eb:34:b6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa428a2cb-5b", "ovs_interfaceid": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:34:b6,bridge_name='br-int',has_traffic_filtering=True,id=a428a2cb-5b9c-44fc-bc45-94488f6812b6,network=Network(982531ca-8a2f-41de-b62e-5b43b6a45a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa428a2cb-5b') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.objects.instance [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lazy-loading 'pci_devices' on Instance uuid 8527ee40-fb8a-469b-9696-d7bde8cc96f7 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.objects.base [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Object Instance<8527ee40-fb8a-469b-9696-d7bde8cc96f7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] End _get_guest_xml xml=<domain type="kvm">
Nov 08 03:51:20 user nova-compute[75014]:   <uuid>8527ee40-fb8a-469b-9696-d7bde8cc96f7</uuid>
Nov 08 03:51:20 user nova-compute[75014]:   <name>instance-00000004</name>
Nov 08 03:51:20 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 03:51:20 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 03:51:20 user nova-compute[75014]:   <metadata>
Nov 08 03:51:20 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 03:51:20 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 03:51:20 user nova-compute[75014]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1953351529</nova:name>
Nov 08 03:51:20 user nova-compute[75014]:       <nova:creationTime>2023-11-08 03:51:20</nova:creationTime>
Nov 08 03:51:20 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 03:51:20 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 03:51:20 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 03:51:20 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 03:51:20 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 03:51:20 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 03:51:20 user nova-compute[75014]:       </nova:flavor>
Nov 08 03:51:20 user nova-compute[75014]:       <nova:owner>
Nov 08 03:51:20 user nova-compute[75014]:         <nova:user uuid="ffadb91b73464e559344658dd11bf60d">tempest-ServerRescueNegativeTestJSON-1450625183-project-member</nova:user>
Nov 08 03:51:20 user nova-compute[75014]:         <nova:project uuid="b48713cc3a8e4082b76fc0408088c607">tempest-ServerRescueNegativeTestJSON-1450625183</nova:project>
Nov 08 03:51:20 user nova-compute[75014]:       </nova:owner>
Nov 08 03:51:20 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 03:51:20 user nova-compute[75014]:       <nova:ports>
Nov 08 03:51:20 user nova-compute[75014]:         <nova:port uuid="a428a2cb-5b9c-44fc-bc45-94488f6812b6">
Nov 08 03:51:20 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 03:51:20 user nova-compute[75014]:         </nova:port>
Nov 08 03:51:20 user nova-compute[75014]:       </nova:ports>
Nov 08 03:51:20 user nova-compute[75014]:     </nova:instance>
Nov 08 03:51:20 user nova-compute[75014]:   </metadata>
Nov 08 03:51:20 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 03:51:20 user nova-compute[75014]:     <system>
Nov 08 03:51:20 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 03:51:20 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 03:51:20 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 03:51:20 user nova-compute[75014]:       <entry name="serial">8527ee40-fb8a-469b-9696-d7bde8cc96f7</entry>
Nov 08 03:51:20 user nova-compute[75014]:       <entry name="uuid">8527ee40-fb8a-469b-9696-d7bde8cc96f7</entry>
Nov 08 03:51:20 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 03:51:20 user nova-compute[75014]:     </system>
Nov 08 03:51:20 user nova-compute[75014]:   </sysinfo>
Nov 08 03:51:20 user nova-compute[75014]:   <os>
Nov 08 03:51:20 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 03:51:20 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 03:51:20 user nova-compute[75014]:   </os>
Nov 08 03:51:20 user nova-compute[75014]:   <features>
Nov 08 03:51:20 user nova-compute[75014]:     <acpi/>
Nov 08 03:51:20 user nova-compute[75014]:     <apic/>
Nov 08 03:51:20 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 03:51:20 user nova-compute[75014]:   </features>
Nov 08 03:51:20 user nova-compute[75014]:   <clock offset="utc">
Nov 08 03:51:20 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 03:51:20 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 03:51:20 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 03:51:20 user nova-compute[75014]:   </clock>
Nov 08 03:51:20 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 03:51:20 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 03:51:20 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 03:51:20 user nova-compute[75014]:   </cpu>
Nov 08 03:51:20 user nova-compute[75014]:   <devices>
Nov 08 03:51:20 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 03:51:20 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 03:51:20 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue"/>
Nov 08 03:51:20 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 03:51:20 user nova-compute[75014]:     </disk>
Nov 08 03:51:20 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 03:51:20 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 03:51:20 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk"/>
Nov 08 03:51:20 user nova-compute[75014]:       <target dev="vdb" bus="virtio"/>
Nov 08 03:51:20 user nova-compute[75014]:     </disk>
Nov 08 03:51:20 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:51:20 user nova-compute[75014]:       <mac address="fa:16:3e:eb:34:b6"/>
Nov 08 03:51:20 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:51:20 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:51:20 user nova-compute[75014]:       <target dev="tapa428a2cb-5b"/>
Nov 08 03:51:20 user nova-compute[75014]:     </interface>
Nov 08 03:51:20 user nova-compute[75014]:     <serial type="pty">
Nov 08 03:51:20 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/console.log" append="off"/>
Nov 08 03:51:20 user nova-compute[75014]:     </serial>
Nov 08 03:51:20 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 03:51:20 user nova-compute[75014]:     <video>
Nov 08 03:51:20 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:51:20 user nova-compute[75014]:     </video>
Nov 08 03:51:20 user nova-compute[75014]:     <rng model="virtio">
Nov 08 03:51:20 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 03:51:20 user nova-compute[75014]:     </rng>
Nov 08 03:51:20 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 03:51:20 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 03:51:20 user nova-compute[75014]:       <stats period="10"/>
Nov 08 03:51:20 user nova-compute[75014]:     </memballoon>
Nov 08 03:51:20 user nova-compute[75014]:   </devices>
Nov 08 03:51:20 user nova-compute[75014]: </domain>
Nov 08 03:51:20 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 03:51:20 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Instance destroyed successfully.
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.privsep.utils [None req-b0a874c6-398d-4705-8ae7-039aa7b1660e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75014) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b0a874c6-398d-4705-8ae7-039aa7b1660e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp901_kpb1/2ddf4da426a84e6fafb213da545418d9.delta /opt/stack/data/nova/instances/snapshots/tmp901_kpb1/2ddf4da426a84e6fafb213da545418d9 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] No VIF found with MAC fa:16:3e:eb:34:b6, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-dbd30f5f-2bda-43e4-b88d-b937b0efa7a5 req-7cbcd49a-c6c9-4286-917a-b80cc33a8ec2 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Received event network-vif-plugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dbd30f5f-2bda-43e4-b88d-b937b0efa7a5 req-7cbcd49a-c6c9-4286-917a-b80cc33a8ec2 service nova] Acquiring lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dbd30f5f-2bda-43e4-b88d-b937b0efa7a5 req-7cbcd49a-c6c9-4286-917a-b80cc33a8ec2 service nova] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dbd30f5f-2bda-43e4-b88d-b937b0efa7a5 req-7cbcd49a-c6c9-4286-917a-b80cc33a8ec2 service nova] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-dbd30f5f-2bda-43e4-b88d-b937b0efa7a5 req-7cbcd49a-c6c9-4286-917a-b80cc33a8ec2 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] No waiting events found dispatching network-vif-plugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:51:20 user nova-compute[75014]: WARNING nova.compute.manager [req-dbd30f5f-2bda-43e4-b88d-b937b0efa7a5 req-7cbcd49a-c6c9-4286-917a-b80cc33a8ec2 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Received unexpected event network-vif-plugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 for instance with vm_state active and task_state rescuing.
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-dbd30f5f-2bda-43e4-b88d-b937b0efa7a5 req-7cbcd49a-c6c9-4286-917a-b80cc33a8ec2 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Received event network-vif-plugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dbd30f5f-2bda-43e4-b88d-b937b0efa7a5 req-7cbcd49a-c6c9-4286-917a-b80cc33a8ec2 service nova] Acquiring lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dbd30f5f-2bda-43e4-b88d-b937b0efa7a5 req-7cbcd49a-c6c9-4286-917a-b80cc33a8ec2 service nova] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dbd30f5f-2bda-43e4-b88d-b937b0efa7a5 req-7cbcd49a-c6c9-4286-917a-b80cc33a8ec2 service nova] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-dbd30f5f-2bda-43e4-b88d-b937b0efa7a5 req-7cbcd49a-c6c9-4286-917a-b80cc33a8ec2 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] No waiting events found dispatching network-vif-plugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:51:20 user nova-compute[75014]: WARNING nova.compute.manager [req-dbd30f5f-2bda-43e4-b88d-b937b0efa7a5 req-7cbcd49a-c6c9-4286-917a-b80cc33a8ec2 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Received unexpected event network-vif-plugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 for instance with vm_state active and task_state rescuing.
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-dbd30f5f-2bda-43e4-b88d-b937b0efa7a5 req-7cbcd49a-c6c9-4286-917a-b80cc33a8ec2 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Received event network-vif-plugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dbd30f5f-2bda-43e4-b88d-b937b0efa7a5 req-7cbcd49a-c6c9-4286-917a-b80cc33a8ec2 service nova] Acquiring lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dbd30f5f-2bda-43e4-b88d-b937b0efa7a5 req-7cbcd49a-c6c9-4286-917a-b80cc33a8ec2 service nova] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dbd30f5f-2bda-43e4-b88d-b937b0efa7a5 req-7cbcd49a-c6c9-4286-917a-b80cc33a8ec2 service nova] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-dbd30f5f-2bda-43e4-b88d-b937b0efa7a5 req-7cbcd49a-c6c9-4286-917a-b80cc33a8ec2 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] No waiting events found dispatching network-vif-plugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:51:20 user nova-compute[75014]: WARNING nova.compute.manager [req-dbd30f5f-2bda-43e4-b88d-b937b0efa7a5 req-7cbcd49a-c6c9-4286-917a-b80cc33a8ec2 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Received unexpected event network-vif-plugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 for instance with vm_state active and task_state rescuing.
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-dbd30f5f-2bda-43e4-b88d-b937b0efa7a5 req-7cbcd49a-c6c9-4286-917a-b80cc33a8ec2 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Received event network-vif-unplugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dbd30f5f-2bda-43e4-b88d-b937b0efa7a5 req-7cbcd49a-c6c9-4286-917a-b80cc33a8ec2 service nova] Acquiring lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dbd30f5f-2bda-43e4-b88d-b937b0efa7a5 req-7cbcd49a-c6c9-4286-917a-b80cc33a8ec2 service nova] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dbd30f5f-2bda-43e4-b88d-b937b0efa7a5 req-7cbcd49a-c6c9-4286-917a-b80cc33a8ec2 service nova] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:51:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-dbd30f5f-2bda-43e4-b88d-b937b0efa7a5 req-7cbcd49a-c6c9-4286-917a-b80cc33a8ec2 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] No waiting events found dispatching network-vif-unplugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:51:20 user nova-compute[75014]: WARNING nova.compute.manager [req-dbd30f5f-2bda-43e4-b88d-b937b0efa7a5 req-7cbcd49a-c6c9-4286-917a-b80cc33a8ec2 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Received unexpected event network-vif-unplugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 for instance with vm_state active and task_state rescuing.
Nov 08 03:51:20 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b0a874c6-398d-4705-8ae7-039aa7b1660e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp901_kpb1/2ddf4da426a84e6fafb213da545418d9.delta /opt/stack/data/nova/instances/snapshots/tmp901_kpb1/2ddf4da426a84e6fafb213da545418d9" returned: 0 in 0.698s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:21 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-b0a874c6-398d-4705-8ae7-039aa7b1660e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Snapshot extracted, beginning image upload
Nov 08 03:51:21 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:21 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:21 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:21 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:22 user nova-compute[75014]: DEBUG nova.compute.manager [req-fbe21421-8e0e-4782-987a-e78b614ed627 req-a19c1a24-58bd-497e-ad7e-7420728195b1 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Received event network-vif-plugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:51:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-fbe21421-8e0e-4782-987a-e78b614ed627 req-a19c1a24-58bd-497e-ad7e-7420728195b1 service nova] Acquiring lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:51:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-fbe21421-8e0e-4782-987a-e78b614ed627 req-a19c1a24-58bd-497e-ad7e-7420728195b1 service nova] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:51:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-fbe21421-8e0e-4782-987a-e78b614ed627 req-a19c1a24-58bd-497e-ad7e-7420728195b1 service nova] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:51:22 user nova-compute[75014]: DEBUG nova.compute.manager [req-fbe21421-8e0e-4782-987a-e78b614ed627 req-a19c1a24-58bd-497e-ad7e-7420728195b1 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] No waiting events found dispatching network-vif-plugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:51:22 user nova-compute[75014]: WARNING nova.compute.manager [req-fbe21421-8e0e-4782-987a-e78b614ed627 req-a19c1a24-58bd-497e-ad7e-7420728195b1 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Received unexpected event network-vif-plugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 for instance with vm_state active and task_state rescuing.
Nov 08 03:51:22 user nova-compute[75014]: DEBUG nova.compute.manager [req-fbe21421-8e0e-4782-987a-e78b614ed627 req-a19c1a24-58bd-497e-ad7e-7420728195b1 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Received event network-vif-plugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:51:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-fbe21421-8e0e-4782-987a-e78b614ed627 req-a19c1a24-58bd-497e-ad7e-7420728195b1 service nova] Acquiring lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:51:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-fbe21421-8e0e-4782-987a-e78b614ed627 req-a19c1a24-58bd-497e-ad7e-7420728195b1 service nova] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:51:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-fbe21421-8e0e-4782-987a-e78b614ed627 req-a19c1a24-58bd-497e-ad7e-7420728195b1 service nova] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:51:22 user nova-compute[75014]: DEBUG nova.compute.manager [req-fbe21421-8e0e-4782-987a-e78b614ed627 req-a19c1a24-58bd-497e-ad7e-7420728195b1 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] No waiting events found dispatching network-vif-plugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:51:22 user nova-compute[75014]: WARNING nova.compute.manager [req-fbe21421-8e0e-4782-987a-e78b614ed627 req-a19c1a24-58bd-497e-ad7e-7420728195b1 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Received unexpected event network-vif-plugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 for instance with vm_state active and task_state rescuing.
Nov 08 03:51:22 user nova-compute[75014]: DEBUG nova.compute.manager [req-fbe21421-8e0e-4782-987a-e78b614ed627 req-a19c1a24-58bd-497e-ad7e-7420728195b1 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Received event network-vif-plugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:51:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-fbe21421-8e0e-4782-987a-e78b614ed627 req-a19c1a24-58bd-497e-ad7e-7420728195b1 service nova] Acquiring lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:51:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-fbe21421-8e0e-4782-987a-e78b614ed627 req-a19c1a24-58bd-497e-ad7e-7420728195b1 service nova] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:51:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-fbe21421-8e0e-4782-987a-e78b614ed627 req-a19c1a24-58bd-497e-ad7e-7420728195b1 service nova] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:51:22 user nova-compute[75014]: DEBUG nova.compute.manager [req-fbe21421-8e0e-4782-987a-e78b614ed627 req-a19c1a24-58bd-497e-ad7e-7420728195b1 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] No waiting events found dispatching network-vif-plugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:51:22 user nova-compute[75014]: WARNING nova.compute.manager [req-fbe21421-8e0e-4782-987a-e78b614ed627 req-a19c1a24-58bd-497e-ad7e-7420728195b1 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Received unexpected event network-vif-plugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 for instance with vm_state active and task_state rescuing.
Nov 08 03:51:22 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:51:22 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:51:22 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:51:22 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 03:51:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-5bfa6580-e0fe-46b0-b497-8db67806113a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:51:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-5bfa6580-e0fe-46b0-b497-8db67806113a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:51:22 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 03:51:23 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Updating instance_info_cache with network_info: [{"id": "3f08242a-d68d-4744-8b4c-49bdc29ea557", "address": "fa:16:3e:65:f5:c2", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f08242a-d6", "ovs_interfaceid": "3f08242a-d68d-4744-8b4c-49bdc29ea557", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:51:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-5bfa6580-e0fe-46b0-b497-8db67806113a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:51:23 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 03:51:23 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:51:23 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:51:23 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:51:23 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:51:23 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:51:23 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:51:23 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 03:51:23 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:51:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:51:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:51:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:51:23 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 03:51:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Acquiring lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:51:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:51:23 user nova-compute[75014]: DEBUG nova.compute.manager [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 03:51:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:51:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:51:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Acquiring lock "30cf3d8d-a9e0-4b67-b2df-fafaeb616e89" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:51:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Lock "30cf3d8d-a9e0-4b67-b2df-fafaeb616e89" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:51:23 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 03:51:23 user nova-compute[75014]: INFO nova.compute.claims [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Claim successful on node user
Nov 08 03:51:23 user nova-compute[75014]: DEBUG nova.objects.instance [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Lazy-loading 'flavor' on Instance uuid 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:51:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Lock "30cf3d8d-a9e0-4b67-b2df-fafaeb616e89" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.161s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:51:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:23 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-b0a874c6-398d-4705-8ae7-039aa7b1660e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Snapshot image upload complete
Nov 08 03:51:23 user nova-compute[75014]: INFO nova.compute.manager [None req-b0a874c6-398d-4705-8ae7-039aa7b1660e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Took 6.18 seconds to snapshot the instance on the hypervisor.
Nov 08 03:51:24 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Acquiring lock "30cf3d8d-a9e0-4b67-b2df-fafaeb616e89" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:51:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Lock "30cf3d8d-a9e0-4b67-b2df-fafaeb616e89" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:51:24 user nova-compute[75014]: INFO nova.compute.manager [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Attaching volume c6106b11-5f08-4f3b-867b-081da414cda3 to /dev/vdb
Nov 08 03:51:24 user nova-compute[75014]: DEBUG os_brick.utils [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:51:24 user nova-compute[75014]: INFO oslo.privsep.daemon [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpdm6mscre/privsep.sock']
Nov 08 03:51:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:24 user sudo[86514]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpdm6mscre/privsep.sock
Nov 08 03:51:24 user sudo[86514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 08 03:51:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:24 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:51:24 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:51:24 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7f385611-e753-4792-b6ba-c085c231ae7b tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:51:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.743s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:51:24 user nova-compute[75014]: DEBUG nova.compute.manager [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 03:51:24 user nova-compute[75014]: DEBUG nova.compute.manager [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 03:51:24 user nova-compute[75014]: DEBUG nova.network.neutron [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 03:51:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:24 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 03:51:24 user nova-compute[75014]: DEBUG nova.compute.manager [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 03:51:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:24 user nova-compute[75014]: INFO nova.virt.block_device [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Booting with volume 2582dcd2-17c6-4521-b955-cafb600221ad at /dev/vda
Nov 08 03:51:24 user nova-compute[75014]: DEBUG nova.policy [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7a5ed8cff034542baf6697046f9c851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd6fce809fab44789c36f2981972b5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 03:51:24 user nova-compute[75014]: DEBUG os_brick.utils [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:51:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:25 user nova-compute[75014]: DEBUG nova.compute.manager [req-eb28d6bb-5cf1-4e01-9437-3689ef94c8fb req-37a8b315-818a-4562-8608-9538b5b70aa4 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Received event network-changed-2dd443c9-89d2-4a7c-b2fe-e842507e24d7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:51:25 user nova-compute[75014]: DEBUG nova.compute.manager [req-eb28d6bb-5cf1-4e01-9437-3689ef94c8fb req-37a8b315-818a-4562-8608-9538b5b70aa4 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Refreshing instance network info cache due to event network-changed-2dd443c9-89d2-4a7c-b2fe-e842507e24d7. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:51:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-eb28d6bb-5cf1-4e01-9437-3689ef94c8fb req-37a8b315-818a-4562-8608-9538b5b70aa4 service nova] Acquiring lock "refresh_cache-f1d49f43-145b-4a9e-acbc-ca3759be49d5" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:51:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-eb28d6bb-5cf1-4e01-9437-3689ef94c8fb req-37a8b315-818a-4562-8608-9538b5b70aa4 service nova] Acquired lock "refresh_cache-f1d49f43-145b-4a9e-acbc-ca3759be49d5" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:51:25 user nova-compute[75014]: DEBUG nova.network.neutron [req-eb28d6bb-5cf1-4e01-9437-3689ef94c8fb req-37a8b315-818a-4562-8608-9538b5b70aa4 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Refreshing network info cache for port 2dd443c9-89d2-4a7c-b2fe-e842507e24d7 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:51:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30cf3d8d-a9e0-4b67-b2df-fafaeb616e89/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30cf3d8d-a9e0-4b67-b2df-fafaeb616e89/disk --force-share --output=json" returned: 0 in 0.312s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30cf3d8d-a9e0-4b67-b2df-fafaeb616e89/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30cf3d8d-a9e0-4b67-b2df-fafaeb616e89/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG nova.network.neutron [req-eb28d6bb-5cf1-4e01-9437-3689ef94c8fb req-37a8b315-818a-4562-8608-9538b5b70aa4 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Updated VIF entry in instance network info cache for port 2dd443c9-89d2-4a7c-b2fe-e842507e24d7. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG nova.network.neutron [req-eb28d6bb-5cf1-4e01-9437-3689ef94c8fb req-37a8b315-818a-4562-8608-9538b5b70aa4 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Updating instance_info_cache with network_info: [{"id": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "address": "fa:16:3e:32:e2:a4", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd443c9-89", "ovs_interfaceid": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-eb28d6bb-5cf1-4e01-9437-3689ef94c8fb req-37a8b315-818a-4562-8608-9538b5b70aa4 service nova] Releasing lock "refresh_cache-f1d49f43-145b-4a9e-acbc-ca3759be49d5" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:26 user sudo[86514]: pam_unix(sudo:session): session closed for user root
Nov 08 03:51:26 user nova-compute[75014]: DEBUG nova.network.neutron [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Successfully created port: 22b161cc-78f9-43ab-a91f-bdda3cb031fe {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 03:51:26 user nova-compute[75014]: INFO oslo.privsep.daemon [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Spawned new privsep daemon via rootwrap
Nov 08 03:51:26 user nova-compute[75014]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 08 03:51:26 user nova-compute[75014]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 08 03:51:26 user nova-compute[75014]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 08 03:51:26 user nova-compute[75014]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86544
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[08035dab-94de-4f5d-b3bd-53027d5a82eb]: (2,) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:51:26 user nova-compute[75014]: WARNING oslo_privsep.priv_context [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] privsep daemon already running
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef83fa5-1902-45f1-a5bf-fca6da207519]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:51:26 user nova-compute[75014]: WARNING os_brick.initiator.connectors.nvmeof [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cadded-e415-42b9-934c-bd6de722f0d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.029s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dfbda0-aafb-4eac-9775-097a78b50946]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[900ccfe2-b44e-4230-ba42-6f1f85d61e64]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7c368a-702a-4d56-8288-b8f40e352c4d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4eab81-b6c1-432f-8293-84660649ed2d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d142452-13cb-4776-8f9c-bc5cfb813096]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5cd503-ae4f-4f5a-bd24-62675c96f465]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 03:51:26 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[988d5277-16f7-46e3-8fce-66fcbe9b1a80]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG os_brick.utils [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] <== get_connector_properties: return (2474ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Updating existing volume attachment record: 90e2344f-e272-446a-b462-16df8a3a4238 {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 03:51:26 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9daf2e0e-f215-4cde-b3be-acc0cf1203b4]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG os_brick.utils [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] <== get_connector_properties: return (1863ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Updating existing volume attachment record: 8f26c943-999a-40d5-a04d-56aa30461de0 {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json" returned: 0 in 0.260s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:27 user nova-compute[75014]: DEBUG nova.network.neutron [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Successfully created port: 1bf169f7-c039-4b88-a7de-3da18a368b14 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 03:51:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:27 user nova-compute[75014]: DEBUG nova.network.neutron [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Successfully created port: ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 03:51:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f326d33-802d-4a4a-b2a2-a01b0fef36b4/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f326d33-802d-4a4a-b2a2-a01b0fef36b4/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f326d33-802d-4a4a-b2a2-a01b0fef36b4/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f326d33-802d-4a4a-b2a2-a01b0fef36b4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:28 user nova-compute[75014]: DEBUG nova.network.neutron [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Successfully created port: 3e63c197-4437-4b03-82c9-a570406f7d38 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 03:51:28 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:51:28 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:51:28 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=7432MB free_disk=25.32125473022461GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 03:51:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:51:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:51:29 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9f205fe5-576f-4ef0-874b-1544c0307a7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:51:29 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 5bfa6580-e0fe-46b0-b497-8db67806113a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:51:29 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:51:29 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 8527ee40-fb8a-469b-9696-d7bde8cc96f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:51:29 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance f1d49f43-145b-4a9e-acbc-ca3759be49d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:51:29 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 8a8d9f3c-1150-4306-8dc6-eedde92c7a35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:51:29 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 7dd0e158-473f-4785-a5cf-a75b2da85b29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:51:29 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 2ab81192-8890-499c-ad4b-b93664da45fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:51:29 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 0f326d33-802d-4a4a-b2a2-a01b0fef36b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:51:29 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance e8eb4171-aa3d-48bd-90e1-dc371da7a77b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:51:29 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 03:51:29 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 03:51:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:29 user nova-compute[75014]: DEBUG nova.network.neutron [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Successfully created port: ef47ac6e-fbd7-47f6-bb62-1d2e1d155179 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 03:51:29 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:51:29 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:51:29 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 03:51:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.668s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:51:30 user nova-compute[75014]: DEBUG nova.network.neutron [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Successfully updated port: 22b161cc-78f9-43ab-a91f-bdda3cb031fe {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 03:51:30 user nova-compute[75014]: DEBUG nova.compute.manager [req-5747a426-83f2-4410-8521-4f66d3e3c388 req-a60d6390-e890-40aa-b195-0471db2f0cf9 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-changed-22b161cc-78f9-43ab-a91f-bdda3cb031fe {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:51:30 user nova-compute[75014]: DEBUG nova.compute.manager [req-5747a426-83f2-4410-8521-4f66d3e3c388 req-a60d6390-e890-40aa-b195-0471db2f0cf9 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Refreshing instance network info cache due to event network-changed-22b161cc-78f9-43ab-a91f-bdda3cb031fe. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:51:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5747a426-83f2-4410-8521-4f66d3e3c388 req-a60d6390-e890-40aa-b195-0471db2f0cf9 service nova] Acquiring lock "refresh_cache-e8eb4171-aa3d-48bd-90e1-dc371da7a77b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:51:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5747a426-83f2-4410-8521-4f66d3e3c388 req-a60d6390-e890-40aa-b195-0471db2f0cf9 service nova] Acquired lock "refresh_cache-e8eb4171-aa3d-48bd-90e1-dc371da7a77b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:51:30 user nova-compute[75014]: DEBUG nova.network.neutron [req-5747a426-83f2-4410-8521-4f66d3e3c388 req-a60d6390-e890-40aa-b195-0471db2f0cf9 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Refreshing network info cache for port 22b161cc-78f9-43ab-a91f-bdda3cb031fe {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:51:30 user nova-compute[75014]: DEBUG nova.network.neutron [req-5747a426-83f2-4410-8521-4f66d3e3c388 req-a60d6390-e890-40aa-b195-0471db2f0cf9 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 03:51:31 user nova-compute[75014]: DEBUG nova.network.neutron [req-5747a426-83f2-4410-8521-4f66d3e3c388 req-a60d6390-e890-40aa-b195-0471db2f0cf9 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:51:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5747a426-83f2-4410-8521-4f66d3e3c388 req-a60d6390-e890-40aa-b195-0471db2f0cf9 service nova] Releasing lock "refresh_cache-e8eb4171-aa3d-48bd-90e1-dc371da7a77b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:51:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:31 user nova-compute[75014]: DEBUG nova.network.neutron [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Successfully updated port: 865f50bd-f6c7-45d9-8fd9-807910ccd477 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 03:51:32 user nova-compute[75014]: DEBUG nova.network.neutron [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Successfully updated port: b8ea5c8c-9b61-42be-bea3-0773a45eddcc {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 03:51:32 user nova-compute[75014]: DEBUG nova.compute.manager [req-502d5b6a-4301-42af-9970-6c77a2a25fe8 req-e312a3ac-0298-41c8-ab6d-a5e332b65056 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-changed-865f50bd-f6c7-45d9-8fd9-807910ccd477 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:51:32 user nova-compute[75014]: DEBUG nova.compute.manager [req-502d5b6a-4301-42af-9970-6c77a2a25fe8 req-e312a3ac-0298-41c8-ab6d-a5e332b65056 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Refreshing instance network info cache due to event network-changed-865f50bd-f6c7-45d9-8fd9-807910ccd477. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:51:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-502d5b6a-4301-42af-9970-6c77a2a25fe8 req-e312a3ac-0298-41c8-ab6d-a5e332b65056 service nova] Acquiring lock "refresh_cache-e8eb4171-aa3d-48bd-90e1-dc371da7a77b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:51:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-502d5b6a-4301-42af-9970-6c77a2a25fe8 req-e312a3ac-0298-41c8-ab6d-a5e332b65056 service nova] Acquired lock "refresh_cache-e8eb4171-aa3d-48bd-90e1-dc371da7a77b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:51:32 user nova-compute[75014]: DEBUG nova.network.neutron [req-502d5b6a-4301-42af-9970-6c77a2a25fe8 req-e312a3ac-0298-41c8-ab6d-a5e332b65056 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Refreshing network info cache for port 865f50bd-f6c7-45d9-8fd9-807910ccd477 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:51:32 user nova-compute[75014]: DEBUG nova.compute.manager [req-f9c8154b-cdcf-4fd2-ab8b-897bb3a4ea30 req-0137707f-bb8c-466e-ba02-2a0a0ef75945 service nova] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Received event network-changed-12d06985-404f-4ffb-98b2-4967d82e45ca {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:51:32 user nova-compute[75014]: DEBUG nova.compute.manager [req-f9c8154b-cdcf-4fd2-ab8b-897bb3a4ea30 req-0137707f-bb8c-466e-ba02-2a0a0ef75945 service nova] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Refreshing instance network info cache due to event network-changed-12d06985-404f-4ffb-98b2-4967d82e45ca. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:51:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f9c8154b-cdcf-4fd2-ab8b-897bb3a4ea30 req-0137707f-bb8c-466e-ba02-2a0a0ef75945 service nova] Acquiring lock "refresh_cache-8a8d9f3c-1150-4306-8dc6-eedde92c7a35" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:51:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f9c8154b-cdcf-4fd2-ab8b-897bb3a4ea30 req-0137707f-bb8c-466e-ba02-2a0a0ef75945 service nova] Acquired lock "refresh_cache-8a8d9f3c-1150-4306-8dc6-eedde92c7a35" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:51:32 user nova-compute[75014]: DEBUG nova.network.neutron [req-f9c8154b-cdcf-4fd2-ab8b-897bb3a4ea30 req-0137707f-bb8c-466e-ba02-2a0a0ef75945 service nova] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Refreshing network info cache for port 12d06985-404f-4ffb-98b2-4967d82e45ca {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:51:32 user nova-compute[75014]: DEBUG nova.network.neutron [req-502d5b6a-4301-42af-9970-6c77a2a25fe8 req-e312a3ac-0298-41c8-ab6d-a5e332b65056 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 03:51:32 user nova-compute[75014]: DEBUG nova.network.neutron [req-502d5b6a-4301-42af-9970-6c77a2a25fe8 req-e312a3ac-0298-41c8-ab6d-a5e332b65056 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:51:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-502d5b6a-4301-42af-9970-6c77a2a25fe8 req-e312a3ac-0298-41c8-ab6d-a5e332b65056 service nova] Releasing lock "refresh_cache-e8eb4171-aa3d-48bd-90e1-dc371da7a77b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:51:33 user nova-compute[75014]: DEBUG nova.network.neutron [req-f9c8154b-cdcf-4fd2-ab8b-897bb3a4ea30 req-0137707f-bb8c-466e-ba02-2a0a0ef75945 service nova] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Updated VIF entry in instance network info cache for port 12d06985-404f-4ffb-98b2-4967d82e45ca. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:51:33 user nova-compute[75014]: DEBUG nova.network.neutron [req-f9c8154b-cdcf-4fd2-ab8b-897bb3a4ea30 req-0137707f-bb8c-466e-ba02-2a0a0ef75945 service nova] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Updating instance_info_cache with network_info: [{"id": "12d06985-404f-4ffb-98b2-4967d82e45ca", "address": "fa:16:3e:c3:48:cb", "network": {"id": "ad32e55b-9579-41dd-b98f-e962ac63433a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1118133511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73af3d7f9cbd46c6b08449dde0ef83cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d06985-40", "ovs_interfaceid": "12d06985-404f-4ffb-98b2-4967d82e45ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:51:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f9c8154b-cdcf-4fd2-ab8b-897bb3a4ea30 req-0137707f-bb8c-466e-ba02-2a0a0ef75945 service nova] Releasing lock "refresh_cache-8a8d9f3c-1150-4306-8dc6-eedde92c7a35" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:51:33 user nova-compute[75014]: DEBUG nova.network.neutron [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Successfully updated port: 1bf169f7-c039-4b88-a7de-3da18a368b14 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 03:51:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:51:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:51:33 user nova-compute[75014]: INFO nova.compute.manager [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Shelving
Nov 08 03:51:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:34 user nova-compute[75014]: DEBUG nova.network.neutron [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Successfully updated port: ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 03:51:34 user nova-compute[75014]: DEBUG nova.compute.manager [req-3225a0e7-e927-4b66-9dba-4e92543ab0f1 req-434762ed-8d5e-4897-8b4f-4c5f564d3e47 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Received event network-vif-unplugged-2dd443c9-89d2-4a7c-b2fe-e842507e24d7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:51:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3225a0e7-e927-4b66-9dba-4e92543ab0f1 req-434762ed-8d5e-4897-8b4f-4c5f564d3e47 service nova] Acquiring lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:51:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3225a0e7-e927-4b66-9dba-4e92543ab0f1 req-434762ed-8d5e-4897-8b4f-4c5f564d3e47 service nova] Lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:51:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3225a0e7-e927-4b66-9dba-4e92543ab0f1 req-434762ed-8d5e-4897-8b4f-4c5f564d3e47 service nova] Lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:51:34 user nova-compute[75014]: DEBUG nova.compute.manager [req-3225a0e7-e927-4b66-9dba-4e92543ab0f1 req-434762ed-8d5e-4897-8b4f-4c5f564d3e47 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] No waiting events found dispatching network-vif-unplugged-2dd443c9-89d2-4a7c-b2fe-e842507e24d7 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:51:34 user nova-compute[75014]: WARNING nova.compute.manager [req-3225a0e7-e927-4b66-9dba-4e92543ab0f1 req-434762ed-8d5e-4897-8b4f-4c5f564d3e47 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Received unexpected event network-vif-unplugged-2dd443c9-89d2-4a7c-b2fe-e842507e24d7 for instance with vm_state active and task_state shelving.
Nov 08 03:51:34 user nova-compute[75014]: DEBUG nova.compute.manager [req-f151a67b-314b-4078-afa0-bfc254868c38 req-ef5bd64c-3cea-4069-885c-a1527555e33f service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-changed-b8ea5c8c-9b61-42be-bea3-0773a45eddcc {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:51:34 user nova-compute[75014]: DEBUG nova.compute.manager [req-f151a67b-314b-4078-afa0-bfc254868c38 req-ef5bd64c-3cea-4069-885c-a1527555e33f service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Refreshing instance network info cache due to event network-changed-b8ea5c8c-9b61-42be-bea3-0773a45eddcc. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:51:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f151a67b-314b-4078-afa0-bfc254868c38 req-ef5bd64c-3cea-4069-885c-a1527555e33f service nova] Acquiring lock "refresh_cache-e8eb4171-aa3d-48bd-90e1-dc371da7a77b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:51:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f151a67b-314b-4078-afa0-bfc254868c38 req-ef5bd64c-3cea-4069-885c-a1527555e33f service nova] Acquired lock "refresh_cache-e8eb4171-aa3d-48bd-90e1-dc371da7a77b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:51:34 user nova-compute[75014]: DEBUG nova.network.neutron [req-f151a67b-314b-4078-afa0-bfc254868c38 req-ef5bd64c-3cea-4069-885c-a1527555e33f service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Refreshing network info cache for port b8ea5c8c-9b61-42be-bea3-0773a45eddcc {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:51:34 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Instance destroyed successfully.
Nov 08 03:51:34 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Beginning cold snapshot process
Nov 08 03:51:34 user nova-compute[75014]: DEBUG nova.network.neutron [req-f151a67b-314b-4078-afa0-bfc254868c38 req-ef5bd64c-3cea-4069-885c-a1527555e33f service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 03:51:34 user nova-compute[75014]: DEBUG nova.privsep.utils [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75014) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 03:51:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk /opt/stack/data/nova/instances/snapshots/tmpp_hpgjpc/f325c763d3b541a4ac0f0250206f4f37 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:35 user nova-compute[75014]: DEBUG nova.network.neutron [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Successfully updated port: 3e63c197-4437-4b03-82c9-a570406f7d38 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 03:51:35 user nova-compute[75014]: DEBUG nova.network.neutron [req-f151a67b-314b-4078-afa0-bfc254868c38 req-ef5bd64c-3cea-4069-885c-a1527555e33f service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:51:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f151a67b-314b-4078-afa0-bfc254868c38 req-ef5bd64c-3cea-4069-885c-a1527555e33f service nova] Releasing lock "refresh_cache-e8eb4171-aa3d-48bd-90e1-dc371da7a77b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:51:35 user nova-compute[75014]: DEBUG nova.compute.manager [req-f151a67b-314b-4078-afa0-bfc254868c38 req-ef5bd64c-3cea-4069-885c-a1527555e33f service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-changed-1bf169f7-c039-4b88-a7de-3da18a368b14 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:51:35 user nova-compute[75014]: DEBUG nova.compute.manager [req-f151a67b-314b-4078-afa0-bfc254868c38 req-ef5bd64c-3cea-4069-885c-a1527555e33f service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Refreshing instance network info cache due to event network-changed-1bf169f7-c039-4b88-a7de-3da18a368b14. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:51:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f151a67b-314b-4078-afa0-bfc254868c38 req-ef5bd64c-3cea-4069-885c-a1527555e33f service nova] Acquiring lock "refresh_cache-e8eb4171-aa3d-48bd-90e1-dc371da7a77b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:51:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f151a67b-314b-4078-afa0-bfc254868c38 req-ef5bd64c-3cea-4069-885c-a1527555e33f service nova] Acquired lock "refresh_cache-e8eb4171-aa3d-48bd-90e1-dc371da7a77b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:51:35 user nova-compute[75014]: DEBUG nova.network.neutron [req-f151a67b-314b-4078-afa0-bfc254868c38 req-ef5bd64c-3cea-4069-885c-a1527555e33f service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Refreshing network info cache for port 1bf169f7-c039-4b88-a7de-3da18a368b14 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:51:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk /opt/stack/data/nova/instances/snapshots/tmpp_hpgjpc/f325c763d3b541a4ac0f0250206f4f37" returned: 0 in 0.875s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:35 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Snapshot extracted, beginning image upload
Nov 08 03:51:35 user nova-compute[75014]: DEBUG nova.network.neutron [req-f151a67b-314b-4078-afa0-bfc254868c38 req-ef5bd64c-3cea-4069-885c-a1527555e33f service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 03:51:36 user nova-compute[75014]: DEBUG nova.network.neutron [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Successfully updated port: ef47ac6e-fbd7-47f6-bb62-1d2e1d155179 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 03:51:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Acquiring lock "refresh_cache-e8eb4171-aa3d-48bd-90e1-dc371da7a77b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:51:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:36 user nova-compute[75014]: DEBUG nova.network.neutron [req-f151a67b-314b-4078-afa0-bfc254868c38 req-ef5bd64c-3cea-4069-885c-a1527555e33f service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:51:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f151a67b-314b-4078-afa0-bfc254868c38 req-ef5bd64c-3cea-4069-885c-a1527555e33f service nova] Releasing lock "refresh_cache-e8eb4171-aa3d-48bd-90e1-dc371da7a77b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:51:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Acquired lock "refresh_cache-e8eb4171-aa3d-48bd-90e1-dc371da7a77b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:51:36 user nova-compute[75014]: DEBUG nova.network.neutron [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 03:51:36 user nova-compute[75014]: DEBUG nova.compute.manager [req-eeafa692-bc91-4458-a6e4-850539d4b1f1 req-1cee905b-048f-41a5-8565-ebf5b5135d6b service nova] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Received event network-changed-81345e21-7bc0-451c-950d-30053a7181d3 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:51:36 user nova-compute[75014]: DEBUG nova.compute.manager [req-eeafa692-bc91-4458-a6e4-850539d4b1f1 req-1cee905b-048f-41a5-8565-ebf5b5135d6b service nova] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Refreshing instance network info cache due to event network-changed-81345e21-7bc0-451c-950d-30053a7181d3. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:51:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-eeafa692-bc91-4458-a6e4-850539d4b1f1 req-1cee905b-048f-41a5-8565-ebf5b5135d6b service nova] Acquiring lock "refresh_cache-7dd0e158-473f-4785-a5cf-a75b2da85b29" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:51:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-eeafa692-bc91-4458-a6e4-850539d4b1f1 req-1cee905b-048f-41a5-8565-ebf5b5135d6b service nova] Acquired lock "refresh_cache-7dd0e158-473f-4785-a5cf-a75b2da85b29" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:51:36 user nova-compute[75014]: DEBUG nova.network.neutron [req-eeafa692-bc91-4458-a6e4-850539d4b1f1 req-1cee905b-048f-41a5-8565-ebf5b5135d6b service nova] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Refreshing network info cache for port 81345e21-7bc0-451c-950d-30053a7181d3 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:51:36 user nova-compute[75014]: DEBUG nova.compute.manager [req-296260e6-d10d-4671-b194-6aab0f0fce82 req-7ac90af6-b1fe-47c2-8e21-66da54fabba2 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-changed-ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:51:36 user nova-compute[75014]: DEBUG nova.compute.manager [req-296260e6-d10d-4671-b194-6aab0f0fce82 req-7ac90af6-b1fe-47c2-8e21-66da54fabba2 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Refreshing instance network info cache due to event network-changed-ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:51:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-296260e6-d10d-4671-b194-6aab0f0fce82 req-7ac90af6-b1fe-47c2-8e21-66da54fabba2 service nova] Acquiring lock "refresh_cache-e8eb4171-aa3d-48bd-90e1-dc371da7a77b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:51:36 user nova-compute[75014]: DEBUG nova.network.neutron [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 03:51:36 user nova-compute[75014]: DEBUG nova.compute.manager [req-dc1be702-796d-48f2-9c19-ae19b2cd3be8 req-51f1a162-560d-4d95-a3b4-17b1b34052b1 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Received event network-vif-plugged-2dd443c9-89d2-4a7c-b2fe-e842507e24d7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:51:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dc1be702-796d-48f2-9c19-ae19b2cd3be8 req-51f1a162-560d-4d95-a3b4-17b1b34052b1 service nova] Acquiring lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:51:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dc1be702-796d-48f2-9c19-ae19b2cd3be8 req-51f1a162-560d-4d95-a3b4-17b1b34052b1 service nova] Lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:51:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dc1be702-796d-48f2-9c19-ae19b2cd3be8 req-51f1a162-560d-4d95-a3b4-17b1b34052b1 service nova] Lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:51:36 user nova-compute[75014]: DEBUG nova.compute.manager [req-dc1be702-796d-48f2-9c19-ae19b2cd3be8 req-51f1a162-560d-4d95-a3b4-17b1b34052b1 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] No waiting events found dispatching network-vif-plugged-2dd443c9-89d2-4a7c-b2fe-e842507e24d7 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:51:36 user nova-compute[75014]: WARNING nova.compute.manager [req-dc1be702-796d-48f2-9c19-ae19b2cd3be8 req-51f1a162-560d-4d95-a3b4-17b1b34052b1 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Received unexpected event network-vif-plugged-2dd443c9-89d2-4a7c-b2fe-e842507e24d7 for instance with vm_state active and task_state shelving_image_uploading.
Nov 08 03:51:36 user nova-compute[75014]: DEBUG nova.network.neutron [req-eeafa692-bc91-4458-a6e4-850539d4b1f1 req-1cee905b-048f-41a5-8565-ebf5b5135d6b service nova] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Updated VIF entry in instance network info cache for port 81345e21-7bc0-451c-950d-30053a7181d3. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:51:36 user nova-compute[75014]: DEBUG nova.network.neutron [req-eeafa692-bc91-4458-a6e4-850539d4b1f1 req-1cee905b-048f-41a5-8565-ebf5b5135d6b service nova] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Updating instance_info_cache with network_info: [{"id": "81345e21-7bc0-451c-950d-30053a7181d3", "address": "fa:16:3e:66:a0:f5", "network": {"id": "24ff600e-3d1c-49d0-90cf-84e1aa25d978", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1636920770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4e7f2292f74b0a88221144ad5220f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81345e21-7b", "ovs_interfaceid": "81345e21-7bc0-451c-950d-30053a7181d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:51:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-eeafa692-bc91-4458-a6e4-850539d4b1f1 req-1cee905b-048f-41a5-8565-ebf5b5135d6b service nova] Releasing lock "refresh_cache-7dd0e158-473f-4785-a5cf-a75b2da85b29" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:51:38 user nova-compute[75014]: DEBUG nova.network.neutron [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Updating instance_info_cache with network_info: [{"id": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "address": "fa:16:3e:e7:72:75", "network": {"id": "f0d5c3f6-95de-4bae-8891-ecf46615f6e0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2062952809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b161cc-78", "ovs_interfaceid": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "address": "fa:16:3e:d1:7b:69", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865f50bd-f6", "ovs_interfaceid": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "address": "fa:16:3e:83:47:72", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea5c8c-9b", "ovs_interfaceid": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1bf169f7-c039-4b88-a7de-3da18a368b14", "address": "fa:16:3e:66:75:a0", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf169f7-c0", "ovs_interfaceid": "1bf169f7-c039-4b88-a7de-3da18a368b14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e", "address": "fa:16:3e:bf:c2:75", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca24a270-f9", "ovs_interfaceid": "ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3e63c197-4437-4b03-82c9-a570406f7d38", "address": "fa:16:3e:6b:d2:09", "network": {"id": "dc41b474-59dc-43ae-9724-45c03cddae19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495507142", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e63c197-44", "ovs_interfaceid": "3e63c197-4437-4b03-82c9-a570406f7d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef47ac6e-fbd7-47f6-bb62-1d2e1d155179", "address": "fa:16:3e:a8:c1:6a", "network": {"id": "dc41b474-59dc-43ae-9724-45c03cddae19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495507142", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef47ac6e-fb", "ovs_interfaceid": "ef47ac6e-fbd7-47f6-bb62-1d2e1d155179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:51:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Releasing lock "refresh_cache-e8eb4171-aa3d-48bd-90e1-dc371da7a77b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:51:38 user nova-compute[75014]: DEBUG nova.compute.manager [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Instance network_info: |[{"id": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "address": "fa:16:3e:e7:72:75", "network": {"id": "f0d5c3f6-95de-4bae-8891-ecf46615f6e0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2062952809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b161cc-78", "ovs_interfaceid": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "address": "fa:16:3e:d1:7b:69", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865f50bd-f6", "ovs_interfaceid": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "address": "fa:16:3e:83:47:72", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea5c8c-9b", "ovs_interfaceid": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1bf169f7-c039-4b88-a7de-3da18a368b14", "address": "fa:16:3e:66:75:a0", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf169f7-c0", "ovs_interfaceid": "1bf169f7-c039-4b88-a7de-3da18a368b14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e", "address": "fa:16:3e:bf:c2:75", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca24a270-f9", "ovs_interfaceid": "ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3e63c197-4437-4b03-82c9-a570406f7d38", "address": "fa:16:3e:6b:d2:09", "network": {"id": "dc41b474-59dc-43ae-9724-45c03cddae19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495507142", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e63c197-44", "ovs_interfaceid": "3e63c197-4437-4b03-82c9-a570406f7d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef47ac6e-fbd7-47f6-bb62-1d2e1d155179", "address": "fa:16:3e:a8:c1:6a", "network": {"id": "dc41b474-59dc-43ae-9724-45c03cddae19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495507142", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef47ac6e-fb", "ovs_interfaceid": "ef47ac6e-fbd7-47f6-bb62-1d2e1d155179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 03:51:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-296260e6-d10d-4671-b194-6aab0f0fce82 req-7ac90af6-b1fe-47c2-8e21-66da54fabba2 service nova] Acquired lock "refresh_cache-e8eb4171-aa3d-48bd-90e1-dc371da7a77b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:51:38 user nova-compute[75014]: DEBUG nova.network.neutron [req-296260e6-d10d-4671-b194-6aab0f0fce82 req-7ac90af6-b1fe-47c2-8e21-66da54fabba2 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Refreshing network info cache for port ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:51:39 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Snapshot image upload complete
Nov 08 03:51:39 user nova-compute[75014]: DEBUG nova.compute.manager [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:51:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:39 user nova-compute[75014]: INFO nova.compute.manager [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Shelve offloading
Nov 08 03:51:39 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Instance destroyed successfully.
Nov 08 03:51:39 user nova-compute[75014]: DEBUG nova.compute.manager [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:51:39 user nova-compute[75014]: DEBUG nova.network.neutron [req-296260e6-d10d-4671-b194-6aab0f0fce82 req-7ac90af6-b1fe-47c2-8e21-66da54fabba2 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Updated VIF entry in instance network info cache for port ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:51:39 user nova-compute[75014]: DEBUG nova.network.neutron [req-296260e6-d10d-4671-b194-6aab0f0fce82 req-7ac90af6-b1fe-47c2-8e21-66da54fabba2 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Updating instance_info_cache with network_info: [{"id": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "address": "fa:16:3e:e7:72:75", "network": {"id": "f0d5c3f6-95de-4bae-8891-ecf46615f6e0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2062952809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b161cc-78", "ovs_interfaceid": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "address": "fa:16:3e:d1:7b:69", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865f50bd-f6", "ovs_interfaceid": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "address": "fa:16:3e:83:47:72", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea5c8c-9b", "ovs_interfaceid": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1bf169f7-c039-4b88-a7de-3da18a368b14", "address": "fa:16:3e:66:75:a0", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf169f7-c0", "ovs_interfaceid": "1bf169f7-c039-4b88-a7de-3da18a368b14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e", "address": "fa:16:3e:bf:c2:75", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca24a270-f9", "ovs_interfaceid": "ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3e63c197-4437-4b03-82c9-a570406f7d38", "address": "fa:16:3e:6b:d2:09", "network": {"id": "dc41b474-59dc-43ae-9724-45c03cddae19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495507142", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e63c197-44", "ovs_interfaceid": "3e63c197-4437-4b03-82c9-a570406f7d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef47ac6e-fbd7-47f6-bb62-1d2e1d155179", "address": "fa:16:3e:a8:c1:6a", "network": {"id": "dc41b474-59dc-43ae-9724-45c03cddae19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495507142", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef47ac6e-fb", "ovs_interfaceid": "ef47ac6e-fbd7-47f6-bb62-1d2e1d155179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:51:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "refresh_cache-f1d49f43-145b-4a9e-acbc-ca3759be49d5" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:51:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquired lock "refresh_cache-f1d49f43-145b-4a9e-acbc-ca3759be49d5" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:51:39 user nova-compute[75014]: DEBUG nova.network.neutron [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 03:51:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-296260e6-d10d-4671-b194-6aab0f0fce82 req-7ac90af6-b1fe-47c2-8e21-66da54fabba2 service nova] Releasing lock "refresh_cache-e8eb4171-aa3d-48bd-90e1-dc371da7a77b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:51:39 user nova-compute[75014]: DEBUG nova.compute.manager [req-296260e6-d10d-4671-b194-6aab0f0fce82 req-7ac90af6-b1fe-47c2-8e21-66da54fabba2 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-changed-3e63c197-4437-4b03-82c9-a570406f7d38 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:51:39 user nova-compute[75014]: DEBUG nova.compute.manager [req-296260e6-d10d-4671-b194-6aab0f0fce82 req-7ac90af6-b1fe-47c2-8e21-66da54fabba2 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Refreshing instance network info cache due to event network-changed-3e63c197-4437-4b03-82c9-a570406f7d38. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:51:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-296260e6-d10d-4671-b194-6aab0f0fce82 req-7ac90af6-b1fe-47c2-8e21-66da54fabba2 service nova] Acquiring lock "refresh_cache-e8eb4171-aa3d-48bd-90e1-dc371da7a77b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:51:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-296260e6-d10d-4671-b194-6aab0f0fce82 req-7ac90af6-b1fe-47c2-8e21-66da54fabba2 service nova] Acquired lock "refresh_cache-e8eb4171-aa3d-48bd-90e1-dc371da7a77b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:51:39 user nova-compute[75014]: DEBUG nova.network.neutron [req-296260e6-d10d-4671-b194-6aab0f0fce82 req-7ac90af6-b1fe-47c2-8e21-66da54fabba2 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Refreshing network info cache for port 3e63c197-4437-4b03-82c9-a570406f7d38 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:51:39 user nova-compute[75014]: DEBUG nova.network.neutron [req-296260e6-d10d-4671-b194-6aab0f0fce82 req-7ac90af6-b1fe-47c2-8e21-66da54fabba2 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Updated VIF entry in instance network info cache for port 3e63c197-4437-4b03-82c9-a570406f7d38. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:51:39 user nova-compute[75014]: DEBUG nova.network.neutron [req-296260e6-d10d-4671-b194-6aab0f0fce82 req-7ac90af6-b1fe-47c2-8e21-66da54fabba2 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Updating instance_info_cache with network_info: [{"id": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "address": "fa:16:3e:e7:72:75", "network": {"id": "f0d5c3f6-95de-4bae-8891-ecf46615f6e0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2062952809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b161cc-78", "ovs_interfaceid": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "address": "fa:16:3e:d1:7b:69", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865f50bd-f6", "ovs_interfaceid": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "address": "fa:16:3e:83:47:72", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea5c8c-9b", "ovs_interfaceid": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1bf169f7-c039-4b88-a7de-3da18a368b14", "address": "fa:16:3e:66:75:a0", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf169f7-c0", "ovs_interfaceid": "1bf169f7-c039-4b88-a7de-3da18a368b14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e", "address": "fa:16:3e:bf:c2:75", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca24a270-f9", "ovs_interfaceid": "ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3e63c197-4437-4b03-82c9-a570406f7d38", "address": "fa:16:3e:6b:d2:09", "network": {"id": "dc41b474-59dc-43ae-9724-45c03cddae19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495507142", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e63c197-44", "ovs_interfaceid": "3e63c197-4437-4b03-82c9-a570406f7d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef47ac6e-fbd7-47f6-bb62-1d2e1d155179", "address": "fa:16:3e:a8:c1:6a", "network": {"id": "dc41b474-59dc-43ae-9724-45c03cddae19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495507142", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef47ac6e-fb", "ovs_interfaceid": "ef47ac6e-fbd7-47f6-bb62-1d2e1d155179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:51:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-296260e6-d10d-4671-b194-6aab0f0fce82 req-7ac90af6-b1fe-47c2-8e21-66da54fabba2 service nova] Releasing lock "refresh_cache-e8eb4171-aa3d-48bd-90e1-dc371da7a77b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:51:39 user nova-compute[75014]: DEBUG nova.compute.manager [req-296260e6-d10d-4671-b194-6aab0f0fce82 req-7ac90af6-b1fe-47c2-8e21-66da54fabba2 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-changed-ef47ac6e-fbd7-47f6-bb62-1d2e1d155179 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:51:39 user nova-compute[75014]: DEBUG nova.compute.manager [req-296260e6-d10d-4671-b194-6aab0f0fce82 req-7ac90af6-b1fe-47c2-8e21-66da54fabba2 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Refreshing instance network info cache due to event network-changed-ef47ac6e-fbd7-47f6-bb62-1d2e1d155179. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:51:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-296260e6-d10d-4671-b194-6aab0f0fce82 req-7ac90af6-b1fe-47c2-8e21-66da54fabba2 service nova] Acquiring lock "refresh_cache-e8eb4171-aa3d-48bd-90e1-dc371da7a77b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:51:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-296260e6-d10d-4671-b194-6aab0f0fce82 req-7ac90af6-b1fe-47c2-8e21-66da54fabba2 service nova] Acquired lock "refresh_cache-e8eb4171-aa3d-48bd-90e1-dc371da7a77b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:51:39 user nova-compute[75014]: DEBUG nova.network.neutron [req-296260e6-d10d-4671-b194-6aab0f0fce82 req-7ac90af6-b1fe-47c2-8e21-66da54fabba2 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Refreshing network info cache for port ef47ac6e-fbd7-47f6-bb62-1d2e1d155179 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:51:39 user nova-compute[75014]: DEBUG nova.network.neutron [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Updating instance_info_cache with network_info: [{"id": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "address": "fa:16:3e:32:e2:a4", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd443c9-89", "ovs_interfaceid": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:51:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Releasing lock "refresh_cache-f1d49f43-145b-4a9e-acbc-ca3759be49d5" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:51:40 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Instance destroyed successfully.
Nov 08 03:51:40 user nova-compute[75014]: DEBUG nova.objects.instance [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lazy-loading 'resources' on Instance uuid f1d49f43-145b-4a9e-acbc-ca3759be49d5 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:51:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:49:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-937810668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-937810668',id=5,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDl11M5avo9bT73kKWpL6ROj4Uc6XogM4W8W1Z+wRJrUz7HXPDFtCISzN1nICvOyAaJUURT7jmmDoJ68zd4dmaLkYUzlRePt20TD2aaKSvy0qPri0GSokXbun02g+I7Vg==',key_name='tempest-keypair-1162981834',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:49:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a1d70b55f2bb42e5b7123acfcd621b2f',ramdisk_id='',reservation_id='r-0ts9n0ef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-650261566',owner_user_name='tempest-AttachVolumeShelveTestJSON-650261566-project-member',shelved_at='2023-11-08T03:51:39.019626',shelved_host='user',shelved_image_id='f21343d3-6ed2-4c4e-b5db-c93c1e2c0c53'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T03:51:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74a49a9155064771bd4e8a179f9111ac',uuid=f1d49f43-145b-4a9e-acbc-ca3759be49d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "address": "fa:16:3e:32:e2:a4", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd443c9-89", "ovs_interfaceid": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 03:51:40 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Converting VIF {"id": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "address": "fa:16:3e:32:e2:a4", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd443c9-89", "ovs_interfaceid": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:51:40 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:e2:a4,bridge_name='br-int',has_traffic_filtering=True,id=2dd443c9-89d2-4a7c-b2fe-e842507e24d7,network=Network(6ebf42ac-ab65-4622-8529-4c508f9d563c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd443c9-89') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:51:40 user nova-compute[75014]: DEBUG os_vif [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:e2:a4,bridge_name='br-int',has_traffic_filtering=True,id=2dd443c9-89d2-4a7c-b2fe-e842507e24d7,network=Network(6ebf42ac-ab65-4622-8529-4c508f9d563c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd443c9-89') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 03:51:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dd443c9-89, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:51:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:51:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db2ec738-f6ed-4b04-bd54-c7ce370df25c) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:51:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:40 user nova-compute[75014]: INFO os_vif [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:e2:a4,bridge_name='br-int',has_traffic_filtering=True,id=2dd443c9-89d2-4a7c-b2fe-e842507e24d7,network=Network(6ebf42ac-ab65-4622-8529-4c508f9d563c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd443c9-89')
Nov 08 03:51:40 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Deleting instance files /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5_del
Nov 08 03:51:40 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Deletion of /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5_del complete
Nov 08 03:51:40 user nova-compute[75014]: DEBUG nova.compute.manager [req-b968e827-d67a-41b5-8b79-bf72d42cb911 req-22031c64-a77c-4a66-a4d6-66695488398a service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Received event network-changed-2dd443c9-89d2-4a7c-b2fe-e842507e24d7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:51:40 user nova-compute[75014]: DEBUG nova.compute.manager [req-b968e827-d67a-41b5-8b79-bf72d42cb911 req-22031c64-a77c-4a66-a4d6-66695488398a service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Refreshing instance network info cache due to event network-changed-2dd443c9-89d2-4a7c-b2fe-e842507e24d7. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:51:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b968e827-d67a-41b5-8b79-bf72d42cb911 req-22031c64-a77c-4a66-a4d6-66695488398a service nova] Acquiring lock "refresh_cache-f1d49f43-145b-4a9e-acbc-ca3759be49d5" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:51:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b968e827-d67a-41b5-8b79-bf72d42cb911 req-22031c64-a77c-4a66-a4d6-66695488398a service nova] Acquired lock "refresh_cache-f1d49f43-145b-4a9e-acbc-ca3759be49d5" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:51:40 user nova-compute[75014]: DEBUG nova.network.neutron [req-b968e827-d67a-41b5-8b79-bf72d42cb911 req-22031c64-a77c-4a66-a4d6-66695488398a service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Refreshing network info cache for port 2dd443c9-89d2-4a7c-b2fe-e842507e24d7 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:51:40 user nova-compute[75014]: DEBUG nova.network.neutron [req-296260e6-d10d-4671-b194-6aab0f0fce82 req-7ac90af6-b1fe-47c2-8e21-66da54fabba2 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Updated VIF entry in instance network info cache for port ef47ac6e-fbd7-47f6-bb62-1d2e1d155179. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:51:40 user nova-compute[75014]: DEBUG nova.network.neutron [req-296260e6-d10d-4671-b194-6aab0f0fce82 req-7ac90af6-b1fe-47c2-8e21-66da54fabba2 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Updating instance_info_cache with network_info: [{"id": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "address": "fa:16:3e:e7:72:75", "network": {"id": "f0d5c3f6-95de-4bae-8891-ecf46615f6e0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2062952809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b161cc-78", "ovs_interfaceid": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "address": "fa:16:3e:d1:7b:69", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865f50bd-f6", "ovs_interfaceid": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "address": "fa:16:3e:83:47:72", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea5c8c-9b", "ovs_interfaceid": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1bf169f7-c039-4b88-a7de-3da18a368b14", "address": "fa:16:3e:66:75:a0", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf169f7-c0", "ovs_interfaceid": "1bf169f7-c039-4b88-a7de-3da18a368b14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e", "address": "fa:16:3e:bf:c2:75", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca24a270-f9", "ovs_interfaceid": "ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3e63c197-4437-4b03-82c9-a570406f7d38", "address": "fa:16:3e:6b:d2:09", "network": {"id": "dc41b474-59dc-43ae-9724-45c03cddae19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495507142", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e63c197-44", "ovs_interfaceid": "3e63c197-4437-4b03-82c9-a570406f7d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef47ac6e-fbd7-47f6-bb62-1d2e1d155179", "address": "fa:16:3e:a8:c1:6a", "network": {"id": "dc41b474-59dc-43ae-9724-45c03cddae19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495507142", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef47ac6e-fb", "ovs_interfaceid": "ef47ac6e-fbd7-47f6-bb62-1d2e1d155179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:51:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-296260e6-d10d-4671-b194-6aab0f0fce82 req-7ac90af6-b1fe-47c2-8e21-66da54fabba2 service nova] Releasing lock "refresh_cache-e8eb4171-aa3d-48bd-90e1-dc371da7a77b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:51:40 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Deleted allocations for instance f1d49f43-145b-4a9e-acbc-ca3759be49d5
Nov 08 03:51:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:51:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:51:40 user nova-compute[75014]: DEBUG nova.objects.instance [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lazy-loading 'numa_topology' on Instance uuid f1d49f43-145b-4a9e-acbc-ca3759be49d5 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:51:40 user nova-compute[75014]: DEBUG nova.objects.base [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Object Instance<f1d49f43-145b-4a9e-acbc-ca3759be49d5> lazy-loaded attributes: resources,numa_topology {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 03:51:40 user nova-compute[75014]: DEBUG nova.network.neutron [req-b968e827-d67a-41b5-8b79-bf72d42cb911 req-22031c64-a77c-4a66-a4d6-66695488398a service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Updated VIF entry in instance network info cache for port 2dd443c9-89d2-4a7c-b2fe-e842507e24d7. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:51:40 user nova-compute[75014]: DEBUG nova.network.neutron [req-b968e827-d67a-41b5-8b79-bf72d42cb911 req-22031c64-a77c-4a66-a4d6-66695488398a service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Updating instance_info_cache with network_info: [{"id": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "address": "fa:16:3e:32:e2:a4", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap2dd443c9-89", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:51:40 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:51:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b968e827-d67a-41b5-8b79-bf72d42cb911 req-22031c64-a77c-4a66-a4d6-66695488398a service nova] Releasing lock "refresh_cache-f1d49f43-145b-4a9e-acbc-ca3759be49d5" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:51:40 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:51:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:51:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6277a2d1-4dbe-4a42-b65c-bff0380bcae5 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.650s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:51:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Acquiring lock "7dd0e158-473f-4785-a5cf-a75b2da85b29" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:51:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "7dd0e158-473f-4785-a5cf-a75b2da85b29" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:51:43 user nova-compute[75014]: DEBUG nova.objects.instance [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lazy-loading 'flavor' on Instance uuid 7dd0e158-473f-4785-a5cf-a75b2da85b29 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:51:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "7dd0e158-473f-4785-a5cf-a75b2da85b29" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:51:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Acquiring lock "7dd0e158-473f-4785-a5cf-a75b2da85b29" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:51:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "7dd0e158-473f-4785-a5cf-a75b2da85b29" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:51:43 user nova-compute[75014]: INFO nova.compute.manager [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Attaching volume 1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 to /dev/vdb
Nov 08 03:51:43 user nova-compute[75014]: DEBUG os_brick.utils [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:51:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:43 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aea6714-c736-4f29-9007-bc5ca16a7b4c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:51:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:43 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f8e248-cc26-4d58-b9be-7ea6153a48cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:51:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:43 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f64b24-cfcf-4e2f-a63a-ee885bd224d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:51:43 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdf7a0e-8f1b-4134-b9bb-f6233397736e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:51:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 03:51:43 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 03:51:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 03:51:43 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 03:51:43 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[124f454e-58ef-442c-9d3a-43ba790bceb4]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:51:43 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 03:51:43 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 03:51:43 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 03:51:43 user nova-compute[75014]: DEBUG os_brick.utils [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:51:43 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Updating existing volume attachment record: 6b1874f3-f134-476e-90a3-9de7e529bfcd {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 03:51:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:46 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:52 user nova-compute[75014]: INFO nova.virt.block_device [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Booting with volume 915cfc8b-84fe-49c9-b514-353b6cf4578d at /dev/vdb
Nov 08 03:51:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Acquiring lock "8a8d9f3c-1150-4306-8dc6-eedde92c7a35" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:51:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lock "8a8d9f3c-1150-4306-8dc6-eedde92c7a35" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:51:52 user nova-compute[75014]: DEBUG nova.objects.instance [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lazy-loading 'flavor' on Instance uuid 8a8d9f3c-1150-4306-8dc6-eedde92c7a35 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:51:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lock "8a8d9f3c-1150-4306-8dc6-eedde92c7a35" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:51:52 user nova-compute[75014]: DEBUG nova.compute.manager [req-13e6691c-10f2-4a4e-ab7c-a720dc7b9b3f req-2ed9118b-ac13-4ffd-90e1-b4ffb658981c service nova] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Received event network-changed-9560a102-ba69-4b8d-a190-4c328fd75152 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:51:52 user nova-compute[75014]: DEBUG nova.compute.manager [req-13e6691c-10f2-4a4e-ab7c-a720dc7b9b3f req-2ed9118b-ac13-4ffd-90e1-b4ffb658981c service nova] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Refreshing instance network info cache due to event network-changed-9560a102-ba69-4b8d-a190-4c328fd75152. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:51:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-13e6691c-10f2-4a4e-ab7c-a720dc7b9b3f req-2ed9118b-ac13-4ffd-90e1-b4ffb658981c service nova] Acquiring lock "refresh_cache-2ab81192-8890-499c-ad4b-b93664da45fb" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:51:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-13e6691c-10f2-4a4e-ab7c-a720dc7b9b3f req-2ed9118b-ac13-4ffd-90e1-b4ffb658981c service nova] Acquired lock "refresh_cache-2ab81192-8890-499c-ad4b-b93664da45fb" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:51:52 user nova-compute[75014]: DEBUG nova.network.neutron [req-13e6691c-10f2-4a4e-ab7c-a720dc7b9b3f req-2ed9118b-ac13-4ffd-90e1-b4ffb658981c service nova] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Refreshing network info cache for port 9560a102-ba69-4b8d-a190-4c328fd75152 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:51:52 user nova-compute[75014]: DEBUG os_brick.utils [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:51:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:52 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ba6a62-6f5f-40f1-b428-114c260ac217]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:51:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:52 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed593b6-9a9d-4a77-a27d-e9964ed08005]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:51:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:51:52 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[974a3cf0-b2f3-4d4d-ab3f-c5ca9463ed0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:51:52 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb52671-6b95-4c28-8296-d6ea3664a1bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:51:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 03:51:52 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 03:51:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:51:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 03:51:53 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 03:51:53 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[766345c8-4e7e-46b6-9bd0-ad962570f691]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:51:53 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 03:51:53 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 03:51:53 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 03:51:53 user nova-compute[75014]: DEBUG os_brick.utils [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:51:53 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Updating existing volume attachment record: 6a162d69-e548-489a-bd10-cfc90ae7a83a {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 03:51:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Acquiring lock "2ab81192-8890-499c-ad4b-b93664da45fb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:51:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Lock "2ab81192-8890-499c-ad4b-b93664da45fb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:51:53 user nova-compute[75014]: DEBUG nova.objects.instance [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Lazy-loading 'flavor' on Instance uuid 2ab81192-8890-499c-ad4b-b93664da45fb {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:51:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Lock "2ab81192-8890-499c-ad4b-b93664da45fb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.102s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:51:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Acquiring lock "8a8d9f3c-1150-4306-8dc6-eedde92c7a35" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:51:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lock "8a8d9f3c-1150-4306-8dc6-eedde92c7a35" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:51:53 user nova-compute[75014]: INFO nova.compute.manager [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Attaching volume 0c07f126-e11e-4778-a39d-a115ec717bc3 to /dev/sdc
Nov 08 03:51:53 user nova-compute[75014]: DEBUG nova.network.neutron [req-13e6691c-10f2-4a4e-ab7c-a720dc7b9b3f req-2ed9118b-ac13-4ffd-90e1-b4ffb658981c service nova] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Updated VIF entry in instance network info cache for port 9560a102-ba69-4b8d-a190-4c328fd75152. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:51:53 user nova-compute[75014]: DEBUG nova.network.neutron [req-13e6691c-10f2-4a4e-ab7c-a720dc7b9b3f req-2ed9118b-ac13-4ffd-90e1-b4ffb658981c service nova] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Updating instance_info_cache with network_info: [{"id": "9560a102-ba69-4b8d-a190-4c328fd75152", "address": "fa:16:3e:ac:c2:d9", "network": {"id": "cd4479bd-ef72-411c-bbab-3738ca8d79d4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1925691320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ed0da9041f4975940636f88112cce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9560a102-ba", "ovs_interfaceid": "9560a102-ba69-4b8d-a190-4c328fd75152", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:51:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-13e6691c-10f2-4a4e-ab7c-a720dc7b9b3f req-2ed9118b-ac13-4ffd-90e1-b4ffb658981c service nova] Releasing lock "refresh_cache-2ab81192-8890-499c-ad4b-b93664da45fb" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:51:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:51:56 user nova-compute[75014]: DEBUG nova.compute.manager [req-c32a3fe6-cad6-4144-85a4-abb4aacf0374 req-3470ae5d-cf9e-4dd4-9844-76102b392151 service nova] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Received event network-changed-6a4fe909-e328-4b38-b695-6c555e1dd6d5 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:51:56 user nova-compute[75014]: DEBUG nova.compute.manager [req-c32a3fe6-cad6-4144-85a4-abb4aacf0374 req-3470ae5d-cf9e-4dd4-9844-76102b392151 service nova] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Refreshing instance network info cache due to event network-changed-6a4fe909-e328-4b38-b695-6c555e1dd6d5. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:51:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c32a3fe6-cad6-4144-85a4-abb4aacf0374 req-3470ae5d-cf9e-4dd4-9844-76102b392151 service nova] Acquiring lock "refresh_cache-0f326d33-802d-4a4a-b2a2-a01b0fef36b4" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:51:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c32a3fe6-cad6-4144-85a4-abb4aacf0374 req-3470ae5d-cf9e-4dd4-9844-76102b392151 service nova] Acquired lock "refresh_cache-0f326d33-802d-4a4a-b2a2-a01b0fef36b4" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:51:56 user nova-compute[75014]: DEBUG nova.network.neutron [req-c32a3fe6-cad6-4144-85a4-abb4aacf0374 req-3470ae5d-cf9e-4dd4-9844-76102b392151 service nova] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Refreshing network info cache for port 6a4fe909-e328-4b38-b695-6c555e1dd6d5 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:51:57 user nova-compute[75014]: DEBUG nova.network.neutron [req-c32a3fe6-cad6-4144-85a4-abb4aacf0374 req-3470ae5d-cf9e-4dd4-9844-76102b392151 service nova] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Updated VIF entry in instance network info cache for port 6a4fe909-e328-4b38-b695-6c555e1dd6d5. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:51:57 user nova-compute[75014]: DEBUG nova.network.neutron [req-c32a3fe6-cad6-4144-85a4-abb4aacf0374 req-3470ae5d-cf9e-4dd4-9844-76102b392151 service nova] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Updating instance_info_cache with network_info: [{"id": "6a4fe909-e328-4b38-b695-6c555e1dd6d5", "address": "fa:16:3e:12:02:8b", "network": {"id": "70074778-610f-4741-b871-65e344ac3986", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-298546593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a10920a240f5ba41ed032321e972", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4fe909-e3", "ovs_interfaceid": "6a4fe909-e328-4b38-b695-6c555e1dd6d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:51:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c32a3fe6-cad6-4144-85a4-abb4aacf0374 req-3470ae5d-cf9e-4dd4-9844-76102b392151 service nova] Releasing lock "refresh_cache-0f326d33-802d-4a4a-b2a2-a01b0fef36b4" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:52:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:52:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:52:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:52:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:52:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:52:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:52:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:52:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:52:20 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:52:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:52:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:52:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 03:52:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 03:52:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 03:52:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:52:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:52:29 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:52:29 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:52:29 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 03:52:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-30cf3d8d-a9e0-4b67-b2df-fafaeb616e89" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:52:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-30cf3d8d-a9e0-4b67-b2df-fafaeb616e89" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:52:29 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 03:52:30 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Updating instance_info_cache with network_info: [{"id": "5ccfbc09-b908-4eb3-9521-31289eb0641f", "address": "fa:16:3e:d7:ed:d9", "network": {"id": "a8fa201e-8062-45a0-9403-bf153b0c406f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1481531992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa81674e9c2471e832ef12631f63abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccfbc09-b9", "ovs_interfaceid": "5ccfbc09-b908-4eb3-9521-31289eb0641f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:52:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-30cf3d8d-a9e0-4b67-b2df-fafaeb616e89" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:52:30 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 03:52:30 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:52:30 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:52:30 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:52:30 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:52:30 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:52:30 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:52:30 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 03:52:30 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:52:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:52:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:52:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:52:30 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 03:52:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:52:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:52:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:52:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:52:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:52:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:52:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:52:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:52:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:52:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:52:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:52:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:52:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:52:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:52:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30cf3d8d-a9e0-4b67-b2df-fafaeb616e89/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:52:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30cf3d8d-a9e0-4b67-b2df-fafaeb616e89/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:52:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30cf3d8d-a9e0-4b67-b2df-fafaeb616e89/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:52:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30cf3d8d-a9e0-4b67-b2df-fafaeb616e89/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:52:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:52:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:52:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:52:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:52:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:52:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:52:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:52:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:52:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:52:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:52:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:52:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:52:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:52:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:52:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:52:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:52:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f326d33-802d-4a4a-b2a2-a01b0fef36b4/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:52:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f326d33-802d-4a4a-b2a2-a01b0fef36b4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:52:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f326d33-802d-4a4a-b2a2-a01b0fef36b4/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:52:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f326d33-802d-4a4a-b2a2-a01b0fef36b4/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:52:33 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:52:33 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:52:33 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=7831MB free_disk=25.30274200439453GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 03:52:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:52:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:52:34 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9f205fe5-576f-4ef0-874b-1544c0307a7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:52:34 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 5bfa6580-e0fe-46b0-b497-8db67806113a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:52:34 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:52:34 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 8527ee40-fb8a-469b-9696-d7bde8cc96f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:52:34 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 8a8d9f3c-1150-4306-8dc6-eedde92c7a35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:52:34 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 7dd0e158-473f-4785-a5cf-a75b2da85b29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:52:34 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 2ab81192-8890-499c-ad4b-b93664da45fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:52:34 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 0f326d33-802d-4a4a-b2a2-a01b0fef36b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:52:34 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance e8eb4171-aa3d-48bd-90e1-dc371da7a77b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:52:34 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 03:52:34 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 03:52:34 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:52:34 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:52:34 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 03:52:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.460s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:52:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:52:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:52:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:52:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 03:52:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 03:52:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 03:52:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:52:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:52:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:52:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:53:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG os_brick.initiator.connector [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Factory for ISCSI on None {{(pid=75014) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHagxOEM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:53:05 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 03:53:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:53:05 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 03:53:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:53:05 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d054f19-e9cb-49ae-aad4-fab49e52adb5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 03:53:05 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ac3557-0b86-4c96-b19e-192184ec51ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3] added
Nov 08 03:53:05 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.070s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[673d9fd0-92ec-4afa-83fa-b2cbfed4684a]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4b0707-9f12-486a-8841-8be2097875a2]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AHagxOEM {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AHagxOEM" returned: 0 in 0.028s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd6bd06-220b-4254-97f7-5271d4a00f84]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AHagxOEM'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7294eeae-631a-42f5-abf0-c82918632f0c]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed78bfd-aa88-4c6e-a7c4-0ea010bdfabd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 03:53:05 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 03:53:05 user nova-compute[75014]:  {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:53:05 user nova-compute[75014]: WARNING os_brick.initiator.connectors.iscsi [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 03:53:05 user nova-compute[75014]: 
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b8ae7624-d31f-4877-b599-8bc9517fc126 tempest-VolumesAssistedSnapshotsTest-1561322015 tempest-VolumesAssistedSnapshotsTest-1561322015-project-admin] Acquiring lock "0f326d33-802d-4a4a-b2a2-a01b0fef36b4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b8ae7624-d31f-4877-b599-8bc9517fc126 tempest-VolumesAssistedSnapshotsTest-1561322015 tempest-VolumesAssistedSnapshotsTest-1561322015-project-admin] Lock "0f326d33-802d-4a4a-b2a2-a01b0fef36b4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG nova.objects.instance [None req-b8ae7624-d31f-4877-b599-8bc9517fc126 tempest-VolumesAssistedSnapshotsTest-1561322015 tempest-VolumesAssistedSnapshotsTest-1561322015-project-admin] Lazy-loading 'flavor' on Instance uuid 0f326d33-802d-4a4a-b2a2-a01b0fef36b4 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[124f298f-8b9b-471a-80b1-5d4ac1775c37]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3, portal: 172.16.0.220,3260]
Nov 08 03:53:05 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3, portal: 172.16.0.220,3260] successful.
Nov 08 03:53:05 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce64fa2-8ccd-4880-b83a-4cfb1ac17ceb]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3621a05-d316-441a-a502-75a901a4e4e8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 (non-flash)
Nov 08 03:53:05 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 (non-flash)
Nov 08 03:53:05 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xlzgmowr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:53:05 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 03:53:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e3e42d-e9c7-4893-a3fd-7c7b4216458e]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHagxOEM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 03:53:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b8ae7624-d31f-4877-b599-8bc9517fc126 tempest-VolumesAssistedSnapshotsTest-1561322015 tempest-VolumesAssistedSnapshotsTest-1561322015-project-admin] Lock "0f326d33-802d-4a4a-b2a2-a01b0fef36b4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.154s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG os_brick.utils [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae764286-0f4f-4613-85bf-be8c4e0987fd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Acquiring lock "2ab81192-8890-499c-ad4b-b93664da45fb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Lock "2ab81192-8890-499c-ad4b-b93664da45fb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:06 user nova-compute[75014]: INFO nova.compute.manager [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Attaching volume 735a233b-2c2f-4d50-99ea-9f457c541f06 to /dev/vdb
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cf47fb-99c0-49d6-b6c2-cb2c658b74f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1600334e-abcf-4b5d-be6a-eca7250a7569]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5d60b5-690d-4e48-a239-4503d674324e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 03:53:06 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbc8691-955d-4d82-b340-6db78d143981]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG os_brick.utils [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Updating existing volume attachment record: e8f6e8ae-b411-497b-b3a2-adea3a27bdd0 {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 03:53:06 user nova-compute[75014]: INFO nova.virt.block_device [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Booting with volume 3140f712-f683-4bd3-937a-aa1fe47ca9f4 at /dev/vdc
Nov 08 03:53:06 user nova-compute[75014]: DEBUG os_brick.utils [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d4e6db-e65b-49d2-8709-278b6808939f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8250b00a-8379-4fdb-905f-8fde2a923792]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c8d9d4-3021-4ecb-b08c-3085bc060c56]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a099a98-3726-4ab3-9c01-77437cf6636a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG os_brick.utils [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 03:53:06 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5509ad71-7d75-4960-983e-f13c7075770b]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG os_brick.utils [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Updating existing volume attachment record: 8e6157d8-2249-4cf4-827b-e45324ce92be {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf434d6c-04aa-4e4d-a5fd-1bf8314359e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ec5031-5b42-464c-bad2-4cea617844cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f7e40b-e943-4c15-b1c1-b97c287c12cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74aeb17-7599-4219-94df-6f0b68baecc1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 03:53:06 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[371b3a26-e852-4ad3-9b14-59a159261da1]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG os_brick.utils [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Updating existing volume attachment record: 0ca0cdbd-a449-4426-99bc-ce130d0c295c {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6a7898b2-010f-434c-84ef-43fa8b6e3b33 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Acquiring lock "2ab81192-8890-499c-ad4b-b93664da45fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23939626232663830', 'path': '/dev/sdb'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939626232663830', 'path': '/dev/sdb'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.026s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:53:06 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 03:53:06 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:53:06 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 03:53:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:06 user nova-compute[75014]: DEBUG nova.objects.instance [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Lazy-loading 'flavor' on Instance uuid 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 -p 172.16.0.220:3260" returned: 21 in 0.048s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[25af9de7-acea-45f6-9c27-9520da8e5405]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 03:53:07 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[818b04df-ea23-48d3-b70a-08c1e922c82d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501] added
Nov 08 03:53:07 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 03:53:07 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 03:53:07 user nova-compute[75014]:   <source dev="/dev/sdb"/>
Nov 08 03:53:07 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 03:53:07 user nova-compute[75014]:   <serial>c6106b11-5f08-4f3b-867b-081da414cda3</serial>
Nov 08 03:53:07 user nova-compute[75014]: </disk>
Nov 08 03:53:07 user nova-compute[75014]:  {{(pid=75014) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f65b18-cfe1-4110-aad4-3078effa58d2]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dde6690-0673-48e7-9604-2d74370dcc96]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xlzgmowr {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xlzgmowr" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[285ab1c6-aff6-42fa-990e-77e1e9ce1149]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xlzgmowr'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[55459680-0c46-4bb5-8708-2c2da714e918]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[455b63a4-ebeb-410e-83a5-d505efa0c0b3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 (non-flash)
Nov 08 03:53:07 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 (non-flash)
Nov 08 03:53:07 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 -p 172.16.0.220:3260 --login" returned: 0 in 0.103s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a93111e-0550-4cac-856a-9545738cbf45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501, portal: 172.16.0.220,3260]
Nov 08 03:53:07 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501, portal: 172.16.0.220,3260] successful.
Nov 08 03:53:07 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70ede9b-46a6-48cd-b2bc-4b02417609af]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[454081d1-94c6-405c-a2cc-d2a108ece1f7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 (non-flash)
Nov 08 03:53:07 user nova-compute[75014]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)
Nov 08 03:53:07 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 (non-flash)
Nov 08 03:53:07 user nova-compute[75014]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)
Nov 08 03:53:07 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c55dd0-3a98-4df3-b2ce-f02df26bff55]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xlzgmowr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Acquiring lock "4802a259-b7ae-4fc2-98ad-8fa3e2cc4965" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Lock "4802a259-b7ae-4fc2-98ad-8fa3e2cc4965" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] No VIF found with MAC fa:16:3e:d7:ed:d9, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 03:53:07 user nova-compute[75014]: INFO nova.compute.claims [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Claim successful on node user
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:07 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 03:53:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:08 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:53:08 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:53:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.609s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:08 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 03:53:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.111s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:08 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 03:53:08 user nova-compute[75014]: INFO nova.compute.claims [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Claim successful on node user
Nov 08 03:53:08 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 03:53:08 user nova-compute[75014]: DEBUG nova.network.neutron [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 03:53:08 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 03:53:08 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 03:53:08 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.467s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:53:08 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] <== connect_volume: return (2492ms) {'type': 'block', 'scsi_wwn': '26562306332326535', 'path': '/dev/sdc'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:53:08 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562306332326535', 'path': '/dev/sdc'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 03:53:08 user nova-compute[75014]: DEBUG nova.objects.instance [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lazy-loading 'flavor' on Instance uuid 7dd0e158-473f-4785-a5cf-a75b2da85b29 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:53:08 user nova-compute[75014]: DEBUG neutronclient.v2_0.client [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Error message: {"NeutronError": {"type": "PortNotFound", "message": "Port 2385bd9b-063b-4ba7-b80a-4910985bf841 could not be found.", "detail": ""}} {{(pid=75014) _handle_fault_response /opt/stack/data/venv/lib/python3.10/site-packages/neutronclient/v2_0/client.py:262}}
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Instance failed network setup after 1 attempt(s): nova.exception.PortNotFound: Port id 2385bd9b-063b-4ba7-b80a-4910985bf841 could not be found.
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager Traceback (most recent call last):
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager   File "/opt/stack/nova/nova/network/neutron.py", line 1975, in _show_port
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager     result = neutron_client.show_port(port_id)
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager   File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager     ret = obj(*args, **kwargs)
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager   File "/opt/stack/data/venv/lib/python3.10/site-packages/neutronclient/v2_0/client.py", line 820, in show_port
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager     return self.get(self.port_path % (port), params=_params)
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager   File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager     ret = obj(*args, **kwargs)
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager   File "/opt/stack/data/venv/lib/python3.10/site-packages/neutronclient/v2_0/client.py", line 356, in get
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager     return self.retry_request("GET", action, body=body,
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager   File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager     ret = obj(*args, **kwargs)
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager   File "/opt/stack/data/venv/lib/python3.10/site-packages/neutronclient/v2_0/client.py", line 333, in retry_request
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager     return self.do_request(method, action, body=body,
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager   File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager     ret = obj(*args, **kwargs)
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager   File "/opt/stack/data/venv/lib/python3.10/site-packages/neutronclient/v2_0/client.py", line 297, in do_request
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager     self._handle_fault_response(status_code, replybody, resp)
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager   File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager     ret = obj(*args, **kwargs)
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager   File "/opt/stack/data/venv/lib/python3.10/site-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager     exception_handler_v20(status_code, error_body)
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager   File "/opt/stack/data/venv/lib/python3.10/site-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager     raise client_exc(message=error_message,
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager neutronclient.common.exceptions.PortNotFoundClient: Port 2385bd9b-063b-4ba7-b80a-4910985bf841 could not be found.
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager Neutron server returns request_ids: ['req-fb5288c8-ece1-4b8b-b792-969118b3ad4e']
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager 
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager During handling of the above exception, another exception occurred:
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager 
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager Traceback (most recent call last):
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager   File "/opt/stack/nova/nova/compute/manager.py", line 1980, in _allocate_network_async
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager     nwinfo = self.network_api.allocate_for_instance(
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager   File "/opt/stack/nova/nova/network/neutron.py", line 1182, in allocate_for_instance
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager     self._validate_requested_port_ids(
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager   File "/opt/stack/nova/nova/network/neutron.py", line 770, in _validate_requested_port_ids
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager     port = self._show_port(context, request.port_id,
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager   File "/opt/stack/nova/nova/network/neutron.py", line 1978, in _show_port
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager     raise exception.PortNotFound(port_id=port_id)
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager nova.exception.PortNotFound: Port id 2385bd9b-063b-4ba7-b80a-4910985bf841 could not be found.
Nov 08 03:53:08 user nova-compute[75014]: ERROR nova.compute.manager 
Nov 08 03:53:08 user nova-compute[75014]: Traceback (most recent call last):
Nov 08 03:53:08 user nova-compute[75014]:   File "/opt/stack/nova/nova/network/neutron.py", line 1975, in _show_port
Nov 08 03:53:08 user nova-compute[75014]:     result = neutron_client.show_port(port_id)
Nov 08 03:53:08 user nova-compute[75014]:   File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper
Nov 08 03:53:08 user nova-compute[75014]:     ret = obj(*args, **kwargs)
Nov 08 03:53:08 user nova-compute[75014]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/neutronclient/v2_0/client.py", line 820, in show_port
Nov 08 03:53:08 user nova-compute[75014]:     return self.get(self.port_path % (port), params=_params)
Nov 08 03:53:08 user nova-compute[75014]:   File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper
Nov 08 03:53:08 user nova-compute[75014]:     ret = obj(*args, **kwargs)
Nov 08 03:53:08 user nova-compute[75014]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/neutronclient/v2_0/client.py", line 356, in get
Nov 08 03:53:08 user nova-compute[75014]:     return self.retry_request("GET", action, body=body,
Nov 08 03:53:08 user nova-compute[75014]:   File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper
Nov 08 03:53:08 user nova-compute[75014]:     ret = obj(*args, **kwargs)
Nov 08 03:53:08 user nova-compute[75014]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/neutronclient/v2_0/client.py", line 333, in retry_request
Nov 08 03:53:08 user nova-compute[75014]:     return self.do_request(method, action, body=body,
Nov 08 03:53:08 user nova-compute[75014]:   File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper
Nov 08 03:53:08 user nova-compute[75014]:     ret = obj(*args, **kwargs)
Nov 08 03:53:08 user nova-compute[75014]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/neutronclient/v2_0/client.py", line 297, in do_request
Nov 08 03:53:08 user nova-compute[75014]:     self._handle_fault_response(status_code, replybody, resp)
Nov 08 03:53:08 user nova-compute[75014]:   File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper
Nov 08 03:53:08 user nova-compute[75014]:     ret = obj(*args, **kwargs)
Nov 08 03:53:08 user nova-compute[75014]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response
Nov 08 03:53:08 user nova-compute[75014]:     exception_handler_v20(status_code, error_body)
Nov 08 03:53:08 user nova-compute[75014]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20
Nov 08 03:53:08 user nova-compute[75014]:     raise client_exc(message=error_message,
Nov 08 03:53:08 user nova-compute[75014]: neutronclient.common.exceptions.PortNotFoundClient: Port 2385bd9b-063b-4ba7-b80a-4910985bf841 could not be found.
Nov 08 03:53:08 user nova-compute[75014]: Neutron server returns request_ids: ['req-fb5288c8-ece1-4b8b-b792-969118b3ad4e']
Nov 08 03:53:08 user nova-compute[75014]: During handling of the above exception, another exception occurred:
Nov 08 03:53:08 user nova-compute[75014]: Traceback (most recent call last):
Nov 08 03:53:08 user nova-compute[75014]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait
Nov 08 03:53:08 user nova-compute[75014]:     listener.cb(fileno)
Nov 08 03:53:08 user nova-compute[75014]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 221, in main
Nov 08 03:53:08 user nova-compute[75014]:     result = function(*args, **kwargs)
Nov 08 03:53:08 user nova-compute[75014]:   File "/opt/stack/nova/nova/utils.py", line 664, in context_wrapper
Nov 08 03:53:08 user nova-compute[75014]:     return func(*args, **kwargs)
Nov 08 03:53:08 user nova-compute[75014]:   File "/opt/stack/nova/nova/compute/manager.py", line 2002, in _allocate_network_async
Nov 08 03:53:08 user nova-compute[75014]:     raise e
Nov 08 03:53:08 user nova-compute[75014]:   File "/opt/stack/nova/nova/compute/manager.py", line 1980, in _allocate_network_async
Nov 08 03:53:08 user nova-compute[75014]:     nwinfo = self.network_api.allocate_for_instance(
Nov 08 03:53:08 user nova-compute[75014]:   File "/opt/stack/nova/nova/network/neutron.py", line 1182, in allocate_for_instance
Nov 08 03:53:08 user nova-compute[75014]:     self._validate_requested_port_ids(
Nov 08 03:53:08 user nova-compute[75014]:   File "/opt/stack/nova/nova/network/neutron.py", line 770, in _validate_requested_port_ids
Nov 08 03:53:08 user nova-compute[75014]:     port = self._show_port(context, request.port_id,
Nov 08 03:53:08 user nova-compute[75014]:   File "/opt/stack/nova/nova/network/neutron.py", line 1978, in _show_port
Nov 08 03:53:08 user nova-compute[75014]:     raise exception.PortNotFound(port_id=port_id)
Nov 08 03:53:08 user nova-compute[75014]: nova.exception.PortNotFound: Port id 2385bd9b-063b-4ba7-b80a-4910985bf841 could not be found.
Nov 08 03:53:08 user nova-compute[75014]: Removing descriptor: 18
Nov 08 03:53:08 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 03:53:08 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 03:53:08 user nova-compute[75014]:   <source dev="/dev/sdc"/>
Nov 08 03:53:08 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 03:53:08 user nova-compute[75014]:   <serial>1d1b9670-e6ea-4dce-a6f6-d0c3a519a501</serial>
Nov 08 03:53:08 user nova-compute[75014]: </disk>
Nov 08 03:53:08 user nova-compute[75014]:  {{(pid=75014) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 03:53:08 user nova-compute[75014]: INFO nova.virt.block_device [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Booting with volume 50adc3d1-c482-4040-8bd2-e107a25dae7a at /dev/vda
Nov 08 03:53:08 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:53:08 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:53:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:08 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 03:53:08 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 03:53:08 user nova-compute[75014]: DEBUG nova.network.neutron [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 03:53:08 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 03:53:08 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:53:08 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:53:08 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] No VIF found with MAC fa:16:3e:66:a0:f5, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:53:08 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 03:53:09 user nova-compute[75014]: DEBUG nova.policy [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '630b9ba8f1d9471f9cea51f74106381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a182cdeb8543fea1ab24326734991e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 03:53:09 user nova-compute[75014]: INFO nova.virt.block_device [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Booting with blank volume at /dev/vda
Nov 08 03:53:09 user nova-compute[75014]: DEBUG nova.network.neutron [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Successfully created port: c9034975-100d-4ca6-b1dd-c39ea788e2d3 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 03:53:10 user nova-compute[75014]: DEBUG nova.network.neutron [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Successfully updated port: c9034975-100d-4ca6-b1dd-c39ea788e2d3 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 03:53:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "refresh_cache-655fe5eb-1271-4b9f-a5a6-6342bd012a69" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:53:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquired lock "refresh_cache-655fe5eb-1271-4b9f-a5a6-6342bd012a69" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:53:10 user nova-compute[75014]: DEBUG nova.network.neutron [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 03:53:10 user nova-compute[75014]: DEBUG nova.compute.manager [req-f6ee00ee-4277-42bc-bc8d-d6c595a6f618 req-91f30473-1ac4-4082-a522-7bd359200a6f service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Received event network-changed-c9034975-100d-4ca6-b1dd-c39ea788e2d3 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:53:10 user nova-compute[75014]: DEBUG nova.compute.manager [req-f6ee00ee-4277-42bc-bc8d-d6c595a6f618 req-91f30473-1ac4-4082-a522-7bd359200a6f service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Refreshing instance network info cache due to event network-changed-c9034975-100d-4ca6-b1dd-c39ea788e2d3. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:53:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f6ee00ee-4277-42bc-bc8d-d6c595a6f618 req-91f30473-1ac4-4082-a522-7bd359200a6f service nova] Acquiring lock "refresh_cache-655fe5eb-1271-4b9f-a5a6-6342bd012a69" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:53:10 user nova-compute[75014]: DEBUG nova.network.neutron [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 03:53:10 user nova-compute[75014]: DEBUG nova.network.neutron [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Updating instance_info_cache with network_info: [{"id": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "address": "fa:16:3e:65:33:45", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9034975-10", "ovs_interfaceid": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:53:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Releasing lock "refresh_cache-655fe5eb-1271-4b9f-a5a6-6342bd012a69" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:53:10 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Instance network_info: |[{"id": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "address": "fa:16:3e:65:33:45", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9034975-10", "ovs_interfaceid": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 03:53:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f6ee00ee-4277-42bc-bc8d-d6c595a6f618 req-91f30473-1ac4-4082-a522-7bd359200a6f service nova] Acquired lock "refresh_cache-655fe5eb-1271-4b9f-a5a6-6342bd012a69" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:53:10 user nova-compute[75014]: DEBUG nova.network.neutron [req-f6ee00ee-4277-42bc-bc8d-d6c595a6f618 req-91f30473-1ac4-4082-a522-7bd359200a6f service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Refreshing network info cache for port c9034975-100d-4ca6-b1dd-c39ea788e2d3 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:53:11 user nova-compute[75014]: DEBUG nova.network.neutron [req-f6ee00ee-4277-42bc-bc8d-d6c595a6f618 req-91f30473-1ac4-4082-a522-7bd359200a6f service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Updated VIF entry in instance network info cache for port c9034975-100d-4ca6-b1dd-c39ea788e2d3. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:53:11 user nova-compute[75014]: DEBUG nova.network.neutron [req-f6ee00ee-4277-42bc-bc8d-d6c595a6f618 req-91f30473-1ac4-4082-a522-7bd359200a6f service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Updating instance_info_cache with network_info: [{"id": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "address": "fa:16:3e:65:33:45", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9034975-10", "ovs_interfaceid": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:53:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f6ee00ee-4277-42bc-bc8d-d6c595a6f618 req-91f30473-1ac4-4082-a522-7bd359200a6f service nova] Releasing lock "refresh_cache-655fe5eb-1271-4b9f-a5a6-6342bd012a69" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:53:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:20 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:27 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:53:27 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:53:27 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:53:27 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 03:53:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-8527ee40-fb8a-469b-9696-d7bde8cc96f7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:53:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-8527ee40-fb8a-469b-9696-d7bde8cc96f7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:53:27 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 03:53:27 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Updating instance_info_cache with network_info: [{"id": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "address": "fa:16:3e:eb:34:b6", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa428a2cb-5b", "ovs_interfaceid": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:53:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-8527ee40-fb8a-469b-9696-d7bde8cc96f7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:53:27 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 03:53:27 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:53:27 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:53:27 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:53:27 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:53:27 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:53:27 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:53:27 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 03:53:27 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:53:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:27 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 03:53:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30cf3d8d-a9e0-4b67-b2df-fafaeb616e89/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30cf3d8d-a9e0-4b67-b2df-fafaeb616e89/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30cf3d8d-a9e0-4b67-b2df-fafaeb616e89/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30cf3d8d-a9e0-4b67-b2df-fafaeb616e89/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:29 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 03:53:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:29 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 03:53:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dtEWpzcJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:53:30 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 03:53:30 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:53:30 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 03:53:30 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:53:30 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bf1505-3098-430b-b501-2b734533f994]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 03:53:30 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43fa3c9-7fa4-41f3-b916-da33c2576105]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3] added
Nov 08 03:53:30 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bde94ff-48ec-4216-ae06-36eaa04e0483]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b2f18a-79fa-4829-8c98-18363aa336ca]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dtEWpzcJ {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dtEWpzcJ" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdb0e8c-0dec-4e20-9e41-094dce9bb9ea]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dtEWpzcJ'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ad86a6-3c9e-4fe4-bc60-465c3e13a2ed]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b01ef8-b4ba-4229-963a-4fdf57765e09]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 (non-flash)
Nov 08 03:53:30 user nova-compute[75014]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)
Nov 08 03:53:30 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 (non-flash)
Nov 08 03:53:30 user nova-compute[75014]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)
Nov 08 03:53:30 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc0c448-87b1-429b-a3a8-79665d6229e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3, portal: 172.16.0.220,3260]
Nov 08 03:53:30 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3, portal: 172.16.0.220,3260] successful.
Nov 08 03:53:30 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-91cee948-a519-4a18-a787-cc658ddcd074 tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Lock "30cf3d8d-a9e0-4b67-b2df-fafaeb616e89" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 126.496s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cce929-18a3-4030-8cda-1fc5ddb3d4d2]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d78e88-0a95-482b-9661-8dda544352d1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 (non-flash)
Nov 08 03:53:30 user nova-compute[75014]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)
Nov 08 03:53:30 user nova-compute[75014]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 (non-flash)
Nov 08 03:53:30 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 (non-flash)
Nov 08 03:53:30 user nova-compute[75014]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)
Nov 08 03:53:30 user nova-compute[75014]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 (non-flash)
Nov 08 03:53:30 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3d78e9c1-d198-470e-a140-fb0aac34af8a tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "7dd0e158-473f-4785-a5cf-a75b2da85b29" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 107.046s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc15ff5-64f1-4738-a98b-9c78116c1409]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dtEWpzcJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1b2d30c3-84ff-427e-b6b1-22239223c4d0 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Acquiring lock "0f326d33-802d-4a4a-b2a2-a01b0fef36b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1b2d30c3-84ff-427e-b6b1-22239223c4d0 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Lock "0f326d33-802d-4a4a-b2a2-a01b0fef36b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1b2d30c3-84ff-427e-b6b1-22239223c4d0 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Acquiring lock "0f326d33-802d-4a4a-b2a2-a01b0fef36b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1b2d30c3-84ff-427e-b6b1-22239223c4d0 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Lock "0f326d33-802d-4a4a-b2a2-a01b0fef36b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1b2d30c3-84ff-427e-b6b1-22239223c4d0 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Lock "0f326d33-802d-4a4a-b2a2-a01b0fef36b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:30 user nova-compute[75014]: INFO nova.compute.manager [None req-1b2d30c3-84ff-427e-b6b1-22239223c4d0 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Terminating instance
Nov 08 03:53:30 user nova-compute[75014]: DEBUG nova.compute.manager [None req-1b2d30c3-84ff-427e-b6b1-22239223c4d0 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG nova.compute.manager [req-5592bb69-d52b-4972-ae7f-ba451dfe7077 req-9872694b-6745-4ad3-8b77-4f6fecd1f73c service nova] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Received event network-vif-unplugged-6a4fe909-e328-4b38-b695-6c555e1dd6d5 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5592bb69-d52b-4972-ae7f-ba451dfe7077 req-9872694b-6745-4ad3-8b77-4f6fecd1f73c service nova] Acquiring lock "0f326d33-802d-4a4a-b2a2-a01b0fef36b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5592bb69-d52b-4972-ae7f-ba451dfe7077 req-9872694b-6745-4ad3-8b77-4f6fecd1f73c service nova] Lock "0f326d33-802d-4a4a-b2a2-a01b0fef36b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5592bb69-d52b-4972-ae7f-ba451dfe7077 req-9872694b-6745-4ad3-8b77-4f6fecd1f73c service nova] Lock "0f326d33-802d-4a4a-b2a2-a01b0fef36b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG nova.compute.manager [req-5592bb69-d52b-4972-ae7f-ba451dfe7077 req-9872694b-6745-4ad3-8b77-4f6fecd1f73c service nova] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] No waiting events found dispatching network-vif-unplugged-6a4fe909-e328-4b38-b695-6c555e1dd6d5 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG nova.compute.manager [req-5592bb69-d52b-4972-ae7f-ba451dfe7077 req-9872694b-6745-4ad3-8b77-4f6fecd1f73c service nova] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Received event network-vif-unplugged-6a4fe909-e328-4b38-b695-6c555e1dd6d5 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f326d33-802d-4a4a-b2a2-a01b0fef36b4/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG os_brick.utils [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c935c80-bd3b-47e2-9898-e1c641463b84]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.039s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a393ce46-c510-4497-92f4-716695de0946]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2353dd5a-515a-4653-a85b-c965ea3e1fd7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5513a434-44b2-49b2-942d-86307d571ea1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f326d33-802d-4a4a-b2a2-a01b0fef36b4/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f326d33-802d-4a4a-b2a2-a01b0fef36b4/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 03:53:31 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 03:53:31 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[74456fae-96d1-46bb-a3a2-84db56a7edbe]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG os_brick.utils [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] <== get_connector_properties: return (201ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Updating existing volume attachment record: 88fd1439-51f6-4b02-8009-ccc31320ab4a {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:31 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Instance destroyed successfully.
Nov 08 03:53:31 user nova-compute[75014]: DEBUG nova.objects.instance [None req-1b2d30c3-84ff-427e-b6b1-22239223c4d0 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Lazy-loading 'resources' on Instance uuid 0f326d33-802d-4a4a-b2a2-a01b0fef36b4 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-1b2d30c3-84ff-427e-b6b1-22239223c4d0 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2010445402',display_name='tempest-VolumesAssistedSnapshotsTest-server-2010445402',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2010445402',id=9,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+mESUz7g5auSz/9ZrPmvghEK/t4hSSw9Fs5/O+xQ74YjhSRZfXgtbrcBXqgDizauIEZ8FiY7AQCrNUqWlq5h2NlsJUptM41Nw4t9aov1vG71t8Sf8Dm0A1a+OpgIJCdQ==',key_name='tempest-keypair-1668063',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:50:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d700a10920a240f5ba41ed032321e972',ramdisk_id='',reservation_id='r-anb4ateo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-519860353',owner_user_name='tempest-VolumesAssistedSnapshotsTest-519860353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T03:50:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a5ffc25af624536989c4330a0c579ee',uuid=0f326d33-802d-4a4a-b2a2-a01b0fef36b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a4fe909-e328-4b38-b695-6c555e1dd6d5", "address": "fa:16:3e:12:02:8b", "network": {"id": "70074778-610f-4741-b871-65e344ac3986", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-298546593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a10920a240f5ba41ed032321e972", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4fe909-e3", "ovs_interfaceid": "6a4fe909-e328-4b38-b695-6c555e1dd6d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-1b2d30c3-84ff-427e-b6b1-22239223c4d0 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Converting VIF {"id": "6a4fe909-e328-4b38-b695-6c555e1dd6d5", "address": "fa:16:3e:12:02:8b", "network": {"id": "70074778-610f-4741-b871-65e344ac3986", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-298546593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a10920a240f5ba41ed032321e972", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4fe909-e3", "ovs_interfaceid": "6a4fe909-e328-4b38-b695-6c555e1dd6d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-1b2d30c3-84ff-427e-b6b1-22239223c4d0 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:02:8b,bridge_name='br-int',has_traffic_filtering=True,id=6a4fe909-e328-4b38-b695-6c555e1dd6d5,network=Network(70074778-610f-4741-b871-65e344ac3986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4fe909-e3') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG os_vif [None req-1b2d30c3-84ff-427e-b6b1-22239223c4d0 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:02:8b,bridge_name='br-int',has_traffic_filtering=True,id=6a4fe909-e328-4b38-b695-6c555e1dd6d5,network=Network(70074778-610f-4741-b871-65e344ac3986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4fe909-e3') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a4fe909-e3, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f326d33-802d-4a4a-b2a2-a01b0fef36b4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6c99a399-50c1-4bbb-9cea-764347d06873) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:53:31 user nova-compute[75014]: INFO os_vif [None req-1b2d30c3-84ff-427e-b6b1-22239223c4d0 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:02:8b,bridge_name='br-int',has_traffic_filtering=True,id=6a4fe909-e328-4b38-b695-6c555e1dd6d5,network=Network(70074778-610f-4741-b871-65e344ac3986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4fe909-e3')
Nov 08 03:53:31 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-1b2d30c3-84ff-427e-b6b1-22239223c4d0 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Deleting instance files /opt/stack/data/nova/instances/0f326d33-802d-4a4a-b2a2-a01b0fef36b4_del
Nov 08 03:53:31 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-1b2d30c3-84ff-427e-b6b1-22239223c4d0 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Deletion of /opt/stack/data/nova/instances/0f326d33-802d-4a4a-b2a2-a01b0fef36b4_del complete
Nov 08 03:53:32 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.052s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] <== connect_volume: return (2054ms) {'type': 'block', 'scsi_wwn': '23930303935326533', 'path': '/dev/sdd'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930303935326533', 'path': '/dev/sdd'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 03:53:32 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:53:32 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=8081MB free_disk=25.299903869628906GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:32 user nova-compute[75014]: INFO nova.compute.manager [None req-1b2d30c3-84ff-427e-b6b1-22239223c4d0 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Took 1.62 seconds to destroy the instance on the hypervisor.
Nov 08 03:53:32 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-1b2d30c3-84ff-427e-b6b1-22239223c4d0 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Acquiring lock "30cf3d8d-a9e0-4b67-b2df-fafaeb616e89" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Lock "30cf3d8d-a9e0-4b67-b2df-fafaeb616e89" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Acquiring lock "30cf3d8d-a9e0-4b67-b2df-fafaeb616e89-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Lock "30cf3d8d-a9e0-4b67-b2df-fafaeb616e89-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Lock "30cf3d8d-a9e0-4b67-b2df-fafaeb616e89-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:32 user nova-compute[75014]: INFO nova.compute.manager [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Terminating instance
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.objects.instance [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lazy-loading 'flavor' on Instance uuid 8a8d9f3c-1150-4306-8dc6-eedde92c7a35 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.compute.manager [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 03:53:32 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 03:53:32 user nova-compute[75014]:   <source dev="/dev/sdd"/>
Nov 08 03:53:32 user nova-compute[75014]:   <target dev="sdc" bus="scsi"/>
Nov 08 03:53:32 user nova-compute[75014]:   <serial>0c07f126-e11e-4778-a39d-a115ec717bc3</serial>
Nov 08 03:53:32 user nova-compute[75014]:   <address type="drive" controller="0" unit="2"/>
Nov 08 03:53:32 user nova-compute[75014]: </disk>
Nov 08 03:53:32 user nova-compute[75014]:  {{(pid=75014) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9f205fe5-576f-4ef0-874b-1544c0307a7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 5bfa6580-e0fe-46b0-b497-8db67806113a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 8527ee40-fb8a-469b-9696-d7bde8cc96f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 8a8d9f3c-1150-4306-8dc6-eedde92c7a35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 7dd0e158-473f-4785-a5cf-a75b2da85b29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 2ab81192-8890-499c-ad4b-b93664da45fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 0f326d33-802d-4a4a-b2a2-a01b0fef36b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance e8eb4171-aa3d-48bd-90e1-dc371da7a77b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 655fe5eb-1271-4b9f-a5a6-6342bd012a69 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.compute.manager [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 03:53:32 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Creating image(s)
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Did not create local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Ensure instance console log exists: /opt/stack/data/nova/instances/e8eb4171-aa3d-48bd-90e1-dc371da7a77b/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Start _get_guest_xml network_info=[{"id": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "address": "fa:16:3e:e7:72:75", "network": {"id": "f0d5c3f6-95de-4bae-8891-ecf46615f6e0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2062952809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b161cc-78", "ovs_interfaceid": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "address": "fa:16:3e:d1:7b:69", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865f50bd-f6", "ovs_interfaceid": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "address": "fa:16:3e:83:47:72", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea5c8c-9b", "ovs_interfaceid": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1bf169f7-c039-4b88-a7de-3da18a368b14", "address": "fa:16:3e:66:75:a0", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf169f7-c0", "ovs_interfaceid": "1bf169f7-c039-4b88-a7de-3da18a368b14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e", "address": "fa:16:3e:bf:c2:75", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca24a270-f9", "ovs_interfaceid": "ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3e63c197-4437-4b03-82c9-a570406f7d38", "address": "fa:16:3e:6b:d2:09", "network": {"id": "dc41b474-59dc-43ae-9724-45c03cddae19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495507142", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e63c197-44", "ovs_interfaceid": "3e63c197-4437-4b03-82c9-a570406f7d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef47ac6e-fbd7-47f6-bb62-1d2e1d155179", "address": "fa:16:3e:a8:c1:6a", "network": {"id": "dc41b474-59dc-43ae-9724-45c03cddae19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495507142", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef47ac6e-fb", "ovs_interfaceid": "ef47ac6e-fbd7-47f6-bb62-1d2e1d155179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OcfkZBto', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e8eb4171-aa3d-48bd-90e1-dc371da7a77b', 'attached_at': '', 'detached_at': '', 'volume_id': '2582dcd2-17c6-4521-b955-cafb600221ad', 'serial': '2582dcd2-17c6-4521-b955-cafb600221ad'}, 'device_type': 'disk', 'attachment_id': '8f26c943-999a-40d5-a04d-56aa30461de0', 'disk_bus': 'virtio', 'volume_type': None}, {'guest_format': None, 'boot_index': 1, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MNzlYxJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e8eb4171-aa3d-48bd-90e1-dc371da7a77b', 'attached_at': '', 'detached_at': '', 'volume_id': '915cfc8b-84fe-49c9-b514-353b6cf4578d', 'serial': '915cfc8b-84fe-49c9-b514-353b6cf4578d'}, 'device_type': 'disk', 'attachment_id': '6a162d69-e548-489a-bd10-cfc90ae7a83a', 'disk_bus': 'virtio', 'volume_type': None}, {'guest_format': None, 'boot_index': 2, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uyoKSREC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e8eb4171-aa3d-48bd-90e1-dc371da7a77b', 'attached_at': '', 'detached_at': '', 'volume_id': '3140f712-f683-4bd3-937a-aa1fe47ca9f4', 'serial': '3140f712-f683-4bd3-937a-aa1fe47ca9f4'}, 'device_type': 'disk', 'attachment_id': '0ca0cdbd-a449-4426-99bc-ce130d0c295c', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 03:53:32 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:53:32 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OcfkZBto', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:53:32 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 03:53:32 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:53:32 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 03:53:32 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:53:32 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 03:53:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f920a63e-b186-49eb-b54a-6175e349a264]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 03:53:32 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[83aa825b-df99-4672-a324-91146b077bbe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad] added
Nov 08 03:53:32 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.compute.manager [req-d56356c6-f97d-4e77-9bdf-bbc3e4d87213 req-089537dc-b731-464b-90b7-19a9a05f8e95 service nova] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Received event network-vif-unplugged-5ccfbc09-b908-4eb3-9521-31289eb0641f {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d56356c6-f97d-4e77-9bdf-bbc3e4d87213 req-089537dc-b731-464b-90b7-19a9a05f8e95 service nova] Acquiring lock "30cf3d8d-a9e0-4b67-b2df-fafaeb616e89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d56356c6-f97d-4e77-9bdf-bbc3e4d87213 req-089537dc-b731-464b-90b7-19a9a05f8e95 service nova] Lock "30cf3d8d-a9e0-4b67-b2df-fafaeb616e89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d56356c6-f97d-4e77-9bdf-bbc3e4d87213 req-089537dc-b731-464b-90b7-19a9a05f8e95 service nova] Lock "30cf3d8d-a9e0-4b67-b2df-fafaeb616e89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.compute.manager [req-d56356c6-f97d-4e77-9bdf-bbc3e4d87213 req-089537dc-b731-464b-90b7-19a9a05f8e95 service nova] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] No waiting events found dispatching network-vif-unplugged-5ccfbc09-b908-4eb3-9521-31289eb0641f {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.compute.manager [req-d56356c6-f97d-4e77-9bdf-bbc3e4d87213 req-089537dc-b731-464b-90b7-19a9a05f8e95 service nova] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Received event network-vif-unplugged-5ccfbc09-b908-4eb3-9521-31289eb0641f for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb67530b-605a-4fd5-b9c6-272e6955f401]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f12a21-8efd-4687-b21b-2542941d385d]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OcfkZBto {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] No BDM found with device name sda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] No VIF found with MAC fa:16:3e:c3:48:cb, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OcfkZBto" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:32 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[219f351e-0b2d-4e0f-b308-ac8d28af9156]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OcfkZBto'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.037s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7570a1bc-dcc4-46fe-8b61-afd7599a67f3]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e847ee83-88b4-4f2c-a1bd-7286ded0cb6d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 (non-flash)
Nov 08 03:53:33 user nova-compute[75014]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)
Nov 08 03:53:33 user nova-compute[75014]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 (non-flash)
Nov 08 03:53:33 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 (non-flash)
Nov 08 03:53:33 user nova-compute[75014]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)
Nov 08 03:53:33 user nova-compute[75014]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 (non-flash)
Nov 08 03:53:33 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG nova.compute.manager [req-cf0a86f2-7682-49af-9116-13faffbb38d6 req-4e8dc833-dcac-4d34-a49c-026f0dd2aa30 service nova] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Received event network-vif-plugged-6a4fe909-e328-4b38-b695-6c555e1dd6d5 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-cf0a86f2-7682-49af-9116-13faffbb38d6 req-4e8dc833-dcac-4d34-a49c-026f0dd2aa30 service nova] Acquiring lock "0f326d33-802d-4a4a-b2a2-a01b0fef36b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-cf0a86f2-7682-49af-9116-13faffbb38d6 req-4e8dc833-dcac-4d34-a49c-026f0dd2aa30 service nova] Lock "0f326d33-802d-4a4a-b2a2-a01b0fef36b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-cf0a86f2-7682-49af-9116-13faffbb38d6 req-4e8dc833-dcac-4d34-a49c-026f0dd2aa30 service nova] Lock "0f326d33-802d-4a4a-b2a2-a01b0fef36b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG nova.compute.manager [req-cf0a86f2-7682-49af-9116-13faffbb38d6 req-4e8dc833-dcac-4d34-a49c-026f0dd2aa30 service nova] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] No waiting events found dispatching network-vif-plugged-6a4fe909-e328-4b38-b695-6c555e1dd6d5 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:53:33 user nova-compute[75014]: WARNING nova.compute.manager [req-cf0a86f2-7682-49af-9116-13faffbb38d6 req-4e8dc833-dcac-4d34-a49c-026f0dd2aa30 service nova] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Received unexpected event network-vif-plugged-6a4fe909-e328-4b38-b695-6c555e1dd6d5 for instance with vm_state active and task_state deleting.
Nov 08 03:53:33 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Instance destroyed successfully.
Nov 08 03:53:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70d9b14-9c60-4d33-9b4c-72dc32d39b74]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG nova.objects.instance [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Lazy-loading 'resources' on Instance uuid 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Acquiring lock "7dd0e158-473f-4785-a5cf-a75b2da85b29" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "7dd0e158-473f-4785-a5cf-a75b2da85b29" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad, portal: 172.16.0.220,3260]
Nov 08 03:53:33 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad, portal: 172.16.0.220,3260] successful.
Nov 08 03:53:33 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:49:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1623520668',display_name='tempest-DeleteServersTestJSON-server-1623520668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1623520668',id=3,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:49:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dfa81674e9c2471e832ef12631f63abd',ramdisk_id='',reservation_id='r-yd19wts5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-219748252',owner_user_name='tempest-DeleteServersTestJSON-219748252-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T03:49:47Z,user_data=None,user_id='fb188835ab5c400ab9db33fd38e31920',uuid=30cf3d8d-a9e0-4b67-b2df-fafaeb616e89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ccfbc09-b908-4eb3-9521-31289eb0641f", "address": "fa:16:3e:d7:ed:d9", "network": {"id": "a8fa201e-8062-45a0-9403-bf153b0c406f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1481531992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa81674e9c2471e832ef12631f63abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccfbc09-b9", "ovs_interfaceid": "5ccfbc09-b908-4eb3-9521-31289eb0641f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Converting VIF {"id": "5ccfbc09-b908-4eb3-9521-31289eb0641f", "address": "fa:16:3e:d7:ed:d9", "network": {"id": "a8fa201e-8062-45a0-9403-bf153b0c406f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1481531992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa81674e9c2471e832ef12631f63abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccfbc09-b9", "ovs_interfaceid": "5ccfbc09-b908-4eb3-9521-31289eb0641f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:ed:d9,bridge_name='br-int',has_traffic_filtering=True,id=5ccfbc09-b908-4eb3-9521-31289eb0641f,network=Network(a8fa201e-8062-45a0-9403-bf153b0c406f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccfbc09-b9') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG os_vif [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:ed:d9,bridge_name='br-int',has_traffic_filtering=True,id=5ccfbc09-b908-4eb3-9521-31289eb0641f,network=Network(a8fa201e-8062-45a0-9403-bf153b0c406f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccfbc09-b9') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 03:53:33 user nova-compute[75014]: INFO nova.compute.manager [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Detaching volume 1d1b9670-e6ea-4dce-a6f6-d0c3a519a501
Nov 08 03:53:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ccfbc09-b9, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37c39c2-8cc4-440d-89d7-914f8db9780b]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7db61505-6e80-449f-8380-9f8a08841d82) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:33 user nova-compute[75014]: INFO os_vif [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:ed:d9,bridge_name='br-int',has_traffic_filtering=True,id=5ccfbc09-b908-4eb3-9521-31289eb0641f,network=Network(a8fa201e-8062-45a0-9403-bf153b0c406f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccfbc09-b9')
Nov 08 03:53:33 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHagxOEM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:53:33 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 03:53:33 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9703891-cc1b-430d-aceb-14c98f5acde6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 (non-flash)
Nov 08 03:53:33 user nova-compute[75014]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)
Nov 08 03:53:33 user nova-compute[75014]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 (non-flash)
Nov 08 03:53:33 user nova-compute[75014]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)
Nov 08 03:53:33 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 (non-flash)
Nov 08 03:53:33 user nova-compute[75014]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)
Nov 08 03:53:33 user nova-compute[75014]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 (non-flash)
Nov 08 03:53:33 user nova-compute[75014]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)
Nov 08 03:53:33 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.451s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5ab53bde-aa21-4b8c-83a8-e7e377bf3438 tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lock "8a8d9f3c-1150-4306-8dc6-eedde92c7a35" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 99.986s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce14bfc6-cd7f-4142-a737-8507afc32466]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OcfkZBto', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.012s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:33 user nova-compute[75014]: INFO nova.virt.block_device [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Attempting to driver detach volume 1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 from mountpoint /dev/vdb
Nov 08 03:53:33 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Attempting to detach device vdb from instance 7dd0e158-473f-4785-a5cf-a75b2da85b29 from the persistent domain config. {{(pid=75014) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 03:53:33 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 03:53:33 user nova-compute[75014]:   <source dev="/dev/sdc"/>
Nov 08 03:53:33 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 03:53:33 user nova-compute[75014]:   <serial>1d1b9670-e6ea-4dce-a6f6-d0c3a519a501</serial>
Nov 08 03:53:33 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 03:53:33 user nova-compute[75014]: </disk>
Nov 08 03:53:33 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 03:53:33 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Successfully detached device vdb from instance 7dd0e158-473f-4785-a5cf-a75b2da85b29 from the persistent domain config.
Nov 08 03:53:33 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7dd0e158-473f-4785-a5cf-a75b2da85b29 from the live domain config. {{(pid=75014) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 03:53:33 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 03:53:33 user nova-compute[75014]:   <source dev="/dev/sdc"/>
Nov 08 03:53:33 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 03:53:33 user nova-compute[75014]:   <serial>1d1b9670-e6ea-4dce-a6f6-d0c3a519a501</serial>
Nov 08 03:53:33 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 03:53:33 user nova-compute[75014]: </disk>
Nov 08 03:53:33 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7dd0e158-473f-4785-a5cf-a75b2da85b29 {{(pid=75014) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 03:53:33 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Took 1.57 seconds to deallocate network for instance.
Nov 08 03:53:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1b2d30c3-84ff-427e-b6b1-22239223c4d0 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1b2d30c3-84ff-427e-b6b1-22239223c4d0 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.510s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] <== connect_volume: return (1512ms) {'type': 'block', 'scsi_wwn': '23564313163633963', 'path': '/dev/sde'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564313163633963', 'path': '/dev/sde'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.078s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbe5c80-4f95-4117-a090-4732e1655b0b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 03:53:34 user nova-compute[75014]: No targets found.
Nov 08 03:53:34 user nova-compute[75014]: iSNS:
Nov 08 03:53:34 user nova-compute[75014]: No targets found.
Nov 08 03:53:34 user nova-compute[75014]: STATIC:
Nov 08 03:53:34 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3
Nov 08 03:53:34 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:53:34 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:53:34 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad
Nov 08 03:53:34 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:53:34 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:53:34 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501
Nov 08 03:53:34 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:53:34 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:53:34 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3
Nov 08 03:53:34 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:53:34 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:53:34 user nova-compute[75014]: FIRMWARE:
Nov 08 03:53:34 user nova-compute[75014]: No targets found.
Nov 08 03:53:34 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 03:53:34 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 03:53:34 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b223f0-4da0-49ef-81ad-fb41b4ce31d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MNzlYxJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:53:34 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 03:53:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b26ee72-fa1a-4588-af5b-80250047750c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 (non-flash)
Nov 08 03:53:34 user nova-compute[75014]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)
Nov 08 03:53:34 user nova-compute[75014]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 (non-flash)
Nov 08 03:53:34 user nova-compute[75014]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)
Nov 08 03:53:34 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 (non-flash)
Nov 08 03:53:34 user nova-compute[75014]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)
Nov 08 03:53:34 user nova-compute[75014]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 (non-flash)
Nov 08 03:53:34 user nova-compute[75014]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)
Nov 08 03:53:34 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0400744430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3'): ({'sdb'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Removing single pathed devices sdb {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Acquiring lock "8a8d9f3c-1150-4306-8dc6-eedde92c7a35" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lock "8a8d9f3c-1150-4306-8dc6-eedde92c7a35" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6dff0cf-c21b-4937-a915-7ceb192f5429]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:34 user nova-compute[75014]: INFO nova.compute.manager [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Detaching volume 0c07f126-e11e-4778-a39d-a115ec717bc3
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[875e88fa-6d70-4e4a-9c96-3daa66e8bb15]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Flushing IO for device /dev/sdb {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb53b7f1-d8c3-4fd4-bc45-51ee253271fc]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-1b2d30c3-84ff-427e-b6b1-22239223c4d0 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-1b2d30c3-84ff-427e-b6b1-22239223c4d0 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3daf9c-d23f-46fa-94bc-db53b5eff6c4]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] SCSI volumes sdb have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1b2d30c3-84ff-427e-b6b1-22239223c4d0 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.669s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9992545-262a-4043-9820-91343c5f0e4e]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:34 user nova-compute[75014]: INFO nova.virt.block_device [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Attempting to driver detach volume 0c07f126-e11e-4778-a39d-a115ec717bc3 from mountpoint /dev/sdc
Nov 08 03:53:34 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-1b2d30c3-84ff-427e-b6b1-22239223c4d0 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Deleted allocations for instance 0f326d33-802d-4a4a-b2a2-a01b0fef36b4
Nov 08 03:53:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Attempting to detach device sdc from instance 8a8d9f3c-1150-4306-8dc6-eedde92c7a35 from the persistent domain config. {{(pid=75014) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 03:53:34 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 03:53:34 user nova-compute[75014]:   <source dev="/dev/sdd"/>
Nov 08 03:53:34 user nova-compute[75014]:   <target dev="sdc" bus="scsi"/>
Nov 08 03:53:34 user nova-compute[75014]:   <serial>0c07f126-e11e-4778-a39d-a115ec717bc3</serial>
Nov 08 03:53:34 user nova-compute[75014]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 08 03:53:34 user nova-compute[75014]: </disk>
Nov 08 03:53:34 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 03:53:34 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Successfully detached device sdc from instance 8a8d9f3c-1150-4306-8dc6-eedde92c7a35 from the persistent domain config.
Nov 08 03:53:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 8a8d9f3c-1150-4306-8dc6-eedde92c7a35 from the live domain config. {{(pid=75014) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 03:53:34 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 03:53:34 user nova-compute[75014]:   <source dev="/dev/sdd"/>
Nov 08 03:53:34 user nova-compute[75014]:   <target dev="sdc" bus="scsi"/>
Nov 08 03:53:34 user nova-compute[75014]:   <serial>0c07f126-e11e-4778-a39d-a115ec717bc3</serial>
Nov 08 03:53:34 user nova-compute[75014]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 08 03:53:34 user nova-compute[75014]: </disk>
Nov 08 03:53:34 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ad8264-9777-4d87-bfbd-5fa30a5143d0]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3, portal: 172.16.0.220,3260]
Nov 08 03:53:34 user nova-compute[75014]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3, portal: 172.16.0.220,3260] successful.
Nov 08 03:53:34 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6106b11-5f08-4f3b-867b-081da414cda3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[03db7779-1bf8-4f68-a40e-63c4ca811e4f]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.452s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] <== disconnect_volume: return (1529ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 03:53:34 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Deleting instance files /opt/stack/data/nova/instances/30cf3d8d-a9e0-4b67-b2df-fafaeb616e89_del
Nov 08 03:53:34 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Deletion of /opt/stack/data/nova/instances/30cf3d8d-a9e0-4b67-b2df-fafaeb616e89_del complete
Nov 08 03:53:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.300s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:53:34 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 03:53:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:53:34 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1b2d30c3-84ff-427e-b6b1-22239223c4d0 tempest-VolumesAssistedSnapshotsTest-519860353 tempest-VolumesAssistedSnapshotsTest-519860353-project-member] Lock "0f326d33-802d-4a4a-b2a2-a01b0fef36b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.100s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[86637093-961b-4467-9200-dc8b767788ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 03:53:34 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b2b456-c2bc-46b7-aec6-10cc555d04f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d] added
Nov 08 03:53:34 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:34 user nova-compute[75014]: INFO nova.compute.manager [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Took 2.49 seconds to destroy the instance on the hypervisor.
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5b2a4a-9aff-4bca-ac60-933aa79e65ae]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.060s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a15031-d297-4bd3-ae04-c470e092101b]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MNzlYxJV {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MNzlYxJV" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc47503-8d24-47ab-befa-a500d568e800]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MNzlYxJV'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e078f90-fa7b-4e28-a43d-c3bebb296a23]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG nova.compute.manager [req-a79e49c9-81b8-4acf-bc1b-bffa528496b8 req-5c324d7d-b918-47fd-98cc-2b907d5cdbce service nova] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Received event network-vif-plugged-5ccfbc09-b908-4eb3-9521-31289eb0641f {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a79e49c9-81b8-4acf-bc1b-bffa528496b8 req-5c324d7d-b918-47fd-98cc-2b907d5cdbce service nova] Acquiring lock "30cf3d8d-a9e0-4b67-b2df-fafaeb616e89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a79e49c9-81b8-4acf-bc1b-bffa528496b8 req-5c324d7d-b918-47fd-98cc-2b907d5cdbce service nova] Lock "30cf3d8d-a9e0-4b67-b2df-fafaeb616e89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a79e49c9-81b8-4acf-bc1b-bffa528496b8 req-5c324d7d-b918-47fd-98cc-2b907d5cdbce service nova] Lock "30cf3d8d-a9e0-4b67-b2df-fafaeb616e89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG nova.compute.manager [req-a79e49c9-81b8-4acf-bc1b-bffa528496b8 req-5c324d7d-b918-47fd-98cc-2b907d5cdbce service nova] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] No waiting events found dispatching network-vif-plugged-5ccfbc09-b908-4eb3-9521-31289eb0641f {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:53:35 user nova-compute[75014]: WARNING nova.compute.manager [req-a79e49c9-81b8-4acf-bc1b-bffa528496b8 req-5c324d7d-b918-47fd-98cc-2b907d5cdbce service nova] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Received unexpected event network-vif-plugged-5ccfbc09-b908-4eb3-9521-31289eb0641f for instance with vm_state active and task_state deleting.
Nov 08 03:53:35 user nova-compute[75014]: DEBUG nova.compute.manager [req-a79e49c9-81b8-4acf-bc1b-bffa528496b8 req-5c324d7d-b918-47fd-98cc-2b907d5cdbce service nova] [instance: 0f326d33-802d-4a4a-b2a2-a01b0fef36b4] Received event network-vif-deleted-6a4fe909-e328-4b38-b695-6c555e1dd6d5 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[924329e1-79ca-4804-922b-d9249ee941f8]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)
Nov 08 03:53:35 user nova-compute[75014]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 (non-flash)
Nov 08 03:53:35 user nova-compute[75014]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)
Nov 08 03:53:35 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)
Nov 08 03:53:35 user nova-compute[75014]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 (non-flash)
Nov 08 03:53:35 user nova-compute[75014]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)
Nov 08 03:53:35 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd15c106-0d9c-408b-bee8-da6bfac60fe2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d, portal: 172.16.0.220,3260]
Nov 08 03:53:35 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d, portal: 172.16.0.220,3260] successful.
Nov 08 03:53:35 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 8a8d9f3c-1150-4306-8dc6-eedde92c7a35 {{(pid=75014) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c415120d-47cb-433a-8bcc-124b272ea741]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf47fc4-8b56-4c67-8aa2-c4d1c8adcece]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)
Nov 08 03:53:35 user nova-compute[75014]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 (non-flash)
Nov 08 03:53:35 user nova-compute[75014]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)
Nov 08 03:53:35 user nova-compute[75014]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)
Nov 08 03:53:35 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)
Nov 08 03:53:35 user nova-compute[75014]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 (non-flash)
Nov 08 03:53:35 user nova-compute[75014]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)
Nov 08 03:53:35 user nova-compute[75014]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)
Nov 08 03:53:35 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] HCTL ('33', '-', '-', 0) found on session 6 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[519f7370-bab1-4cbd-b4e2-ae52260b8d36]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Searching for a device in session 6 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MNzlYxJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 03:53:35 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:53:35 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Took 0.55 seconds to deallocate network for instance.
Nov 08 03:53:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] <== connect_volume: return (1715ms) {'type': 'block', 'scsi_wwn': '23332633663333264', 'path': '/dev/sdb'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332633663333264', 'path': '/dev/sdb'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uyoKSREC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:53:36 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 03:53:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:53:36 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 03:53:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:53:36 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 03:53:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1c4ebd-181f-4079-9fd2-6262b961f60d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 03:53:36 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f7938a-7612-4d80-8ec4-454d53fa9de7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4] added
Nov 08 03:53:36 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[52dd42fc-4a4b-4e56-b96e-84aaff7887b9]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a61891-d422-4a26-b8fc-6c2a73ec0e3f]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uyoKSREC {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uyoKSREC" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4cf6dc-174c-44d4-9bed-59e93f827831]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uyoKSREC'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0926d571-7c90-45e3-8b9c-15a62c7b62be]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ace36e-126d-48b8-a1ae-adeef82d0f01]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)
Nov 08 03:53:36 user nova-compute[75014]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 (non-flash)
Nov 08 03:53:36 user nova-compute[75014]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)
Nov 08 03:53:36 user nova-compute[75014]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)
Nov 08 03:53:36 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)
Nov 08 03:53:36 user nova-compute[75014]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 (non-flash)
Nov 08 03:53:36 user nova-compute[75014]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)
Nov 08 03:53:36 user nova-compute[75014]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)
Nov 08 03:53:36 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:36 user nova-compute[75014]: INFO nova.compute.manager [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Took 1.11 seconds to detach 1 volumes for instance.
Nov 08 03:53:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:53:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:37 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Deleted allocations for instance 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89
Nov 08 03:53:37 user nova-compute[75014]: DEBUG nova.compute.manager [req-db9cc266-2099-4f11-907e-df5595046db5 req-00299905-65f8-4624-8ced-2d013c38d2d2 service nova] [instance: 30cf3d8d-a9e0-4b67-b2df-fafaeb616e89] Received event network-vif-deleted-5ccfbc09-b908-4eb3-9521-31289eb0641f {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:53:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2a72132c-666a-44ae-a545-c78935c1b2ee tempest-DeleteServersTestJSON-219748252 tempest-DeleteServersTestJSON-219748252-project-member] Lock "30cf3d8d-a9e0-4b67-b2df-fafaeb616e89" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.751s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 -p 172.16.0.220:3260 --login" returned: 0 in 1.070s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[89725a71-699f-48e1-b07a-aa0cce458aec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4, portal: 172.16.0.220,3260]
Nov 08 03:53:37 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4, portal: 172.16.0.220,3260] successful.
Nov 08 03:53:37 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ae3ccb-9d93-4c2a-b306-98234782c1c2]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b748df2b-a152-4ae6-8a79-bdc6a74fcc1a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)
Nov 08 03:53:37 user nova-compute[75014]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 (non-flash)
Nov 08 03:53:37 user nova-compute[75014]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)
Nov 08 03:53:37 user nova-compute[75014]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)
Nov 08 03:53:37 user nova-compute[75014]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)
Nov 08 03:53:37 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:53:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)
Nov 08 03:53:37 user nova-compute[75014]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 (non-flash)
Nov 08 03:53:37 user nova-compute[75014]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)
Nov 08 03:53:37 user nova-compute[75014]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)
Nov 08 03:53:37 user nova-compute[75014]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)
Nov 08 03:53:37 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:53:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.310s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:53:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 03:53:37 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 03:53:37 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 03:53:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f347ee-d504-4ada-ad1b-1a9cbbdf7bba]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:37 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 03:53:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uyoKSREC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.351s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] <== connect_volume: return (2352ms) {'type': 'block', 'scsi_wwn': '23265393138636232', 'path': '/dev/sdf'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265393138636232', 'path': '/dev/sdf'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1240423537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1240423537',id=10,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMAMUsnsS0BAVlPK/lbZXgX4HwHuisLn+3uma5f8FEdUnJ0NVdubfRUA7pxoNgCgGlRukeGayveJawKOl/Wf1Q+R5tg5uVlLxhvOrUbJo0dZMB0awYHSdF62JBQPRP+5A==',key_name='tempest-keypair-692880222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd6fce809fab44789c36f2981972b5b8',ramdisk_id='',reservation_id='r-5ot67hpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-198201622',owner_user_name='tempest-TaggedBootDevicesTest_v242-198201622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:51:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7a5ed8cff034542baf6697046f9c851',uuid=e8eb4171-aa3d-48bd-90e1-dc371da7a77b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "address": "fa:16:3e:e7:72:75", "network": {"id": "f0d5c3f6-95de-4bae-8891-ecf46615f6e0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2062952809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b161cc-78", "ovs_interfaceid": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converting VIF {"id": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "address": "fa:16:3e:e7:72:75", "network": {"id": "f0d5c3f6-95de-4bae-8891-ecf46615f6e0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2062952809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b161cc-78", "ovs_interfaceid": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:72:75,bridge_name='br-int',has_traffic_filtering=True,id=22b161cc-78f9-43ab-a91f-bdda3cb031fe,network=Network(f0d5c3f6-95de-4bae-8891-ecf46615f6e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b161cc-78') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1240423537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1240423537',id=10,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMAMUsnsS0BAVlPK/lbZXgX4HwHuisLn+3uma5f8FEdUnJ0NVdubfRUA7pxoNgCgGlRukeGayveJawKOl/Wf1Q+R5tg5uVlLxhvOrUbJo0dZMB0awYHSdF62JBQPRP+5A==',key_name='tempest-keypair-692880222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd6fce809fab44789c36f2981972b5b8',ramdisk_id='',reservation_id='r-5ot67hpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-198201622',owner_user_name='tempest-TaggedBootDevicesTest_v242-198201622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:51:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7a5ed8cff034542baf6697046f9c851',uuid=e8eb4171-aa3d-48bd-90e1-dc371da7a77b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "address": "fa:16:3e:d1:7b:69", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865f50bd-f6", "ovs_interfaceid": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converting VIF {"id": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "address": "fa:16:3e:d1:7b:69", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865f50bd-f6", "ovs_interfaceid": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:7b:69,bridge_name='br-int',has_traffic_filtering=True,id=865f50bd-f6c7-45d9-8fd9-807910ccd477,network=Network(8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap865f50bd-f6') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1240423537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1240423537',id=10,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMAMUsnsS0BAVlPK/lbZXgX4HwHuisLn+3uma5f8FEdUnJ0NVdubfRUA7pxoNgCgGlRukeGayveJawKOl/Wf1Q+R5tg5uVlLxhvOrUbJo0dZMB0awYHSdF62JBQPRP+5A==',key_name='tempest-keypair-692880222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd6fce809fab44789c36f2981972b5b8',ramdisk_id='',reservation_id='r-5ot67hpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-198201622',owner_user_name='tempest-TaggedBootDevicesTest_v242-198201622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:51:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7a5ed8cff034542baf6697046f9c851',uuid=e8eb4171-aa3d-48bd-90e1-dc371da7a77b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "address": "fa:16:3e:83:47:72", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea5c8c-9b", "ovs_interfaceid": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converting VIF {"id": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "address": "fa:16:3e:83:47:72", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea5c8c-9b", "ovs_interfaceid": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:47:72,bridge_name='br-int',has_traffic_filtering=True,id=b8ea5c8c-9b61-42be-bea3-0773a45eddcc,network=Network(8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb8ea5c8c-9b') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1240423537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1240423537',id=10,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMAMUsnsS0BAVlPK/lbZXgX4HwHuisLn+3uma5f8FEdUnJ0NVdubfRUA7pxoNgCgGlRukeGayveJawKOl/Wf1Q+R5tg5uVlLxhvOrUbJo0dZMB0awYHSdF62JBQPRP+5A==',key_name='tempest-keypair-692880222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd6fce809fab44789c36f2981972b5b8',ramdisk_id='',reservation_id='r-5ot67hpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-198201622',owner_user_name='tempest-TaggedBootDevicesTest_v242-198201622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:51:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7a5ed8cff034542baf6697046f9c851',uuid=e8eb4171-aa3d-48bd-90e1-dc371da7a77b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bf169f7-c039-4b88-a7de-3da18a368b14", "address": "fa:16:3e:66:75:a0", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf169f7-c0", "ovs_interfaceid": "1bf169f7-c039-4b88-a7de-3da18a368b14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converting VIF {"id": "1bf169f7-c039-4b88-a7de-3da18a368b14", "address": "fa:16:3e:66:75:a0", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf169f7-c0", "ovs_interfaceid": "1bf169f7-c039-4b88-a7de-3da18a368b14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:75:a0,bridge_name='br-int',has_traffic_filtering=True,id=1bf169f7-c039-4b88-a7de-3da18a368b14,network=Network(8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf169f7-c0') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1240423537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1240423537',id=10,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMAMUsnsS0BAVlPK/lbZXgX4HwHuisLn+3uma5f8FEdUnJ0NVdubfRUA7pxoNgCgGlRukeGayveJawKOl/Wf1Q+R5tg5uVlLxhvOrUbJo0dZMB0awYHSdF62JBQPRP+5A==',key_name='tempest-keypair-692880222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd6fce809fab44789c36f2981972b5b8',ramdisk_id='',reservation_id='r-5ot67hpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-198201622',owner_user_name='tempest-TaggedBootDevicesTest_v242-198201622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:51:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7a5ed8cff034542baf6697046f9c851',uuid=e8eb4171-aa3d-48bd-90e1-dc371da7a77b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e", "address": "fa:16:3e:bf:c2:75", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca24a270-f9", "ovs_interfaceid": "ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converting VIF {"id": "ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e", "address": "fa:16:3e:bf:c2:75", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca24a270-f9", "ovs_interfaceid": "ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:c2:75,bridge_name='br-int',has_traffic_filtering=True,id=ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e,network=Network(8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca24a270-f9') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1240423537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1240423537',id=10,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMAMUsnsS0BAVlPK/lbZXgX4HwHuisLn+3uma5f8FEdUnJ0NVdubfRUA7pxoNgCgGlRukeGayveJawKOl/Wf1Q+R5tg5uVlLxhvOrUbJo0dZMB0awYHSdF62JBQPRP+5A==',key_name='tempest-keypair-692880222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd6fce809fab44789c36f2981972b5b8',ramdisk_id='',reservation_id='r-5ot67hpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-198201622',owner_user_name='tempest-TaggedBootDevicesTest_v242-198201622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:51:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7a5ed8cff034542baf6697046f9c851',uuid=e8eb4171-aa3d-48bd-90e1-dc371da7a77b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e63c197-4437-4b03-82c9-a570406f7d38", "address": "fa:16:3e:6b:d2:09", "network": {"id": "dc41b474-59dc-43ae-9724-45c03cddae19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495507142", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e63c197-44", "ovs_interfaceid": "3e63c197-4437-4b03-82c9-a570406f7d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converting VIF {"id": "3e63c197-4437-4b03-82c9-a570406f7d38", "address": "fa:16:3e:6b:d2:09", "network": {"id": "dc41b474-59dc-43ae-9724-45c03cddae19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495507142", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e63c197-44", "ovs_interfaceid": "3e63c197-4437-4b03-82c9-a570406f7d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:d2:09,bridge_name='br-int',has_traffic_filtering=True,id=3e63c197-4437-4b03-82c9-a570406f7d38,network=Network(dc41b474-59dc-43ae-9724-45c03cddae19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e63c197-44') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1240423537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1240423537',id=10,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMAMUsnsS0BAVlPK/lbZXgX4HwHuisLn+3uma5f8FEdUnJ0NVdubfRUA7pxoNgCgGlRukeGayveJawKOl/Wf1Q+R5tg5uVlLxhvOrUbJo0dZMB0awYHSdF62JBQPRP+5A==',key_name='tempest-keypair-692880222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd6fce809fab44789c36f2981972b5b8',ramdisk_id='',reservation_id='r-5ot67hpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-198201622',owner_user_name='tempest-TaggedBootDevicesTest_v242-198201622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:51:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7a5ed8cff034542baf6697046f9c851',uuid=e8eb4171-aa3d-48bd-90e1-dc371da7a77b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef47ac6e-fbd7-47f6-bb62-1d2e1d155179", "address": "fa:16:3e:a8:c1:6a", "network": {"id": "dc41b474-59dc-43ae-9724-45c03cddae19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495507142", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef47ac6e-fb", "ovs_interfaceid": "ef47ac6e-fbd7-47f6-bb62-1d2e1d155179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converting VIF {"id": "ef47ac6e-fbd7-47f6-bb62-1d2e1d155179", "address": "fa:16:3e:a8:c1:6a", "network": {"id": "dc41b474-59dc-43ae-9724-45c03cddae19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495507142", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef47ac6e-fb", "ovs_interfaceid": "ef47ac6e-fbd7-47f6-bb62-1d2e1d155179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:c1:6a,bridge_name='br-int',has_traffic_filtering=True,id=ef47ac6e-fbd7-47f6-bb62-1d2e1d155179,network=Network(dc41b474-59dc-43ae-9724-45c03cddae19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef47ac6e-fb') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.objects.instance [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Lazy-loading 'pci_devices' on Instance uuid e8eb4171-aa3d-48bd-90e1-dc371da7a77b {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] End _get_guest_xml xml=<domain type="kvm">
Nov 08 03:53:38 user nova-compute[75014]:   <uuid>e8eb4171-aa3d-48bd-90e1-dc371da7a77b</uuid>
Nov 08 03:53:38 user nova-compute[75014]:   <name>instance-0000000a</name>
Nov 08 03:53:38 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 03:53:38 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 03:53:38 user nova-compute[75014]:   <metadata>
Nov 08 03:53:38 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 03:53:38 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 03:53:38 user nova-compute[75014]:       <nova:name>tempest-device-tagging-server-1240423537</nova:name>
Nov 08 03:53:38 user nova-compute[75014]:       <nova:creationTime>2023-11-08 03:53:32</nova:creationTime>
Nov 08 03:53:38 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 03:53:38 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 03:53:38 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 03:53:38 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 03:53:38 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 03:53:38 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 03:53:38 user nova-compute[75014]:       </nova:flavor>
Nov 08 03:53:38 user nova-compute[75014]:       <nova:owner>
Nov 08 03:53:38 user nova-compute[75014]:         <nova:user uuid="e7a5ed8cff034542baf6697046f9c851">tempest-TaggedBootDevicesTest_v242-198201622-project-member</nova:user>
Nov 08 03:53:38 user nova-compute[75014]:         <nova:project uuid="fd6fce809fab44789c36f2981972b5b8">tempest-TaggedBootDevicesTest_v242-198201622</nova:project>
Nov 08 03:53:38 user nova-compute[75014]:       </nova:owner>
Nov 08 03:53:38 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 03:53:38 user nova-compute[75014]:       <nova:ports>
Nov 08 03:53:38 user nova-compute[75014]:         <nova:port uuid="22b161cc-78f9-43ab-a91f-bdda3cb031fe">
Nov 08 03:53:38 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 03:53:38 user nova-compute[75014]:         </nova:port>
Nov 08 03:53:38 user nova-compute[75014]:         <nova:port uuid="865f50bd-f6c7-45d9-8fd9-807910ccd477">
Nov 08 03:53:38 user nova-compute[75014]:           <nova:ip type="fixed" address="10.1.1.186" ipVersion="4"/>
Nov 08 03:53:38 user nova-compute[75014]:         </nova:port>
Nov 08 03:53:38 user nova-compute[75014]:         <nova:port uuid="b8ea5c8c-9b61-42be-bea3-0773a45eddcc">
Nov 08 03:53:38 user nova-compute[75014]:           <nova:ip type="fixed" address="10.1.1.38" ipVersion="4"/>
Nov 08 03:53:38 user nova-compute[75014]:         </nova:port>
Nov 08 03:53:38 user nova-compute[75014]:         <nova:port uuid="1bf169f7-c039-4b88-a7de-3da18a368b14">
Nov 08 03:53:38 user nova-compute[75014]:           <nova:ip type="fixed" address="10.1.1.106" ipVersion="4"/>
Nov 08 03:53:38 user nova-compute[75014]:         </nova:port>
Nov 08 03:53:38 user nova-compute[75014]:         <nova:port uuid="ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e">
Nov 08 03:53:38 user nova-compute[75014]:           <nova:ip type="fixed" address="10.1.1.110" ipVersion="4"/>
Nov 08 03:53:38 user nova-compute[75014]:         </nova:port>
Nov 08 03:53:38 user nova-compute[75014]:         <nova:port uuid="3e63c197-4437-4b03-82c9-a570406f7d38">
Nov 08 03:53:38 user nova-compute[75014]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 08 03:53:38 user nova-compute[75014]:         </nova:port>
Nov 08 03:53:38 user nova-compute[75014]:         <nova:port uuid="ef47ac6e-fbd7-47f6-bb62-1d2e1d155179">
Nov 08 03:53:38 user nova-compute[75014]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 08 03:53:38 user nova-compute[75014]:         </nova:port>
Nov 08 03:53:38 user nova-compute[75014]:       </nova:ports>
Nov 08 03:53:38 user nova-compute[75014]:     </nova:instance>
Nov 08 03:53:38 user nova-compute[75014]:   </metadata>
Nov 08 03:53:38 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 03:53:38 user nova-compute[75014]:     <system>
Nov 08 03:53:38 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 03:53:38 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 03:53:38 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 03:53:38 user nova-compute[75014]:       <entry name="serial">e8eb4171-aa3d-48bd-90e1-dc371da7a77b</entry>
Nov 08 03:53:38 user nova-compute[75014]:       <entry name="uuid">e8eb4171-aa3d-48bd-90e1-dc371da7a77b</entry>
Nov 08 03:53:38 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 03:53:38 user nova-compute[75014]:     </system>
Nov 08 03:53:38 user nova-compute[75014]:   </sysinfo>
Nov 08 03:53:38 user nova-compute[75014]:   <os>
Nov 08 03:53:38 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 03:53:38 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 03:53:38 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 03:53:38 user nova-compute[75014]:   </os>
Nov 08 03:53:38 user nova-compute[75014]:   <features>
Nov 08 03:53:38 user nova-compute[75014]:     <acpi/>
Nov 08 03:53:38 user nova-compute[75014]:     <apic/>
Nov 08 03:53:38 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 03:53:38 user nova-compute[75014]:   </features>
Nov 08 03:53:38 user nova-compute[75014]:   <clock offset="utc">
Nov 08 03:53:38 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 03:53:38 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 03:53:38 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 03:53:38 user nova-compute[75014]:   </clock>
Nov 08 03:53:38 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 03:53:38 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 03:53:38 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 03:53:38 user nova-compute[75014]:   </cpu>
Nov 08 03:53:38 user nova-compute[75014]:   <devices>
Nov 08 03:53:38 user nova-compute[75014]:     <disk type="file" device="cdrom">
Nov 08 03:53:38 user nova-compute[75014]:       <driver name="qemu" type="raw" cache="none"/>
Nov 08 03:53:38 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/e8eb4171-aa3d-48bd-90e1-dc371da7a77b/disk.config"/>
Nov 08 03:53:38 user nova-compute[75014]:       <target dev="hda" bus="ide"/>
Nov 08 03:53:38 user nova-compute[75014]:     </disk>
Nov 08 03:53:38 user nova-compute[75014]:     <disk type="block" device="disk">
Nov 08 03:53:38 user nova-compute[75014]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 03:53:38 user nova-compute[75014]:       <source dev="/dev/sde"/>
Nov 08 03:53:38 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 03:53:38 user nova-compute[75014]:       <serial>2582dcd2-17c6-4521-b955-cafb600221ad</serial>
Nov 08 03:53:38 user nova-compute[75014]:     </disk>
Nov 08 03:53:38 user nova-compute[75014]:     <disk type="block" device="disk">
Nov 08 03:53:38 user nova-compute[75014]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 03:53:38 user nova-compute[75014]:       <source dev="/dev/sdb"/>
Nov 08 03:53:38 user nova-compute[75014]:       <target dev="vdb" bus="virtio"/>
Nov 08 03:53:38 user nova-compute[75014]:       <serial>915cfc8b-84fe-49c9-b514-353b6cf4578d</serial>
Nov 08 03:53:38 user nova-compute[75014]:     </disk>
Nov 08 03:53:38 user nova-compute[75014]:     <disk type="block" device="disk">
Nov 08 03:53:38 user nova-compute[75014]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 03:53:38 user nova-compute[75014]:       <source dev="/dev/sdf"/>
Nov 08 03:53:38 user nova-compute[75014]:       <target dev="vdc" bus="virtio"/>
Nov 08 03:53:38 user nova-compute[75014]:       <serial>3140f712-f683-4bd3-937a-aa1fe47ca9f4</serial>
Nov 08 03:53:38 user nova-compute[75014]:     </disk>
Nov 08 03:53:38 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:53:38 user nova-compute[75014]:       <mac address="fa:16:3e:e7:72:75"/>
Nov 08 03:53:38 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:53:38 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:53:38 user nova-compute[75014]:       <target dev="tap22b161cc-78"/>
Nov 08 03:53:38 user nova-compute[75014]:     </interface>
Nov 08 03:53:38 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:53:38 user nova-compute[75014]:       <mac address="fa:16:3e:d1:7b:69"/>
Nov 08 03:53:38 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:53:38 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:53:38 user nova-compute[75014]:       <target dev="tap865f50bd-f6"/>
Nov 08 03:53:38 user nova-compute[75014]:     </interface>
Nov 08 03:53:38 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:53:38 user nova-compute[75014]:       <mac address="fa:16:3e:83:47:72"/>
Nov 08 03:53:38 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:53:38 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:53:38 user nova-compute[75014]:       <target dev="tapb8ea5c8c-9b"/>
Nov 08 03:53:38 user nova-compute[75014]:     </interface>
Nov 08 03:53:38 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:53:38 user nova-compute[75014]:       <mac address="fa:16:3e:66:75:a0"/>
Nov 08 03:53:38 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:53:38 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:53:38 user nova-compute[75014]:       <target dev="tap1bf169f7-c0"/>
Nov 08 03:53:38 user nova-compute[75014]:     </interface>
Nov 08 03:53:38 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:53:38 user nova-compute[75014]:       <mac address="fa:16:3e:bf:c2:75"/>
Nov 08 03:53:38 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:53:38 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:53:38 user nova-compute[75014]:       <target dev="tapca24a270-f9"/>
Nov 08 03:53:38 user nova-compute[75014]:     </interface>
Nov 08 03:53:38 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:53:38 user nova-compute[75014]:       <mac address="fa:16:3e:6b:d2:09"/>
Nov 08 03:53:38 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:53:38 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:53:38 user nova-compute[75014]:       <target dev="tap3e63c197-44"/>
Nov 08 03:53:38 user nova-compute[75014]:     </interface>
Nov 08 03:53:38 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:53:38 user nova-compute[75014]:       <mac address="fa:16:3e:a8:c1:6a"/>
Nov 08 03:53:38 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:53:38 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:53:38 user nova-compute[75014]:       <target dev="tapef47ac6e-fb"/>
Nov 08 03:53:38 user nova-compute[75014]:     </interface>
Nov 08 03:53:38 user nova-compute[75014]:     <serial type="pty">
Nov 08 03:53:38 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/e8eb4171-aa3d-48bd-90e1-dc371da7a77b/console.log" append="off"/>
Nov 08 03:53:38 user nova-compute[75014]:     </serial>
Nov 08 03:53:38 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 03:53:38 user nova-compute[75014]:     <video>
Nov 08 03:53:38 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:53:38 user nova-compute[75014]:     </video>
Nov 08 03:53:38 user nova-compute[75014]:     <rng model="virtio">
Nov 08 03:53:38 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 03:53:38 user nova-compute[75014]:     </rng>
Nov 08 03:53:38 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 03:53:38 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 03:53:38 user nova-compute[75014]:       <stats period="10"/>
Nov 08 03:53:38 user nova-compute[75014]:     </memballoon>
Nov 08 03:53:38 user nova-compute[75014]:   </devices>
Nov 08 03:53:38 user nova-compute[75014]: </domain>
Nov 08 03:53:38 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1240423537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1240423537',id=10,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMAMUsnsS0BAVlPK/lbZXgX4HwHuisLn+3uma5f8FEdUnJ0NVdubfRUA7pxoNgCgGlRukeGayveJawKOl/Wf1Q+R5tg5uVlLxhvOrUbJo0dZMB0awYHSdF62JBQPRP+5A==',key_name='tempest-keypair-692880222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd6fce809fab44789c36f2981972b5b8',ramdisk_id='',reservation_id='r-5ot67hpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-198201622',owner_user_name='tempest-TaggedBootDevicesTest_v242-198201622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:51:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7a5ed8cff034542baf6697046f9c851',uuid=e8eb4171-aa3d-48bd-90e1-dc371da7a77b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "address": "fa:16:3e:e7:72:75", "network": {"id": "f0d5c3f6-95de-4bae-8891-ecf46615f6e0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2062952809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b161cc-78", "ovs_interfaceid": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converting VIF {"id": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "address": "fa:16:3e:e7:72:75", "network": {"id": "f0d5c3f6-95de-4bae-8891-ecf46615f6e0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2062952809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b161cc-78", "ovs_interfaceid": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:72:75,bridge_name='br-int',has_traffic_filtering=True,id=22b161cc-78f9-43ab-a91f-bdda3cb031fe,network=Network(f0d5c3f6-95de-4bae-8891-ecf46615f6e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b161cc-78') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG os_vif [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:72:75,bridge_name='br-int',has_traffic_filtering=True,id=22b161cc-78f9-43ab-a91f-bdda3cb031fe,network=Network(f0d5c3f6-95de-4bae-8891-ecf46615f6e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b161cc-78') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '77c0a8fe-8916-57c6-9bab-e1543202ce64', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22b161cc-78, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22b161cc-78, col_values=(('qos', UUID('0fa10d59-2b50-4ae5-bae4-3e25757e4a94')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22b161cc-78, col_values=(('external_ids', {'iface-id': '22b161cc-78f9-43ab-a91f-bdda3cb031fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:72:75', 'vm-uuid': 'e8eb4171-aa3d-48bd-90e1-dc371da7a77b'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: INFO os_vif [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:72:75,bridge_name='br-int',has_traffic_filtering=True,id=22b161cc-78f9-43ab-a91f-bdda3cb031fe,network=Network(f0d5c3f6-95de-4bae-8891-ecf46615f6e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b161cc-78')
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1240423537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1240423537',id=10,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMAMUsnsS0BAVlPK/lbZXgX4HwHuisLn+3uma5f8FEdUnJ0NVdubfRUA7pxoNgCgGlRukeGayveJawKOl/Wf1Q+R5tg5uVlLxhvOrUbJo0dZMB0awYHSdF62JBQPRP+5A==',key_name='tempest-keypair-692880222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd6fce809fab44789c36f2981972b5b8',ramdisk_id='',reservation_id='r-5ot67hpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-198201622',owner_user_name='tempest-TaggedBootDevicesTest_v242-198201622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:51:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7a5ed8cff034542baf6697046f9c851',uuid=e8eb4171-aa3d-48bd-90e1-dc371da7a77b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "address": "fa:16:3e:d1:7b:69", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865f50bd-f6", "ovs_interfaceid": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converting VIF {"id": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "address": "fa:16:3e:d1:7b:69", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865f50bd-f6", "ovs_interfaceid": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:7b:69,bridge_name='br-int',has_traffic_filtering=True,id=865f50bd-f6c7-45d9-8fd9-807910ccd477,network=Network(8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap865f50bd-f6') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG os_vif [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:7b:69,bridge_name='br-int',has_traffic_filtering=True,id=865f50bd-f6c7-45d9-8fd9-807910ccd477,network=Network(8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap865f50bd-f6') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dc326960-64de-59ba-9881-47aa208c5b8f', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap865f50bd-f6, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap865f50bd-f6, col_values=(('qos', UUID('d6629a47-c8bc-4fa4-b414-760ea46e98e5')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap865f50bd-f6, col_values=(('external_ids', {'iface-id': '865f50bd-f6c7-45d9-8fd9-807910ccd477', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:7b:69', 'vm-uuid': 'e8eb4171-aa3d-48bd-90e1-dc371da7a77b'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: INFO os_vif [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:7b:69,bridge_name='br-int',has_traffic_filtering=True,id=865f50bd-f6c7-45d9-8fd9-807910ccd477,network=Network(8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap865f50bd-f6')
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1240423537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1240423537',id=10,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMAMUsnsS0BAVlPK/lbZXgX4HwHuisLn+3uma5f8FEdUnJ0NVdubfRUA7pxoNgCgGlRukeGayveJawKOl/Wf1Q+R5tg5uVlLxhvOrUbJo0dZMB0awYHSdF62JBQPRP+5A==',key_name='tempest-keypair-692880222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd6fce809fab44789c36f2981972b5b8',ramdisk_id='',reservation_id='r-5ot67hpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-198201622',owner_user_name='tempest-TaggedBootDevicesTest_v242-198201622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:51:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7a5ed8cff034542baf6697046f9c851',uuid=e8eb4171-aa3d-48bd-90e1-dc371da7a77b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "address": "fa:16:3e:83:47:72", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea5c8c-9b", "ovs_interfaceid": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converting VIF {"id": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "address": "fa:16:3e:83:47:72", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea5c8c-9b", "ovs_interfaceid": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:47:72,bridge_name='br-int',has_traffic_filtering=True,id=b8ea5c8c-9b61-42be-bea3-0773a45eddcc,network=Network(8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb8ea5c8c-9b') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG os_vif [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:47:72,bridge_name='br-int',has_traffic_filtering=True,id=b8ea5c8c-9b61-42be-bea3-0773a45eddcc,network=Network(8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb8ea5c8c-9b') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d131c66-334a-5553-9599-04cb55d60bb9', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8ea5c8c-9b, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb8ea5c8c-9b, col_values=(('qos', UUID('57ca2181-9879-45a2-9093-31ba43f06d94')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb8ea5c8c-9b, col_values=(('external_ids', {'iface-id': 'b8ea5c8c-9b61-42be-bea3-0773a45eddcc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:47:72', 'vm-uuid': 'e8eb4171-aa3d-48bd-90e1-dc371da7a77b'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: INFO os_vif [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:47:72,bridge_name='br-int',has_traffic_filtering=True,id=b8ea5c8c-9b61-42be-bea3-0773a45eddcc,network=Network(8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb8ea5c8c-9b')
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1240423537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1240423537',id=10,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMAMUsnsS0BAVlPK/lbZXgX4HwHuisLn+3uma5f8FEdUnJ0NVdubfRUA7pxoNgCgGlRukeGayveJawKOl/Wf1Q+R5tg5uVlLxhvOrUbJo0dZMB0awYHSdF62JBQPRP+5A==',key_name='tempest-keypair-692880222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd6fce809fab44789c36f2981972b5b8',ramdisk_id='',reservation_id='r-5ot67hpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-198201622',owner_user_name='tempest-TaggedBootDevicesTest_v242-198201622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:51:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7a5ed8cff034542baf6697046f9c851',uuid=e8eb4171-aa3d-48bd-90e1-dc371da7a77b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bf169f7-c039-4b88-a7de-3da18a368b14", "address": "fa:16:3e:66:75:a0", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf169f7-c0", "ovs_interfaceid": "1bf169f7-c039-4b88-a7de-3da18a368b14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converting VIF {"id": "1bf169f7-c039-4b88-a7de-3da18a368b14", "address": "fa:16:3e:66:75:a0", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf169f7-c0", "ovs_interfaceid": "1bf169f7-c039-4b88-a7de-3da18a368b14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:75:a0,bridge_name='br-int',has_traffic_filtering=True,id=1bf169f7-c039-4b88-a7de-3da18a368b14,network=Network(8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf169f7-c0') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG os_vif [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:75:a0,bridge_name='br-int',has_traffic_filtering=True,id=1bf169f7-c039-4b88-a7de-3da18a368b14,network=Network(8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf169f7-c0') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa89d582-c9ae-55e5-9967-e05046afae66', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1bf169f7-c0, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1bf169f7-c0, col_values=(('qos', UUID('178fe6e5-61d3-4a46-9617-0b6fbce0e976')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1bf169f7-c0, col_values=(('external_ids', {'iface-id': '1bf169f7-c039-4b88-a7de-3da18a368b14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:75:a0', 'vm-uuid': 'e8eb4171-aa3d-48bd-90e1-dc371da7a77b'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: INFO os_vif [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:75:a0,bridge_name='br-int',has_traffic_filtering=True,id=1bf169f7-c039-4b88-a7de-3da18a368b14,network=Network(8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf169f7-c0')
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1240423537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1240423537',id=10,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMAMUsnsS0BAVlPK/lbZXgX4HwHuisLn+3uma5f8FEdUnJ0NVdubfRUA7pxoNgCgGlRukeGayveJawKOl/Wf1Q+R5tg5uVlLxhvOrUbJo0dZMB0awYHSdF62JBQPRP+5A==',key_name='tempest-keypair-692880222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd6fce809fab44789c36f2981972b5b8',ramdisk_id='',reservation_id='r-5ot67hpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-198201622',owner_user_name='tempest-TaggedBootDevicesTest_v242-198201622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:51:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7a5ed8cff034542baf6697046f9c851',uuid=e8eb4171-aa3d-48bd-90e1-dc371da7a77b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e", "address": "fa:16:3e:bf:c2:75", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca24a270-f9", "ovs_interfaceid": "ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converting VIF {"id": "ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e", "address": "fa:16:3e:bf:c2:75", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca24a270-f9", "ovs_interfaceid": "ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:c2:75,bridge_name='br-int',has_traffic_filtering=True,id=ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e,network=Network(8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca24a270-f9') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG os_vif [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:c2:75,bridge_name='br-int',has_traffic_filtering=True,id=ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e,network=Network(8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca24a270-f9') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e33358e2-7b8d-5f8c-91a5-a064de1be6ba', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca24a270-f9, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapca24a270-f9, col_values=(('qos', UUID('8467bc32-e631-4515-8766-a7ba63462294')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapca24a270-f9, col_values=(('external_ids', {'iface-id': 'ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:c2:75', 'vm-uuid': 'e8eb4171-aa3d-48bd-90e1-dc371da7a77b'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:39 user nova-compute[75014]: INFO os_vif [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:c2:75,bridge_name='br-int',has_traffic_filtering=True,id=ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e,network=Network(8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca24a270-f9')
Nov 08 03:53:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1240423537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1240423537',id=10,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMAMUsnsS0BAVlPK/lbZXgX4HwHuisLn+3uma5f8FEdUnJ0NVdubfRUA7pxoNgCgGlRukeGayveJawKOl/Wf1Q+R5tg5uVlLxhvOrUbJo0dZMB0awYHSdF62JBQPRP+5A==',key_name='tempest-keypair-692880222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd6fce809fab44789c36f2981972b5b8',ramdisk_id='',reservation_id='r-5ot67hpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-198201622',owner_user_name='tempest-TaggedBootDevicesTest_v242-198201622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:51:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7a5ed8cff034542baf6697046f9c851',uuid=e8eb4171-aa3d-48bd-90e1-dc371da7a77b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e63c197-4437-4b03-82c9-a570406f7d38", "address": "fa:16:3e:6b:d2:09", "network": {"id": "dc41b474-59dc-43ae-9724-45c03cddae19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495507142", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e63c197-44", "ovs_interfaceid": "3e63c197-4437-4b03-82c9-a570406f7d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converting VIF {"id": "3e63c197-4437-4b03-82c9-a570406f7d38", "address": "fa:16:3e:6b:d2:09", "network": {"id": "dc41b474-59dc-43ae-9724-45c03cddae19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495507142", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e63c197-44", "ovs_interfaceid": "3e63c197-4437-4b03-82c9-a570406f7d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:d2:09,bridge_name='br-int',has_traffic_filtering=True,id=3e63c197-4437-4b03-82c9-a570406f7d38,network=Network(dc41b474-59dc-43ae-9724-45c03cddae19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e63c197-44') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG os_vif [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:d2:09,bridge_name='br-int',has_traffic_filtering=True,id=3e63c197-4437-4b03-82c9-a570406f7d38,network=Network(dc41b474-59dc-43ae-9724-45c03cddae19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e63c197-44') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e6b2917d-e63d-507b-ad19-490b781c9cd0', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e63c197-44, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3e63c197-44, col_values=(('qos', UUID('e5609f1e-56de-4b03-8efe-1438a8c1bf83')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3e63c197-44, col_values=(('external_ids', {'iface-id': '3e63c197-4437-4b03-82c9-a570406f7d38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:d2:09', 'vm-uuid': 'e8eb4171-aa3d-48bd-90e1-dc371da7a77b'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:39 user nova-compute[75014]: INFO os_vif [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:d2:09,bridge_name='br-int',has_traffic_filtering=True,id=3e63c197-4437-4b03-82c9-a570406f7d38,network=Network(dc41b474-59dc-43ae-9724-45c03cddae19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e63c197-44')
Nov 08 03:53:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1240423537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1240423537',id=10,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMAMUsnsS0BAVlPK/lbZXgX4HwHuisLn+3uma5f8FEdUnJ0NVdubfRUA7pxoNgCgGlRukeGayveJawKOl/Wf1Q+R5tg5uVlLxhvOrUbJo0dZMB0awYHSdF62JBQPRP+5A==',key_name='tempest-keypair-692880222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd6fce809fab44789c36f2981972b5b8',ramdisk_id='',reservation_id='r-5ot67hpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-198201622',owner_user_name='tempest-TaggedBootDevicesTest_v242-198201622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:51:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7a5ed8cff034542baf6697046f9c851',uuid=e8eb4171-aa3d-48bd-90e1-dc371da7a77b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef47ac6e-fbd7-47f6-bb62-1d2e1d155179", "address": "fa:16:3e:a8:c1:6a", "network": {"id": "dc41b474-59dc-43ae-9724-45c03cddae19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495507142", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef47ac6e-fb", "ovs_interfaceid": "ef47ac6e-fbd7-47f6-bb62-1d2e1d155179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converting VIF {"id": "ef47ac6e-fbd7-47f6-bb62-1d2e1d155179", "address": "fa:16:3e:a8:c1:6a", "network": {"id": "dc41b474-59dc-43ae-9724-45c03cddae19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495507142", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef47ac6e-fb", "ovs_interfaceid": "ef47ac6e-fbd7-47f6-bb62-1d2e1d155179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:c1:6a,bridge_name='br-int',has_traffic_filtering=True,id=ef47ac6e-fbd7-47f6-bb62-1d2e1d155179,network=Network(dc41b474-59dc-43ae-9724-45c03cddae19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef47ac6e-fb') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG os_vif [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:c1:6a,bridge_name='br-int',has_traffic_filtering=True,id=ef47ac6e-fbd7-47f6-bb62-1d2e1d155179,network=Network(dc41b474-59dc-43ae-9724-45c03cddae19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef47ac6e-fb') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'afacc02a-b74a-5b3b-93b5-3a5ef672ab3d', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef47ac6e-fb, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef47ac6e-fb, col_values=(('qos', UUID('8315e8fa-5e5f-4046-898e-2dfb138ef2af')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef47ac6e-fb, col_values=(('external_ids', {'iface-id': 'ef47ac6e-fbd7-47f6-bb62-1d2e1d155179', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:c1:6a', 'vm-uuid': 'e8eb4171-aa3d-48bd-90e1-dc371da7a77b'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:39 user nova-compute[75014]: INFO os_vif [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:c1:6a,bridge_name='br-int',has_traffic_filtering=True,id=ef47ac6e-fbd7-47f6-bb62-1d2e1d155179,network=Network(dc41b474-59dc-43ae-9724-45c03cddae19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef47ac6e-fb')
Nov 08 03:53:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] No BDM found with device name hda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] No VIF found with MAC fa:16:3e:e7:72:75, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] No VIF found with MAC fa:16:3e:bf:c2:75, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:53:39 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Using config drive
Nov 08 03:53:39 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Creating config drive at /opt/stack/data/nova/instances/e8eb4171-aa3d-48bd-90e1-dc371da7a77b/disk.config
Nov 08 03:53:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e8eb4171-aa3d-48bd-90e1-dc371da7a77b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpen30keqr {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e8eb4171-aa3d-48bd-90e1-dc371da7a77b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpen30keqr" returned: 0 in 0.055s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:41 user nova-compute[75014]: DEBUG nova.compute.manager [req-042a43d7-a72f-4d6c-8ec7-6bce34b5e3d9 req-77d5c32a-e305-4d5f-8f45-aa79b8955b78 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-plugged-22b161cc-78f9-43ab-a91f-bdda3cb031fe {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:53:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-042a43d7-a72f-4d6c-8ec7-6bce34b5e3d9 req-77d5c32a-e305-4d5f-8f45-aa79b8955b78 service nova] Acquiring lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-042a43d7-a72f-4d6c-8ec7-6bce34b5e3d9 req-77d5c32a-e305-4d5f-8f45-aa79b8955b78 service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-042a43d7-a72f-4d6c-8ec7-6bce34b5e3d9 req-77d5c32a-e305-4d5f-8f45-aa79b8955b78 service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:41 user nova-compute[75014]: DEBUG nova.compute.manager [req-042a43d7-a72f-4d6c-8ec7-6bce34b5e3d9 req-77d5c32a-e305-4d5f-8f45-aa79b8955b78 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] No waiting events found dispatching network-vif-plugged-22b161cc-78f9-43ab-a91f-bdda3cb031fe {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:53:41 user nova-compute[75014]: WARNING nova.compute.manager [req-042a43d7-a72f-4d6c-8ec7-6bce34b5e3d9 req-77d5c32a-e305-4d5f-8f45-aa79b8955b78 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received unexpected event network-vif-plugged-22b161cc-78f9-43ab-a91f-bdda3cb031fe for instance with vm_state building and task_state spawning.
Nov 08 03:53:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:41 user nova-compute[75014]: DEBUG nova.compute.manager [req-c0453411-49da-40d0-b6ba-92d092f1e517 req-54c5acda-6537-40c6-810c-4ca7f4024d89 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-plugged-865f50bd-f6c7-45d9-8fd9-807910ccd477 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:53:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c0453411-49da-40d0-b6ba-92d092f1e517 req-54c5acda-6537-40c6-810c-4ca7f4024d89 service nova] Acquiring lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c0453411-49da-40d0-b6ba-92d092f1e517 req-54c5acda-6537-40c6-810c-4ca7f4024d89 service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c0453411-49da-40d0-b6ba-92d092f1e517 req-54c5acda-6537-40c6-810c-4ca7f4024d89 service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:41 user nova-compute[75014]: DEBUG nova.compute.manager [req-c0453411-49da-40d0-b6ba-92d092f1e517 req-54c5acda-6537-40c6-810c-4ca7f4024d89 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] No waiting events found dispatching network-vif-plugged-865f50bd-f6c7-45d9-8fd9-807910ccd477 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:53:41 user nova-compute[75014]: WARNING nova.compute.manager [req-c0453411-49da-40d0-b6ba-92d092f1e517 req-54c5acda-6537-40c6-810c-4ca7f4024d89 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received unexpected event network-vif-plugged-865f50bd-f6c7-45d9-8fd9-807910ccd477 for instance with vm_state building and task_state spawning.
Nov 08 03:53:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:41 user nova-compute[75014]: DEBUG nova.compute.manager [req-d477df83-3315-42c7-875d-0b84ffc986b4 req-a3a1878a-fb3b-4b80-a268-44e7325e6bb8 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-plugged-b8ea5c8c-9b61-42be-bea3-0773a45eddcc {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:53:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d477df83-3315-42c7-875d-0b84ffc986b4 req-a3a1878a-fb3b-4b80-a268-44e7325e6bb8 service nova] Acquiring lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d477df83-3315-42c7-875d-0b84ffc986b4 req-a3a1878a-fb3b-4b80-a268-44e7325e6bb8 service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d477df83-3315-42c7-875d-0b84ffc986b4 req-a3a1878a-fb3b-4b80-a268-44e7325e6bb8 service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:41 user nova-compute[75014]: DEBUG nova.compute.manager [req-d477df83-3315-42c7-875d-0b84ffc986b4 req-a3a1878a-fb3b-4b80-a268-44e7325e6bb8 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] No waiting events found dispatching network-vif-plugged-b8ea5c8c-9b61-42be-bea3-0773a45eddcc {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:53:41 user nova-compute[75014]: WARNING nova.compute.manager [req-d477df83-3315-42c7-875d-0b84ffc986b4 req-a3a1878a-fb3b-4b80-a268-44e7325e6bb8 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received unexpected event network-vif-plugged-b8ea5c8c-9b61-42be-bea3-0773a45eddcc for instance with vm_state building and task_state spawning.
Nov 08 03:53:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG os_brick.utils [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce738ce-4471-4943-b36c-8821d3927d89]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e38ba0-ad6a-4e93-874b-369ddba94ea6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffbae71-9438-4c14-946b-c086dfef4232]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e00d52-0ed4-4f6f-8d04-6cd4bd3d1825]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 03:53:42 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 03:53:42 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b954c9-39ca-4538-8115-ce927f0a1fe2]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG os_brick.utils [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Updating existing volume attachment record: f2a49b5c-5e78-47fe-8ea1-eeb36e6fc73f {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-209b9bb6-c661-4204-83bd-a814fa6f1e5a req-5587a13c-8556-4495-ae41-698c58395a8b service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-plugged-22b161cc-78f9-43ab-a91f-bdda3cb031fe {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-209b9bb6-c661-4204-83bd-a814fa6f1e5a req-5587a13c-8556-4495-ae41-698c58395a8b service nova] Acquiring lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-209b9bb6-c661-4204-83bd-a814fa6f1e5a req-5587a13c-8556-4495-ae41-698c58395a8b service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-209b9bb6-c661-4204-83bd-a814fa6f1e5a req-5587a13c-8556-4495-ae41-698c58395a8b service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-209b9bb6-c661-4204-83bd-a814fa6f1e5a req-5587a13c-8556-4495-ae41-698c58395a8b service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] No waiting events found dispatching network-vif-plugged-22b161cc-78f9-43ab-a91f-bdda3cb031fe {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:53:43 user nova-compute[75014]: WARNING nova.compute.manager [req-209b9bb6-c661-4204-83bd-a814fa6f1e5a req-5587a13c-8556-4495-ae41-698c58395a8b service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received unexpected event network-vif-plugged-22b161cc-78f9-43ab-a91f-bdda3cb031fe for instance with vm_state building and task_state spawning.
Nov 08 03:53:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-209b9bb6-c661-4204-83bd-a814fa6f1e5a req-5587a13c-8556-4495-ae41-698c58395a8b service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-plugged-3e63c197-4437-4b03-82c9-a570406f7d38 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-209b9bb6-c661-4204-83bd-a814fa6f1e5a req-5587a13c-8556-4495-ae41-698c58395a8b service nova] Acquiring lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-209b9bb6-c661-4204-83bd-a814fa6f1e5a req-5587a13c-8556-4495-ae41-698c58395a8b service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-209b9bb6-c661-4204-83bd-a814fa6f1e5a req-5587a13c-8556-4495-ae41-698c58395a8b service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-209b9bb6-c661-4204-83bd-a814fa6f1e5a req-5587a13c-8556-4495-ae41-698c58395a8b service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] No waiting events found dispatching network-vif-plugged-3e63c197-4437-4b03-82c9-a570406f7d38 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:53:43 user nova-compute[75014]: WARNING nova.compute.manager [req-209b9bb6-c661-4204-83bd-a814fa6f1e5a req-5587a13c-8556-4495-ae41-698c58395a8b service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received unexpected event network-vif-plugged-3e63c197-4437-4b03-82c9-a570406f7d38 for instance with vm_state building and task_state spawning.
Nov 08 03:53:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-209b9bb6-c661-4204-83bd-a814fa6f1e5a req-5587a13c-8556-4495-ae41-698c58395a8b service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-plugged-3e63c197-4437-4b03-82c9-a570406f7d38 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-209b9bb6-c661-4204-83bd-a814fa6f1e5a req-5587a13c-8556-4495-ae41-698c58395a8b service nova] Acquiring lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-209b9bb6-c661-4204-83bd-a814fa6f1e5a req-5587a13c-8556-4495-ae41-698c58395a8b service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-209b9bb6-c661-4204-83bd-a814fa6f1e5a req-5587a13c-8556-4495-ae41-698c58395a8b service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-209b9bb6-c661-4204-83bd-a814fa6f1e5a req-5587a13c-8556-4495-ae41-698c58395a8b service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] No waiting events found dispatching network-vif-plugged-3e63c197-4437-4b03-82c9-a570406f7d38 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:53:43 user nova-compute[75014]: WARNING nova.compute.manager [req-209b9bb6-c661-4204-83bd-a814fa6f1e5a req-5587a13c-8556-4495-ae41-698c58395a8b service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received unexpected event network-vif-plugged-3e63c197-4437-4b03-82c9-a570406f7d38 for instance with vm_state building and task_state spawning.
Nov 08 03:53:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-114db08d-f72f-406c-9fdd-029211f95c1b req-35a1f0da-8634-469c-9d86-87369875363c service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-plugged-865f50bd-f6c7-45d9-8fd9-807910ccd477 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-114db08d-f72f-406c-9fdd-029211f95c1b req-35a1f0da-8634-469c-9d86-87369875363c service nova] Acquiring lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-114db08d-f72f-406c-9fdd-029211f95c1b req-35a1f0da-8634-469c-9d86-87369875363c service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-114db08d-f72f-406c-9fdd-029211f95c1b req-35a1f0da-8634-469c-9d86-87369875363c service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-114db08d-f72f-406c-9fdd-029211f95c1b req-35a1f0da-8634-469c-9d86-87369875363c service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] No waiting events found dispatching network-vif-plugged-865f50bd-f6c7-45d9-8fd9-807910ccd477 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:53:43 user nova-compute[75014]: WARNING nova.compute.manager [req-114db08d-f72f-406c-9fdd-029211f95c1b req-35a1f0da-8634-469c-9d86-87369875363c service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received unexpected event network-vif-plugged-865f50bd-f6c7-45d9-8fd9-807910ccd477 for instance with vm_state building and task_state spawning.
Nov 08 03:53:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-114db08d-f72f-406c-9fdd-029211f95c1b req-35a1f0da-8634-469c-9d86-87369875363c service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-plugged-ef47ac6e-fbd7-47f6-bb62-1d2e1d155179 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-114db08d-f72f-406c-9fdd-029211f95c1b req-35a1f0da-8634-469c-9d86-87369875363c service nova] Acquiring lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-114db08d-f72f-406c-9fdd-029211f95c1b req-35a1f0da-8634-469c-9d86-87369875363c service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-114db08d-f72f-406c-9fdd-029211f95c1b req-35a1f0da-8634-469c-9d86-87369875363c service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-114db08d-f72f-406c-9fdd-029211f95c1b req-35a1f0da-8634-469c-9d86-87369875363c service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] No waiting events found dispatching network-vif-plugged-ef47ac6e-fbd7-47f6-bb62-1d2e1d155179 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:53:43 user nova-compute[75014]: WARNING nova.compute.manager [req-114db08d-f72f-406c-9fdd-029211f95c1b req-35a1f0da-8634-469c-9d86-87369875363c service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received unexpected event network-vif-plugged-ef47ac6e-fbd7-47f6-bb62-1d2e1d155179 for instance with vm_state building and task_state spawning.
Nov 08 03:53:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-114db08d-f72f-406c-9fdd-029211f95c1b req-35a1f0da-8634-469c-9d86-87369875363c service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-plugged-ef47ac6e-fbd7-47f6-bb62-1d2e1d155179 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-114db08d-f72f-406c-9fdd-029211f95c1b req-35a1f0da-8634-469c-9d86-87369875363c service nova] Acquiring lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-114db08d-f72f-406c-9fdd-029211f95c1b req-35a1f0da-8634-469c-9d86-87369875363c service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-114db08d-f72f-406c-9fdd-029211f95c1b req-35a1f0da-8634-469c-9d86-87369875363c service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-114db08d-f72f-406c-9fdd-029211f95c1b req-35a1f0da-8634-469c-9d86-87369875363c service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] No waiting events found dispatching network-vif-plugged-ef47ac6e-fbd7-47f6-bb62-1d2e1d155179 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:53:43 user nova-compute[75014]: WARNING nova.compute.manager [req-114db08d-f72f-406c-9fdd-029211f95c1b req-35a1f0da-8634-469c-9d86-87369875363c service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received unexpected event network-vif-plugged-ef47ac6e-fbd7-47f6-bb62-1d2e1d155179 for instance with vm_state building and task_state spawning.
Nov 08 03:53:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-c3401117-53c4-4eca-8807-c00908cf4625 req-8433b96b-dcde-4012-aef0-e1b426759545 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-plugged-b8ea5c8c-9b61-42be-bea3-0773a45eddcc {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c3401117-53c4-4eca-8807-c00908cf4625 req-8433b96b-dcde-4012-aef0-e1b426759545 service nova] Acquiring lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c3401117-53c4-4eca-8807-c00908cf4625 req-8433b96b-dcde-4012-aef0-e1b426759545 service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c3401117-53c4-4eca-8807-c00908cf4625 req-8433b96b-dcde-4012-aef0-e1b426759545 service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-c3401117-53c4-4eca-8807-c00908cf4625 req-8433b96b-dcde-4012-aef0-e1b426759545 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] No waiting events found dispatching network-vif-plugged-b8ea5c8c-9b61-42be-bea3-0773a45eddcc {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:53:43 user nova-compute[75014]: WARNING nova.compute.manager [req-c3401117-53c4-4eca-8807-c00908cf4625 req-8433b96b-dcde-4012-aef0-e1b426759545 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received unexpected event network-vif-plugged-b8ea5c8c-9b61-42be-bea3-0773a45eddcc for instance with vm_state building and task_state spawning.
Nov 08 03:53:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-c3401117-53c4-4eca-8807-c00908cf4625 req-8433b96b-dcde-4012-aef0-e1b426759545 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-plugged-1bf169f7-c039-4b88-a7de-3da18a368b14 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c3401117-53c4-4eca-8807-c00908cf4625 req-8433b96b-dcde-4012-aef0-e1b426759545 service nova] Acquiring lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c3401117-53c4-4eca-8807-c00908cf4625 req-8433b96b-dcde-4012-aef0-e1b426759545 service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c3401117-53c4-4eca-8807-c00908cf4625 req-8433b96b-dcde-4012-aef0-e1b426759545 service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-c3401117-53c4-4eca-8807-c00908cf4625 req-8433b96b-dcde-4012-aef0-e1b426759545 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] No waiting events found dispatching network-vif-plugged-1bf169f7-c039-4b88-a7de-3da18a368b14 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:53:43 user nova-compute[75014]: WARNING nova.compute.manager [req-c3401117-53c4-4eca-8807-c00908cf4625 req-8433b96b-dcde-4012-aef0-e1b426759545 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received unexpected event network-vif-plugged-1bf169f7-c039-4b88-a7de-3da18a368b14 for instance with vm_state building and task_state spawning.
Nov 08 03:53:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-c3401117-53c4-4eca-8807-c00908cf4625 req-8433b96b-dcde-4012-aef0-e1b426759545 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-plugged-1bf169f7-c039-4b88-a7de-3da18a368b14 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c3401117-53c4-4eca-8807-c00908cf4625 req-8433b96b-dcde-4012-aef0-e1b426759545 service nova] Acquiring lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c3401117-53c4-4eca-8807-c00908cf4625 req-8433b96b-dcde-4012-aef0-e1b426759545 service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c3401117-53c4-4eca-8807-c00908cf4625 req-8433b96b-dcde-4012-aef0-e1b426759545 service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-c3401117-53c4-4eca-8807-c00908cf4625 req-8433b96b-dcde-4012-aef0-e1b426759545 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] No waiting events found dispatching network-vif-plugged-1bf169f7-c039-4b88-a7de-3da18a368b14 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:53:43 user nova-compute[75014]: WARNING nova.compute.manager [req-c3401117-53c4-4eca-8807-c00908cf4625 req-8433b96b-dcde-4012-aef0-e1b426759545 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received unexpected event network-vif-plugged-1bf169f7-c039-4b88-a7de-3da18a368b14 for instance with vm_state building and task_state spawning.
Nov 08 03:53:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-c3401117-53c4-4eca-8807-c00908cf4625 req-8433b96b-dcde-4012-aef0-e1b426759545 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-plugged-ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c3401117-53c4-4eca-8807-c00908cf4625 req-8433b96b-dcde-4012-aef0-e1b426759545 service nova] Acquiring lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c3401117-53c4-4eca-8807-c00908cf4625 req-8433b96b-dcde-4012-aef0-e1b426759545 service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c3401117-53c4-4eca-8807-c00908cf4625 req-8433b96b-dcde-4012-aef0-e1b426759545 service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-c3401117-53c4-4eca-8807-c00908cf4625 req-8433b96b-dcde-4012-aef0-e1b426759545 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] No waiting events found dispatching network-vif-plugged-ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:53:43 user nova-compute[75014]: WARNING nova.compute.manager [req-c3401117-53c4-4eca-8807-c00908cf4625 req-8433b96b-dcde-4012-aef0-e1b426759545 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received unexpected event network-vif-plugged-ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e for instance with vm_state building and task_state spawning.
Nov 08 03:53:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-c3401117-53c4-4eca-8807-c00908cf4625 req-8433b96b-dcde-4012-aef0-e1b426759545 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-plugged-ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c3401117-53c4-4eca-8807-c00908cf4625 req-8433b96b-dcde-4012-aef0-e1b426759545 service nova] Acquiring lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c3401117-53c4-4eca-8807-c00908cf4625 req-8433b96b-dcde-4012-aef0-e1b426759545 service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c3401117-53c4-4eca-8807-c00908cf4625 req-8433b96b-dcde-4012-aef0-e1b426759545 service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-c3401117-53c4-4eca-8807-c00908cf4625 req-8433b96b-dcde-4012-aef0-e1b426759545 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] No waiting events found dispatching network-vif-plugged-ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:53:43 user nova-compute[75014]: WARNING nova.compute.manager [req-c3401117-53c4-4eca-8807-c00908cf4625 req-8433b96b-dcde-4012-aef0-e1b426759545 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received unexpected event network-vif-plugged-ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e for instance with vm_state building and task_state spawning.
Nov 08 03:53:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:45 user nova-compute[75014]: DEBUG nova.compute.manager [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 03:53:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 03:53:45 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Instance spawned successfully.
Nov 08 03:53:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 03:53:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:53:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:53:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:53:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:53:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:53:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:53:45 user nova-compute[75014]: INFO nova.compute.manager [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Took 12.84 seconds to spawn the instance on the hypervisor.
Nov 08 03:53:45 user nova-compute[75014]: DEBUG nova.compute.manager [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:53:45 user nova-compute[75014]: INFO nova.compute.manager [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Took 141.97 seconds to build instance.
Nov 08 03:53:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-33ac51df-1714-40b8-860e-4f1e71af2f39 tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 142.087s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:53:46 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:53 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7dd0e158-473f-4785-a5cf-a75b2da85b29 is timed out.
Nov 08 03:53:53 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Successfully detached device vdb from instance 7dd0e158-473f-4785-a5cf-a75b2da85b29 from the live domain config.
Nov 08 03:53:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 03:53:53 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xlzgmowr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:53:53 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 03:53:53 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:53:53 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:53:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:53 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c29cfeb-b4e6-4aeb-88ed-1e3a7d11297a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:53 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 03:53:53 user nova-compute[75014]: No targets found.
Nov 08 03:53:53 user nova-compute[75014]: iSNS:
Nov 08 03:53:53 user nova-compute[75014]: No targets found.
Nov 08 03:53:53 user nova-compute[75014]: STATIC:
Nov 08 03:53:53 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4
Nov 08 03:53:53 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:53:53 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:53:53 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad
Nov 08 03:53:53 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:53:53 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:53:53 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d
Nov 08 03:53:53 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:53:53 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:53:53 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501
Nov 08 03:53:53 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:53:53 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:53:53 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3
Nov 08 03:53:53 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:53:53 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:53:53 user nova-compute[75014]: FIRMWARE:
Nov 08 03:53:53 user nova-compute[75014]: No targets found.
Nov 08 03:53:53 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:53:53 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 03:53:53 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 03:53:53 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 03:53:53 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 03:53:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:53 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f042cb-7928-480d-b15e-63576c0293ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45f51fa-4e88-41ed-987d-8aa83f1fabcb]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)
Nov 08 03:53:54 user nova-compute[75014]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 (non-flash)
Nov 08 03:53:54 user nova-compute[75014]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)
Nov 08 03:53:54 user nova-compute[75014]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)
Nov 08 03:53:54 user nova-compute[75014]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)
Nov 08 03:53:54 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 (non-flash)
Nov 08 03:53:54 user nova-compute[75014]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 (non-flash)
Nov 08 03:53:54 user nova-compute[75014]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)
Nov 08 03:53:54 user nova-compute[75014]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)
Nov 08 03:53:54 user nova-compute[75014]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)
Nov 08 03:53:54 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0400614700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501'): ({'sdc'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Removing single pathed devices sdc {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[970073bc-5d5d-492f-a900-3def35ec1336]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9705723-c3d4-474b-b046-6a92b8036878]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Flushing IO for device /dev/sdc {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d265fc5e-e259-4230-9129-9e482c6a021d]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77e0e10-2327-469c-9c84-c1d48c4d48ba]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] SCSI volumes sdc have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bca25b9-e332-470f-bb71-a6a64d207e0e]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d434388-7071-4b2c-ae6f-53ea9e14ef13]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501, portal: 172.16.0.220,3260]
Nov 08 03:53:54 user nova-compute[75014]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501, portal: 172.16.0.220,3260] successful.
Nov 08 03:53:54 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d1b9670-e6ea-4dce-a6f6-d0c3a519a501 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0de814-55f4-448e-aadc-02d0eec1ee79]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] <== disconnect_volume: return (322ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:53:54 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 03:53:55 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 8a8d9f3c-1150-4306-8dc6-eedde92c7a35 is timed out.
Nov 08 03:53:55 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Successfully detached device sdc from instance 8a8d9f3c-1150-4306-8dc6-eedde92c7a35 from the live domain config.
Nov 08 03:53:55 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dtEWpzcJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:53:55 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 03:53:55 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a28159e-28bf-4f33-8702-1f2b8119eece]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 03:53:55 user nova-compute[75014]: No targets found.
Nov 08 03:53:55 user nova-compute[75014]: iSNS:
Nov 08 03:53:55 user nova-compute[75014]: No targets found.
Nov 08 03:53:55 user nova-compute[75014]: STATIC:
Nov 08 03:53:55 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4
Nov 08 03:53:55 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:53:55 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:53:55 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad
Nov 08 03:53:55 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:53:55 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:53:55 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d
Nov 08 03:53:55 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:53:55 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:53:55 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3
Nov 08 03:53:55 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:53:55 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:53:55 user nova-compute[75014]: FIRMWARE:
Nov 08 03:53:55 user nova-compute[75014]: No targets found.
Nov 08 03:53:55 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 03:53:55 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 03:53:55 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[98597d0b-8f45-44a8-8492-7698a5adccd5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0580d9-7407-4ae7-9404-88722e607c8f]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 (non-flash)
Nov 08 03:53:55 user nova-compute[75014]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)
Nov 08 03:53:55 user nova-compute[75014]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)
Nov 08 03:53:55 user nova-compute[75014]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)
Nov 08 03:53:55 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 (non-flash)
Nov 08 03:53:55 user nova-compute[75014]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)
Nov 08 03:53:55 user nova-compute[75014]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)
Nov 08 03:53:55 user nova-compute[75014]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)
Nov 08 03:53:55 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f040046d360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3'): ({'sdd'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Removing single pathed devices sdd {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe685477-cfda-4f65-a22b-44ef67fd4890]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[35df5916-7122-44c3-882a-d808dbaab56a]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Flushing IO for device /dev/sdd {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e570fd03-6483-4499-9f4c-d097c4ae175a]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[feef2032-e865-44ac-b96e-a188d3ed122a]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] SCSI volumes sdd have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98fe22f-c826-403d-b3ec-55fe12eedaf2]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c38ff5-3fe8-4fa6-a387-bfa87ec1e22f]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3, portal: 172.16.0.220,3260]
Nov 08 03:53:55 user nova-compute[75014]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3, portal: 172.16.0.220,3260] successful.
Nov 08 03:53:55 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c07f126-e11e-4778-a39d-a115ec717bc3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5daa57b-022e-4873-91e0-037071d32d0e]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] <== disconnect_volume: return (297ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:53:55 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 03:53:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:54:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:54:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:54:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 03:54:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 03:54:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 03:54:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:08 user nova-compute[75014]: DEBUG nova.objects.instance [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lazy-loading 'flavor' on Instance uuid 7dd0e158-473f-4785-a5cf-a75b2da85b29 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:54:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-aeba8f78-e7ed-4c65-9d54-9b598ade7aec tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "7dd0e158-473f-4785-a5cf-a75b2da85b29" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 35.673s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG nova.objects.instance [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lazy-loading 'flavor' on Instance uuid 8a8d9f3c-1150-4306-8dc6-eedde92c7a35 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e770df5b-1643-46f3-b39a-b192db60db2d tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lock "8a8d9f3c-1150-4306-8dc6-eedde92c7a35" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 35.163s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 03:54:09 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Creating image(s)
Nov 08 03:54:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Did not create local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Ensure instance console log exists: /opt/stack/data/nova/instances/655fe5eb-1271-4b9f-a5a6-6342bd012a69/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Start _get_guest_xml network_info=[{"id": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "address": "fa:16:3e:65:33:45", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9034975-10", "ovs_interfaceid": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFNlLqJa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '655fe5eb-1271-4b9f-a5a6-6342bd012a69', 'attached_at': '', 'detached_at': '', 'volume_id': 'e5f9f2d2-e443-4943-85f4-0f697ab7f6ec', 'serial': 'e5f9f2d2-e443-4943-85f4-0f697ab7f6ec'}, 'device_type': 'disk', 'attachment_id': 'f2a49b5c-5e78-47fe-8ea1-eeb36e6fc73f', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 03:54:09 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:54:09 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:54:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFNlLqJa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:54:09 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 03:54:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:54:09 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 03:54:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:54:09 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 03:54:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ace480-8964-43e4-bcbb-2ad36f5a047c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 03:54:09 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[895f6d75-2eba-4514-955d-3d7906ebca28]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec] added
Nov 08 03:54:09 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a300d2-a10c-4307-8ca2-d9341ea210de]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3585d77b-6c5c-4bf2-a6dc-0f77842104da]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:54:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fFNlLqJa {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fFNlLqJa" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1037a3bd-ec23-485f-b94f-6467d3a8c473]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fFNlLqJa'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ac8d9e-43b4-415b-9c2f-7fd0ff2223a0]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7ca06a-a700-40de-9ace-89f34eca038a]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)
Nov 08 03:54:10 user nova-compute[75014]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)
Nov 08 03:54:10 user nova-compute[75014]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)
Nov 08 03:54:10 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)
Nov 08 03:54:10 user nova-compute[75014]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)
Nov 08 03:54:10 user nova-compute[75014]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)
Nov 08 03:54:10 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a77affd-9cfb-48fb-bf7b-af50a891f59f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec, portal: 172.16.0.220,3260]
Nov 08 03:54:10 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec, portal: 172.16.0.220,3260] successful.
Nov 08 03:54:10 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7b51d1-a7c6-4e1e-8ec9-a23dcf46d87c]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7291a83-6e71-481c-9aac-f01cf730a50c]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)
Nov 08 03:54:10 user nova-compute[75014]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)
Nov 08 03:54:10 user nova-compute[75014]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)
Nov 08 03:54:10 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:54:10 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)
Nov 08 03:54:10 user nova-compute[75014]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)
Nov 08 03:54:10 user nova-compute[75014]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)
Nov 08 03:54:10 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:54:10 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] HCTL ('34', '-', '-', 0) found on session 8 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c1a077-247e-4504-834b-261eca692dcb]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Searching for a device in session 8 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFNlLqJa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-32220031-7972-40f6-bc82-5b910805f6bd tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Acquiring lock "8a8d9f3c-1150-4306-8dc6-eedde92c7a35" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-32220031-7972-40f6-bc82-5b910805f6bd tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lock "8a8d9f3c-1150-4306-8dc6-eedde92c7a35" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-32220031-7972-40f6-bc82-5b910805f6bd tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Acquiring lock "8a8d9f3c-1150-4306-8dc6-eedde92c7a35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-32220031-7972-40f6-bc82-5b910805f6bd tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lock "8a8d9f3c-1150-4306-8dc6-eedde92c7a35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-32220031-7972-40f6-bc82-5b910805f6bd tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lock "8a8d9f3c-1150-4306-8dc6-eedde92c7a35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:54:10 user nova-compute[75014]: INFO nova.compute.manager [None req-32220031-7972-40f6-bc82-5b910805f6bd tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Terminating instance
Nov 08 03:54:10 user nova-compute[75014]: DEBUG nova.compute.manager [None req-32220031-7972-40f6-bc82-5b910805f6bd tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG nova.compute.manager [req-5ed63c96-1332-404e-b6f6-7fd304ec9c09 req-3f878653-2d65-42bf-b66c-c9b0ab7bfe4f service nova] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Received event network-vif-unplugged-12d06985-404f-4ffb-98b2-4967d82e45ca {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5ed63c96-1332-404e-b6f6-7fd304ec9c09 req-3f878653-2d65-42bf-b66c-c9b0ab7bfe4f service nova] Acquiring lock "8a8d9f3c-1150-4306-8dc6-eedde92c7a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5ed63c96-1332-404e-b6f6-7fd304ec9c09 req-3f878653-2d65-42bf-b66c-c9b0ab7bfe4f service nova] Lock "8a8d9f3c-1150-4306-8dc6-eedde92c7a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5ed63c96-1332-404e-b6f6-7fd304ec9c09 req-3f878653-2d65-42bf-b66c-c9b0ab7bfe4f service nova] Lock "8a8d9f3c-1150-4306-8dc6-eedde92c7a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG nova.compute.manager [req-5ed63c96-1332-404e-b6f6-7fd304ec9c09 req-3f878653-2d65-42bf-b66c-c9b0ab7bfe4f service nova] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] No waiting events found dispatching network-vif-unplugged-12d06985-404f-4ffb-98b2-4967d82e45ca {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:54:10 user nova-compute[75014]: DEBUG nova.compute.manager [req-5ed63c96-1332-404e-b6f6-7fd304ec9c09 req-3f878653-2d65-42bf-b66c-c9b0ab7bfe4f service nova] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Received event network-vif-unplugged-12d06985-404f-4ffb-98b2-4967d82e45ca for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:11 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Instance destroyed successfully.
Nov 08 03:54:11 user nova-compute[75014]: DEBUG nova.objects.instance [None req-32220031-7972-40f6-bc82-5b910805f6bd tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lazy-loading 'resources' on Instance uuid 8a8d9f3c-1150-4306-8dc6-eedde92c7a35 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-32220031-7972-40f6-bc82-5b910805f6bd tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:49:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1751896276',display_name='tempest-AttachSCSIVolumeTestJSON-server-1751896276',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1751896276',id=6,image_ref='bf066b05-2bf7-4337-a362-db1202224114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+px21gyGxCyg8YXyhCYpThpjcf0ZiZIgyJZ8yfitrhz4DFHIMzDgh8jo4gaToI4Tbk9OSkVjj99XuUpPToStW3+DSzuijtTaPClBOrVw8jY8INyF6hpiGZoE7f98N+7A==',key_name='tempest-keypair-1364196698',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:49:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73af3d7f9cbd46c6b08449dde0ef83cf',ramdisk_id='',reservation_id='r-fh7u0nla',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bf066b05-2bf7-4337-a362-db1202224114',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-381314217',owner_user_name='tempest-AttachSCSIVolumeTestJSON-381314217-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T03:50:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270af1c402db435fbd851feef3d30693',uuid=8a8d9f3c-1150-4306-8dc6-eedde92c7a35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12d06985-404f-4ffb-98b2-4967d82e45ca", "address": "fa:16:3e:c3:48:cb", "network": {"id": "ad32e55b-9579-41dd-b98f-e962ac63433a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1118133511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73af3d7f9cbd46c6b08449dde0ef83cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d06985-40", "ovs_interfaceid": "12d06985-404f-4ffb-98b2-4967d82e45ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-32220031-7972-40f6-bc82-5b910805f6bd tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Converting VIF {"id": "12d06985-404f-4ffb-98b2-4967d82e45ca", "address": "fa:16:3e:c3:48:cb", "network": {"id": "ad32e55b-9579-41dd-b98f-e962ac63433a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1118133511-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73af3d7f9cbd46c6b08449dde0ef83cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d06985-40", "ovs_interfaceid": "12d06985-404f-4ffb-98b2-4967d82e45ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-32220031-7972-40f6-bc82-5b910805f6bd tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:48:cb,bridge_name='br-int',has_traffic_filtering=True,id=12d06985-404f-4ffb-98b2-4967d82e45ca,network=Network(ad32e55b-9579-41dd-b98f-e962ac63433a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12d06985-40') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG os_vif [None req-32220031-7972-40f6-bc82-5b910805f6bd tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:48:cb,bridge_name='br-int',has_traffic_filtering=True,id=12d06985-404f-4ffb-98b2-4967d82e45ca,network=Network(ad32e55b-9579-41dd-b98f-e962ac63433a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12d06985-40') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12d06985-40, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d693d0b4-0c6d-4baa-8a98-fed7434a0720) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:54:11 user nova-compute[75014]: INFO os_vif [None req-32220031-7972-40f6-bc82-5b910805f6bd tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:48:cb,bridge_name='br-int',has_traffic_filtering=True,id=12d06985-404f-4ffb-98b2-4967d82e45ca,network=Network(ad32e55b-9579-41dd-b98f-e962ac63433a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12d06985-40')
Nov 08 03:54:11 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-32220031-7972-40f6-bc82-5b910805f6bd tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Deleting instance files /opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35_del
Nov 08 03:54:11 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-32220031-7972-40f6-bc82-5b910805f6bd tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Deletion of /opt/stack/data/nova/instances/8a8d9f3c-1150-4306-8dc6-eedde92c7a35_del complete
Nov 08 03:54:11 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26461376539663935', 'path': '/dev/sdc'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461376539663935', 'path': '/dev/sdc'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:53:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-296870254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-296870254',id=12,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92a182cdeb8543fea1ab24326734991e',ramdisk_id='',reservation_id='r-zhw8trfw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648299000',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:53:09Z,user_data=None,user_id='630b9ba8f1d9471f9cea51f74106381a',uuid=655fe5eb-1271-4b9f-a5a6-6342bd012a69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "address": "fa:16:3e:65:33:45", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9034975-10", "ovs_interfaceid": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Converting VIF {"id": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "address": "fa:16:3e:65:33:45", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9034975-10", "ovs_interfaceid": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:33:45,bridge_name='br-int',has_traffic_filtering=True,id=c9034975-100d-4ca6-b1dd-c39ea788e2d3,network=Network(d45dbf14-9570-46c1-91a3-cbe2f7972b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9034975-10') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG nova.objects.instance [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lazy-loading 'pci_devices' on Instance uuid 655fe5eb-1271-4b9f-a5a6-6342bd012a69 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:54:11 user nova-compute[75014]: INFO nova.compute.manager [None req-32220031-7972-40f6-bc82-5b910805f6bd tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 08 03:54:11 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-32220031-7972-40f6-bc82-5b910805f6bd tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] End _get_guest_xml xml=<domain type="kvm">
Nov 08 03:54:11 user nova-compute[75014]:   <uuid>655fe5eb-1271-4b9f-a5a6-6342bd012a69</uuid>
Nov 08 03:54:11 user nova-compute[75014]:   <name>instance-0000000c</name>
Nov 08 03:54:11 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 03:54:11 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 03:54:11 user nova-compute[75014]:   <metadata>
Nov 08 03:54:11 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 03:54:11 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 03:54:11 user nova-compute[75014]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-296870254</nova:name>
Nov 08 03:54:11 user nova-compute[75014]:       <nova:creationTime>2023-11-08 03:54:09</nova:creationTime>
Nov 08 03:54:11 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 03:54:11 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 03:54:11 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 03:54:11 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 03:54:11 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 03:54:11 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 03:54:11 user nova-compute[75014]:       </nova:flavor>
Nov 08 03:54:11 user nova-compute[75014]:       <nova:owner>
Nov 08 03:54:11 user nova-compute[75014]:         <nova:user uuid="630b9ba8f1d9471f9cea51f74106381a">tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member</nova:user>
Nov 08 03:54:11 user nova-compute[75014]:         <nova:project uuid="92a182cdeb8543fea1ab24326734991e">tempest-ServerBootFromVolumeStableRescueTest-1648299000</nova:project>
Nov 08 03:54:11 user nova-compute[75014]:       </nova:owner>
Nov 08 03:54:11 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 03:54:11 user nova-compute[75014]:       <nova:ports>
Nov 08 03:54:11 user nova-compute[75014]:         <nova:port uuid="c9034975-100d-4ca6-b1dd-c39ea788e2d3">
Nov 08 03:54:11 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 03:54:11 user nova-compute[75014]:         </nova:port>
Nov 08 03:54:11 user nova-compute[75014]:       </nova:ports>
Nov 08 03:54:11 user nova-compute[75014]:     </nova:instance>
Nov 08 03:54:11 user nova-compute[75014]:   </metadata>
Nov 08 03:54:11 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 03:54:11 user nova-compute[75014]:     <system>
Nov 08 03:54:11 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 03:54:11 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 03:54:11 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 03:54:11 user nova-compute[75014]:       <entry name="serial">655fe5eb-1271-4b9f-a5a6-6342bd012a69</entry>
Nov 08 03:54:11 user nova-compute[75014]:       <entry name="uuid">655fe5eb-1271-4b9f-a5a6-6342bd012a69</entry>
Nov 08 03:54:11 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 03:54:11 user nova-compute[75014]:     </system>
Nov 08 03:54:11 user nova-compute[75014]:   </sysinfo>
Nov 08 03:54:11 user nova-compute[75014]:   <os>
Nov 08 03:54:11 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 03:54:11 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 03:54:11 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 03:54:11 user nova-compute[75014]:   </os>
Nov 08 03:54:11 user nova-compute[75014]:   <features>
Nov 08 03:54:11 user nova-compute[75014]:     <acpi/>
Nov 08 03:54:11 user nova-compute[75014]:     <apic/>
Nov 08 03:54:11 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 03:54:11 user nova-compute[75014]:   </features>
Nov 08 03:54:11 user nova-compute[75014]:   <clock offset="utc">
Nov 08 03:54:11 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 03:54:11 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 03:54:11 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 03:54:11 user nova-compute[75014]:   </clock>
Nov 08 03:54:11 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 03:54:11 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 03:54:11 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 03:54:11 user nova-compute[75014]:   </cpu>
Nov 08 03:54:11 user nova-compute[75014]:   <devices>
Nov 08 03:54:11 user nova-compute[75014]:     <disk type="block" device="disk">
Nov 08 03:54:11 user nova-compute[75014]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 03:54:11 user nova-compute[75014]:       <source dev="/dev/sdc"/>
Nov 08 03:54:11 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 03:54:11 user nova-compute[75014]:       <serial>e5f9f2d2-e443-4943-85f4-0f697ab7f6ec</serial>
Nov 08 03:54:11 user nova-compute[75014]:     </disk>
Nov 08 03:54:11 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:54:11 user nova-compute[75014]:       <mac address="fa:16:3e:65:33:45"/>
Nov 08 03:54:11 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:54:11 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:54:11 user nova-compute[75014]:       <target dev="tapc9034975-10"/>
Nov 08 03:54:11 user nova-compute[75014]:     </interface>
Nov 08 03:54:11 user nova-compute[75014]:     <serial type="pty">
Nov 08 03:54:11 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/655fe5eb-1271-4b9f-a5a6-6342bd012a69/console.log" append="off"/>
Nov 08 03:54:11 user nova-compute[75014]:     </serial>
Nov 08 03:54:11 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 03:54:11 user nova-compute[75014]:     <video>
Nov 08 03:54:11 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:54:11 user nova-compute[75014]:     </video>
Nov 08 03:54:11 user nova-compute[75014]:     <rng model="virtio">
Nov 08 03:54:11 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 03:54:11 user nova-compute[75014]:     </rng>
Nov 08 03:54:11 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 03:54:11 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 03:54:11 user nova-compute[75014]:       <stats period="10"/>
Nov 08 03:54:11 user nova-compute[75014]:     </memballoon>
Nov 08 03:54:11 user nova-compute[75014]:   </devices>
Nov 08 03:54:11 user nova-compute[75014]: </domain>
Nov 08 03:54:11 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:53:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-296870254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-296870254',id=12,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92a182cdeb8543fea1ab24326734991e',ramdisk_id='',reservation_id='r-zhw8trfw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648299000',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:53:09Z,user_data=None,user_id='630b9ba8f1d9471f9cea51f74106381a',uuid=655fe5eb-1271-4b9f-a5a6-6342bd012a69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "address": "fa:16:3e:65:33:45", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9034975-10", "ovs_interfaceid": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Converting VIF {"id": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "address": "fa:16:3e:65:33:45", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9034975-10", "ovs_interfaceid": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:33:45,bridge_name='br-int',has_traffic_filtering=True,id=c9034975-100d-4ca6-b1dd-c39ea788e2d3,network=Network(d45dbf14-9570-46c1-91a3-cbe2f7972b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9034975-10') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG os_vif [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:33:45,bridge_name='br-int',has_traffic_filtering=True,id=c9034975-100d-4ca6-b1dd-c39ea788e2d3,network=Network(d45dbf14-9570-46c1-91a3-cbe2f7972b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9034975-10') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59e30c0d-0142-5357-b42d-77cafd7b30ee', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9034975-10, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc9034975-10, col_values=(('qos', UUID('91fe0811-0e05-44d9-876e-9b72c79e539a')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc9034975-10, col_values=(('external_ids', {'iface-id': 'c9034975-100d-4ca6-b1dd-c39ea788e2d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:33:45', 'vm-uuid': '655fe5eb-1271-4b9f-a5a6-6342bd012a69'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:11 user nova-compute[75014]: INFO os_vif [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:33:45,bridge_name='br-int',has_traffic_filtering=True,id=c9034975-100d-4ca6-b1dd-c39ea788e2d3,network=Network(d45dbf14-9570-46c1-91a3-cbe2f7972b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9034975-10')
Nov 08 03:54:11 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] No VIF found with MAC fa:16:3e:65:33:45, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:54:11 user nova-compute[75014]: INFO nova.compute.manager [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Unshelving
Nov 08 03:54:11 user nova-compute[75014]: INFO nova.virt.block_device [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Booting with volume 356aca91-a548-47f4-9a03-0dc73b9a24a9 at /dev/vdc
Nov 08 03:54:11 user nova-compute[75014]: DEBUG os_brick.utils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eed84a2-9540-4453-b0e5-2c52fdbd0d12]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:11 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:12 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Took 0.74 seconds to deallocate network for instance.
Nov 08 03:54:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:12 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed873bef-eda5-41f4-80ea-6d2bc8a6d5ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:12 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[80868656-1212-41ec-b2b7-509676502fec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:12 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5b3982-210a-42fe-a221-de763fadaa2f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 03:54:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 03:54:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-32220031-7972-40f6-bc82-5b910805f6bd tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:54:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-32220031-7972-40f6-bc82-5b910805f6bd tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:54:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 03:54:12 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 03:54:12 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[67724af7-2f78-4210-acdd-9b76eed9a344]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 03:54:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 03:54:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 03:54:12 user nova-compute[75014]: DEBUG os_brick.utils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:54:12 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Updating existing volume attachment record: 0f7e23b2-8428-4e93-a44b-9f02d6b8ecc5 {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 03:54:12 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-32220031-7972-40f6-bc82-5b910805f6bd tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:54:12 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-32220031-7972-40f6-bc82-5b910805f6bd tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:54:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-32220031-7972-40f6-bc82-5b910805f6bd tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:54:12 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-32220031-7972-40f6-bc82-5b910805f6bd tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Deleted allocations for instance 8a8d9f3c-1150-4306-8dc6-eedde92c7a35
Nov 08 03:54:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-32220031-7972-40f6-bc82-5b910805f6bd tempest-AttachSCSIVolumeTestJSON-381314217 tempest-AttachSCSIVolumeTestJSON-381314217-project-member] Lock "8a8d9f3c-1150-4306-8dc6-eedde92c7a35" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.289s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:54:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:12 user nova-compute[75014]: DEBUG nova.compute.manager [req-bc5ed015-bfbe-4d5f-9cbd-b8f6d6250790 req-b7bebc4d-6fe1-4486-b62e-2eebad6b5b02 service nova] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Received event network-vif-plugged-12d06985-404f-4ffb-98b2-4967d82e45ca {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:54:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-bc5ed015-bfbe-4d5f-9cbd-b8f6d6250790 req-b7bebc4d-6fe1-4486-b62e-2eebad6b5b02 service nova] Acquiring lock "8a8d9f3c-1150-4306-8dc6-eedde92c7a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:54:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-bc5ed015-bfbe-4d5f-9cbd-b8f6d6250790 req-b7bebc4d-6fe1-4486-b62e-2eebad6b5b02 service nova] Lock "8a8d9f3c-1150-4306-8dc6-eedde92c7a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:54:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-bc5ed015-bfbe-4d5f-9cbd-b8f6d6250790 req-b7bebc4d-6fe1-4486-b62e-2eebad6b5b02 service nova] Lock "8a8d9f3c-1150-4306-8dc6-eedde92c7a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:54:12 user nova-compute[75014]: DEBUG nova.compute.manager [req-bc5ed015-bfbe-4d5f-9cbd-b8f6d6250790 req-b7bebc4d-6fe1-4486-b62e-2eebad6b5b02 service nova] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] No waiting events found dispatching network-vif-plugged-12d06985-404f-4ffb-98b2-4967d82e45ca {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:54:12 user nova-compute[75014]: WARNING nova.compute.manager [req-bc5ed015-bfbe-4d5f-9cbd-b8f6d6250790 req-b7bebc4d-6fe1-4486-b62e-2eebad6b5b02 service nova] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Received unexpected event network-vif-plugged-12d06985-404f-4ffb-98b2-4967d82e45ca for instance with vm_state deleted and task_state None.
Nov 08 03:54:12 user nova-compute[75014]: DEBUG nova.compute.manager [req-bc5ed015-bfbe-4d5f-9cbd-b8f6d6250790 req-b7bebc4d-6fe1-4486-b62e-2eebad6b5b02 service nova] [instance: 8a8d9f3c-1150-4306-8dc6-eedde92c7a35] Received event network-vif-deleted-12d06985-404f-4ffb-98b2-4967d82e45ca {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:54:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:14 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 03:54:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 03:54:14 user nova-compute[75014]: DEBUG nova.compute.manager [req-e622207b-cb71-4180-ae19-c2ae90f024af req-1f7e56c4-decd-4f83-b0ed-f0508e82d7f3 service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Received event network-vif-plugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:54:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e622207b-cb71-4180-ae19-c2ae90f024af req-1f7e56c4-decd-4f83-b0ed-f0508e82d7f3 service nova] Acquiring lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:54:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e622207b-cb71-4180-ae19-c2ae90f024af req-1f7e56c4-decd-4f83-b0ed-f0508e82d7f3 service nova] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:54:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e622207b-cb71-4180-ae19-c2ae90f024af req-1f7e56c4-decd-4f83-b0ed-f0508e82d7f3 service nova] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:54:14 user nova-compute[75014]: DEBUG nova.compute.manager [req-e622207b-cb71-4180-ae19-c2ae90f024af req-1f7e56c4-decd-4f83-b0ed-f0508e82d7f3 service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] No waiting events found dispatching network-vif-plugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:54:14 user nova-compute[75014]: WARNING nova.compute.manager [req-e622207b-cb71-4180-ae19-c2ae90f024af req-1f7e56c4-decd-4f83-b0ed-f0508e82d7f3 service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Received unexpected event network-vif-plugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 for instance with vm_state building and task_state spawning.
Nov 08 03:54:14 user nova-compute[75014]: DEBUG nova.compute.manager [req-e622207b-cb71-4180-ae19-c2ae90f024af req-1f7e56c4-decd-4f83-b0ed-f0508e82d7f3 service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Received event network-vif-plugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:54:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e622207b-cb71-4180-ae19-c2ae90f024af req-1f7e56c4-decd-4f83-b0ed-f0508e82d7f3 service nova] Acquiring lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:54:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e622207b-cb71-4180-ae19-c2ae90f024af req-1f7e56c4-decd-4f83-b0ed-f0508e82d7f3 service nova] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:54:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e622207b-cb71-4180-ae19-c2ae90f024af req-1f7e56c4-decd-4f83-b0ed-f0508e82d7f3 service nova] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:54:14 user nova-compute[75014]: DEBUG nova.compute.manager [req-e622207b-cb71-4180-ae19-c2ae90f024af req-1f7e56c4-decd-4f83-b0ed-f0508e82d7f3 service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] No waiting events found dispatching network-vif-plugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:54:14 user nova-compute[75014]: WARNING nova.compute.manager [req-e622207b-cb71-4180-ae19-c2ae90f024af req-1f7e56c4-decd-4f83-b0ed-f0508e82d7f3 service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Received unexpected event network-vif-plugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 for instance with vm_state building and task_state spawning.
Nov 08 03:54:14 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Instance spawned successfully.
Nov 08 03:54:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 03:54:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:54:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:54:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:54:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:54:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:54:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:54:14 user nova-compute[75014]: INFO nova.compute.manager [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Took 5.07 seconds to spawn the instance on the hypervisor.
Nov 08 03:54:14 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:54:15 user nova-compute[75014]: INFO nova.compute.manager [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Took 66.97 seconds to build instance.
Nov 08 03:54:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f1eabdd8-3862-4206-bec6-b02ff6334b79 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 67.165s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:54:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:21 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:21 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:54:33 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:54:33 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:54:33 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 03:54:33 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 08 03:54:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-7dd0e158-473f-4785-a5cf-a75b2da85b29" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:54:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-7dd0e158-473f-4785-a5cf-a75b2da85b29" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:54:33 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 03:54:33 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Updating instance_info_cache with network_info: [{"id": "81345e21-7bc0-451c-950d-30053a7181d3", "address": "fa:16:3e:66:a0:f5", "network": {"id": "24ff600e-3d1c-49d0-90cf-84e1aa25d978", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1636920770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4e7f2292f74b0a88221144ad5220f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81345e21-7b", "ovs_interfaceid": "81345e21-7bc0-451c-950d-30053a7181d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:54:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-7dd0e158-473f-4785-a5cf-a75b2da85b29" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:54:34 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 03:54:34 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:54:34 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:54:34 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:54:34 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:54:34 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:54:34 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:54:34 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 03:54:34 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:54:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:54:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:54:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:54:34 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 03:54:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 03:54:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 03:54:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 03:54:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 03:54:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:54:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:36 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:54:36 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:54:36 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=8055MB free_disk=25.370468139648438GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 03:54:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:54:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:54:36 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9f205fe5-576f-4ef0-874b-1544c0307a7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:54:36 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 5bfa6580-e0fe-46b0-b497-8db67806113a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:54:36 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 8527ee40-fb8a-469b-9696-d7bde8cc96f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:54:36 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 7dd0e158-473f-4785-a5cf-a75b2da85b29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:54:36 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 2ab81192-8890-499c-ad4b-b93664da45fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:54:36 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance e8eb4171-aa3d-48bd-90e1-dc371da7a77b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:54:36 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:54:36 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 655fe5eb-1271-4b9f-a5a6-6342bd012a69 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:54:37 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance f1d49f43-145b-4a9e-acbc-ca3759be49d5 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 08 03:54:37 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 03:54:37 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 03:54:37 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:54:37 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:54:37 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 03:54:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.534s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:54:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:54:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:54:37 user nova-compute[75014]: DEBUG nova.objects.instance [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lazy-loading 'pci_requests' on Instance uuid f1d49f43-145b-4a9e-acbc-ca3759be49d5 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:54:37 user nova-compute[75014]: DEBUG nova.objects.instance [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lazy-loading 'numa_topology' on Instance uuid f1d49f43-145b-4a9e-acbc-ca3759be49d5 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:54:37 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 03:54:37 user nova-compute[75014]: INFO nova.compute.claims [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Claim successful on node user
Nov 08 03:54:37 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:54:37 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:54:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:54:37 user nova-compute[75014]: INFO nova.network.neutron [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Updating port 2dd443c9-89d2-4a7c-b2fe-e842507e24d7 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 08 03:54:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "refresh_cache-f1d49f43-145b-4a9e-acbc-ca3759be49d5" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:54:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquired lock "refresh_cache-f1d49f43-145b-4a9e-acbc-ca3759be49d5" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:54:38 user nova-compute[75014]: DEBUG nova.network.neutron [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 03:54:39 user nova-compute[75014]: DEBUG nova.compute.manager [req-fcbc9fe6-2ecc-4e3f-a7db-b48a65189c55 req-a3a46233-43e3-4c14-b1e2-fa412b81f5bd service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Received event network-changed-2dd443c9-89d2-4a7c-b2fe-e842507e24d7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:54:39 user nova-compute[75014]: DEBUG nova.compute.manager [req-fcbc9fe6-2ecc-4e3f-a7db-b48a65189c55 req-a3a46233-43e3-4c14-b1e2-fa412b81f5bd service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Refreshing instance network info cache due to event network-changed-2dd443c9-89d2-4a7c-b2fe-e842507e24d7. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:54:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-fcbc9fe6-2ecc-4e3f-a7db-b48a65189c55 req-a3a46233-43e3-4c14-b1e2-fa412b81f5bd service nova] Acquiring lock "refresh_cache-f1d49f43-145b-4a9e-acbc-ca3759be49d5" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:54:39 user nova-compute[75014]: DEBUG nova.network.neutron [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Updating instance_info_cache with network_info: [{"id": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "address": "fa:16:3e:32:e2:a4", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd443c9-89", "ovs_interfaceid": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:54:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Releasing lock "refresh_cache-f1d49f43-145b-4a9e-acbc-ca3759be49d5" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:54:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 03:54:39 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Creating image(s)
Nov 08 03:54:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:54:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "/opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:54:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "/opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:54:39 user nova-compute[75014]: DEBUG nova.objects.instance [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lazy-loading 'trusted_certs' on Instance uuid f1d49f43-145b-4a9e-acbc-ca3759be49d5 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:54:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-fcbc9fe6-2ecc-4e3f-a7db-b48a65189c55 req-a3a46233-43e3-4c14-b1e2-fa412b81f5bd service nova] Acquired lock "refresh_cache-f1d49f43-145b-4a9e-acbc-ca3759be49d5" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:54:39 user nova-compute[75014]: DEBUG nova.network.neutron [req-fcbc9fe6-2ecc-4e3f-a7db-b48a65189c55 req-a3a46233-43e3-4c14-b1e2-fa412b81f5bd service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Refreshing network info cache for port 2dd443c9-89d2-4a7c-b2fe-e842507e24d7 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:54:39 user nova-compute[75014]: DEBUG nova.objects.base [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Object Instance<f1d49f43-145b-4a9e-acbc-ca3759be49d5> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 03:54:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "9c99e942abfea2907bd68f08c69d92a9637e7f43" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:54:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "9c99e942abfea2907bd68f08c69d92a9637e7f43" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:54:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Acquiring lock "4848bd0b-c05f-4938-806b-a36bfdb043a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:54:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "4848bd0b-c05f-4938-806b-a36bfdb043a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:54:39 user nova-compute[75014]: DEBUG nova.compute.manager [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 03:54:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:54:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:54:39 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 03:54:39 user nova-compute[75014]: INFO nova.compute.claims [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Claim successful on node user
Nov 08 03:54:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c99e942abfea2907bd68f08c69d92a9637e7f43.part --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:41 user nova-compute[75014]: DEBUG nova.network.neutron [req-fcbc9fe6-2ecc-4e3f-a7db-b48a65189c55 req-a3a46233-43e3-4c14-b1e2-fa412b81f5bd service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Updated VIF entry in instance network info cache for port 2dd443c9-89d2-4a7c-b2fe-e842507e24d7. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:54:41 user nova-compute[75014]: DEBUG nova.network.neutron [req-fcbc9fe6-2ecc-4e3f-a7db-b48a65189c55 req-a3a46233-43e3-4c14-b1e2-fa412b81f5bd service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Updating instance_info_cache with network_info: [{"id": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "address": "fa:16:3e:32:e2:a4", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd443c9-89", "ovs_interfaceid": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:54:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-fcbc9fe6-2ecc-4e3f-a7db-b48a65189c55 req-a3a46233-43e3-4c14-b1e2-fa412b81f5bd service nova] Releasing lock "refresh_cache-f1d49f43-145b-4a9e-acbc-ca3759be49d5" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:54:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c99e942abfea2907bd68f08c69d92a9637e7f43.part --force-share --output=json" returned: 0 in 0.192s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:41 user nova-compute[75014]: DEBUG nova.virt.images [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] f21343d3-6ed2-4c4e-b5db-c93c1e2c0c53 was qcow2, converting to raw {{(pid=75014) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 03:54:41 user nova-compute[75014]: DEBUG nova.privsep.utils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75014) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 03:54:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9c99e942abfea2907bd68f08c69d92a9637e7f43.part /opt/stack/data/nova/instances/_base/9c99e942abfea2907bd68f08c69d92a9637e7f43.converted {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9c99e942abfea2907bd68f08c69d92a9637e7f43.part /opt/stack/data/nova/instances/_base/9c99e942abfea2907bd68f08c69d92a9637e7f43.converted" returned: 0 in 0.174s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c99e942abfea2907bd68f08c69d92a9637e7f43.converted --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:41 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:54:41 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:54:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c99e942abfea2907bd68f08c69d92a9637e7f43.converted --force-share --output=json" returned: 0 in 0.222s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "9c99e942abfea2907bd68f08c69d92a9637e7f43" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.119s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:54:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c99e942abfea2907bd68f08c69d92a9637e7f43 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.783s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:54:41 user nova-compute[75014]: DEBUG nova.compute.manager [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 03:54:41 user nova-compute[75014]: DEBUG nova.compute.manager [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 03:54:41 user nova-compute[75014]: DEBUG nova.network.neutron [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 03:54:41 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 03:54:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c99e942abfea2907bd68f08c69d92a9637e7f43 --force-share --output=json" returned: 0 in 0.215s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "9c99e942abfea2907bd68f08c69d92a9637e7f43" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:54:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "9c99e942abfea2907bd68f08c69d92a9637e7f43" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:54:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c99e942abfea2907bd68f08c69d92a9637e7f43 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:41 user nova-compute[75014]: DEBUG nova.compute.manager [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 03:54:42 user nova-compute[75014]: DEBUG nova.policy [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e82b4bdb6a464a06ac0afb07401a0ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4e7f2292f74b0a88221144ad5220f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 03:54:42 user nova-compute[75014]: DEBUG nova.compute.manager [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 03:54:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 03:54:42 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Creating image(s)
Nov 08 03:54:42 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Acquiring lock "/opt/stack/data/nova/instances/4848bd0b-c05f-4938-806b-a36bfdb043a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:54:42 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "/opt/stack/data/nova/instances/4848bd0b-c05f-4938-806b-a36bfdb043a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:54:42 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "/opt/stack/data/nova/instances/4848bd0b-c05f-4938-806b-a36bfdb043a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:54:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c99e942abfea2907bd68f08c69d92a9637e7f43 --force-share --output=json" returned: 0 in 0.222s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c99e942abfea2907bd68f08c69d92a9637e7f43,backing_fmt=raw /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c99e942abfea2907bd68f08c69d92a9637e7f43,backing_fmt=raw /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk 1073741824" returned: 0 in 0.074s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:42 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "9c99e942abfea2907bd68f08c69d92a9637e7f43" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:54:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c99e942abfea2907bd68f08c69d92a9637e7f43 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.187s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:42 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:54:42 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:54:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c99e942abfea2907bd68f08c69d92a9637e7f43 --force-share --output=json" returned: 0 in 0.195s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:42 user nova-compute[75014]: DEBUG nova.objects.instance [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lazy-loading 'migration_context' on Instance uuid f1d49f43-145b-4a9e-acbc-ca3759be49d5 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:54:42 user nova-compute[75014]: DEBUG nova.objects.base [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Object Instance<f1d49f43-145b-4a9e-acbc-ca3759be49d5> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 03:54:42 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Rebasing disk image.
Nov 08 03:54:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.211s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/4848bd0b-c05f-4938-806b-a36bfdb043a7/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/4848bd0b-c05f-4938-806b-a36bfdb043a7/disk 1073741824" returned: 0 in 0.054s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:42 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:54:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.234s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 -F raw /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.235s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:42 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4848bd0b-c05f-4938-806b-a36bfdb043a7/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 03:54:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4848bd0b-c05f-4938-806b-a36bfdb043a7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:42 user nova-compute[75014]: DEBUG nova.network.neutron [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Successfully created port: e60ebc78-297c-4479-a778-c4aee9d207ae {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 03:54:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4848bd0b-c05f-4938-806b-a36bfdb043a7/disk --force-share --output=json" returned: 0 in 0.339s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:43 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Cannot resize image /opt/stack/data/nova/instances/4848bd0b-c05f-4938-806b-a36bfdb043a7/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 03:54:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 03:54:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Ensure instance console log exists: /opt/stack/data/nova/instances/4848bd0b-c05f-4938-806b-a36bfdb043a7/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 03:54:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:54:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:54:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:54:43 user nova-compute[75014]: DEBUG nova.network.neutron [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Successfully updated port: e60ebc78-297c-4479-a778-c4aee9d207ae {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 03:54:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Acquiring lock "refresh_cache-4848bd0b-c05f-4938-806b-a36bfdb043a7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:54:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Acquired lock "refresh_cache-4848bd0b-c05f-4938-806b-a36bfdb043a7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:54:43 user nova-compute[75014]: DEBUG nova.network.neutron [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 03:54:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-08c7473c-b968-4ed5-88c8-a357715c0982 req-af8161ec-f247-45ab-b38b-2085ed19f5e5 service nova] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Received event network-changed-e60ebc78-297c-4479-a778-c4aee9d207ae {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:54:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-08c7473c-b968-4ed5-88c8-a357715c0982 req-af8161ec-f247-45ab-b38b-2085ed19f5e5 service nova] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Refreshing instance network info cache due to event network-changed-e60ebc78-297c-4479-a778-c4aee9d207ae. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:54:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-08c7473c-b968-4ed5-88c8-a357715c0982 req-af8161ec-f247-45ab-b38b-2085ed19f5e5 service nova] Acquiring lock "refresh_cache-4848bd0b-c05f-4938-806b-a36bfdb043a7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:54:43 user nova-compute[75014]: DEBUG nova.network.neutron [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 03:54:43 user nova-compute[75014]: DEBUG nova.network.neutron [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Updating instance_info_cache with network_info: [{"id": "e60ebc78-297c-4479-a778-c4aee9d207ae", "address": "fa:16:3e:46:33:f4", "network": {"id": "24ff600e-3d1c-49d0-90cf-84e1aa25d978", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1636920770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4e7f2292f74b0a88221144ad5220f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60ebc78-29", "ovs_interfaceid": "e60ebc78-297c-4479-a778-c4aee9d207ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:54:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Releasing lock "refresh_cache-4848bd0b-c05f-4938-806b-a36bfdb043a7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:54:43 user nova-compute[75014]: DEBUG nova.compute.manager [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Instance network_info: |[{"id": "e60ebc78-297c-4479-a778-c4aee9d207ae", "address": "fa:16:3e:46:33:f4", "network": {"id": "24ff600e-3d1c-49d0-90cf-84e1aa25d978", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1636920770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4e7f2292f74b0a88221144ad5220f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60ebc78-29", "ovs_interfaceid": "e60ebc78-297c-4479-a778-c4aee9d207ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 03:54:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-08c7473c-b968-4ed5-88c8-a357715c0982 req-af8161ec-f247-45ab-b38b-2085ed19f5e5 service nova] Acquired lock "refresh_cache-4848bd0b-c05f-4938-806b-a36bfdb043a7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:54:43 user nova-compute[75014]: DEBUG nova.network.neutron [req-08c7473c-b968-4ed5-88c8-a357715c0982 req-af8161ec-f247-45ab-b38b-2085ed19f5e5 service nova] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Refreshing network info cache for port e60ebc78-297c-4479-a778-c4aee9d207ae {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Start _get_guest_xml network_info=[{"id": "e60ebc78-297c-4479-a778-c4aee9d207ae", "address": "fa:16:3e:46:33:f4", "network": {"id": "24ff600e-3d1c-49d0-90cf-84e1aa25d978", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1636920770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4e7f2292f74b0a88221144ad5220f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60ebc78-29", "ovs_interfaceid": "e60ebc78-297c-4479-a778-c4aee9d207ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 03:54:44 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:54:44 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:54:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1635663112',display_name='tempest-VolumesAdminNegativeTest-server-1635663112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1635663112',id=13,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca4e7f2292f74b0a88221144ad5220f5',ramdisk_id='',reservation_id='r-d52villi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-730381045',owner_user_name='tempest-VolumesAdminNegativeTest-730381045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:54:42Z,user_data=None,user_id='e82b4bdb6a464a06ac0afb07401a0ff1',uuid=4848bd0b-c05f-4938-806b-a36bfdb043a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e60ebc78-297c-4479-a778-c4aee9d207ae", "address": "fa:16:3e:46:33:f4", "network": {"id": "24ff600e-3d1c-49d0-90cf-84e1aa25d978", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1636920770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4e7f2292f74b0a88221144ad5220f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60ebc78-29", "ovs_interfaceid": "e60ebc78-297c-4479-a778-c4aee9d207ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Converting VIF {"id": "e60ebc78-297c-4479-a778-c4aee9d207ae", "address": "fa:16:3e:46:33:f4", "network": {"id": "24ff600e-3d1c-49d0-90cf-84e1aa25d978", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1636920770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4e7f2292f74b0a88221144ad5220f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60ebc78-29", "ovs_interfaceid": "e60ebc78-297c-4479-a778-c4aee9d207ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:33:f4,bridge_name='br-int',has_traffic_filtering=True,id=e60ebc78-297c-4479-a778-c4aee9d207ae,network=Network(24ff600e-3d1c-49d0-90cf-84e1aa25d978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape60ebc78-29') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG nova.objects.instance [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lazy-loading 'pci_devices' on Instance uuid 4848bd0b-c05f-4938-806b-a36bfdb043a7 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] End _get_guest_xml xml=<domain type="kvm">
Nov 08 03:54:44 user nova-compute[75014]:   <uuid>4848bd0b-c05f-4938-806b-a36bfdb043a7</uuid>
Nov 08 03:54:44 user nova-compute[75014]:   <name>instance-0000000d</name>
Nov 08 03:54:44 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 03:54:44 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 03:54:44 user nova-compute[75014]:   <metadata>
Nov 08 03:54:44 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 03:54:44 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 03:54:44 user nova-compute[75014]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1635663112</nova:name>
Nov 08 03:54:44 user nova-compute[75014]:       <nova:creationTime>2023-11-08 03:54:44</nova:creationTime>
Nov 08 03:54:44 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 03:54:44 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 03:54:44 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 03:54:44 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 03:54:44 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 03:54:44 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 03:54:44 user nova-compute[75014]:       </nova:flavor>
Nov 08 03:54:44 user nova-compute[75014]:       <nova:owner>
Nov 08 03:54:44 user nova-compute[75014]:         <nova:user uuid="e82b4bdb6a464a06ac0afb07401a0ff1">tempest-VolumesAdminNegativeTest-730381045-project-member</nova:user>
Nov 08 03:54:44 user nova-compute[75014]:         <nova:project uuid="ca4e7f2292f74b0a88221144ad5220f5">tempest-VolumesAdminNegativeTest-730381045</nova:project>
Nov 08 03:54:44 user nova-compute[75014]:       </nova:owner>
Nov 08 03:54:44 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 03:54:44 user nova-compute[75014]:       <nova:ports>
Nov 08 03:54:44 user nova-compute[75014]:         <nova:port uuid="e60ebc78-297c-4479-a778-c4aee9d207ae">
Nov 08 03:54:44 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 03:54:44 user nova-compute[75014]:         </nova:port>
Nov 08 03:54:44 user nova-compute[75014]:       </nova:ports>
Nov 08 03:54:44 user nova-compute[75014]:     </nova:instance>
Nov 08 03:54:44 user nova-compute[75014]:   </metadata>
Nov 08 03:54:44 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 03:54:44 user nova-compute[75014]:     <system>
Nov 08 03:54:44 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 03:54:44 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 03:54:44 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 03:54:44 user nova-compute[75014]:       <entry name="serial">4848bd0b-c05f-4938-806b-a36bfdb043a7</entry>
Nov 08 03:54:44 user nova-compute[75014]:       <entry name="uuid">4848bd0b-c05f-4938-806b-a36bfdb043a7</entry>
Nov 08 03:54:44 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 03:54:44 user nova-compute[75014]:     </system>
Nov 08 03:54:44 user nova-compute[75014]:   </sysinfo>
Nov 08 03:54:44 user nova-compute[75014]:   <os>
Nov 08 03:54:44 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 03:54:44 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 03:54:44 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 03:54:44 user nova-compute[75014]:   </os>
Nov 08 03:54:44 user nova-compute[75014]:   <features>
Nov 08 03:54:44 user nova-compute[75014]:     <acpi/>
Nov 08 03:54:44 user nova-compute[75014]:     <apic/>
Nov 08 03:54:44 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 03:54:44 user nova-compute[75014]:   </features>
Nov 08 03:54:44 user nova-compute[75014]:   <clock offset="utc">
Nov 08 03:54:44 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 03:54:44 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 03:54:44 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 03:54:44 user nova-compute[75014]:   </clock>
Nov 08 03:54:44 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 03:54:44 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 03:54:44 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 03:54:44 user nova-compute[75014]:   </cpu>
Nov 08 03:54:44 user nova-compute[75014]:   <devices>
Nov 08 03:54:44 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 03:54:44 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 03:54:44 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/4848bd0b-c05f-4938-806b-a36bfdb043a7/disk"/>
Nov 08 03:54:44 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 03:54:44 user nova-compute[75014]:     </disk>
Nov 08 03:54:44 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:54:44 user nova-compute[75014]:       <mac address="fa:16:3e:46:33:f4"/>
Nov 08 03:54:44 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:54:44 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:54:44 user nova-compute[75014]:       <target dev="tape60ebc78-29"/>
Nov 08 03:54:44 user nova-compute[75014]:     </interface>
Nov 08 03:54:44 user nova-compute[75014]:     <serial type="pty">
Nov 08 03:54:44 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/4848bd0b-c05f-4938-806b-a36bfdb043a7/console.log" append="off"/>
Nov 08 03:54:44 user nova-compute[75014]:     </serial>
Nov 08 03:54:44 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 03:54:44 user nova-compute[75014]:     <video>
Nov 08 03:54:44 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:54:44 user nova-compute[75014]:     </video>
Nov 08 03:54:44 user nova-compute[75014]:     <rng model="virtio">
Nov 08 03:54:44 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 03:54:44 user nova-compute[75014]:     </rng>
Nov 08 03:54:44 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 03:54:44 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 03:54:44 user nova-compute[75014]:       <stats period="10"/>
Nov 08 03:54:44 user nova-compute[75014]:     </memballoon>
Nov 08 03:54:44 user nova-compute[75014]:   </devices>
Nov 08 03:54:44 user nova-compute[75014]: </domain>
Nov 08 03:54:44 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1635663112',display_name='tempest-VolumesAdminNegativeTest-server-1635663112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1635663112',id=13,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca4e7f2292f74b0a88221144ad5220f5',ramdisk_id='',reservation_id='r-d52villi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-730381045',owner_user_name='tempest-VolumesAdminNegativeTest-730381045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:54:42Z,user_data=None,user_id='e82b4bdb6a464a06ac0afb07401a0ff1',uuid=4848bd0b-c05f-4938-806b-a36bfdb043a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e60ebc78-297c-4479-a778-c4aee9d207ae", "address": "fa:16:3e:46:33:f4", "network": {"id": "24ff600e-3d1c-49d0-90cf-84e1aa25d978", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1636920770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4e7f2292f74b0a88221144ad5220f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60ebc78-29", "ovs_interfaceid": "e60ebc78-297c-4479-a778-c4aee9d207ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Converting VIF {"id": "e60ebc78-297c-4479-a778-c4aee9d207ae", "address": "fa:16:3e:46:33:f4", "network": {"id": "24ff600e-3d1c-49d0-90cf-84e1aa25d978", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1636920770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4e7f2292f74b0a88221144ad5220f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60ebc78-29", "ovs_interfaceid": "e60ebc78-297c-4479-a778-c4aee9d207ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:33:f4,bridge_name='br-int',has_traffic_filtering=True,id=e60ebc78-297c-4479-a778-c4aee9d207ae,network=Network(24ff600e-3d1c-49d0-90cf-84e1aa25d978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape60ebc78-29') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG os_vif [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:33:f4,bridge_name='br-int',has_traffic_filtering=True,id=e60ebc78-297c-4479-a778-c4aee9d207ae,network=Network(24ff600e-3d1c-49d0-90cf-84e1aa25d978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape60ebc78-29') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9f26a2bf-c7b0-5a2e-9583-0b58dda0b4dd', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape60ebc78-29, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape60ebc78-29, col_values=(('qos', UUID('1e9cfb1e-5de5-41df-8d68-77559c205f67')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape60ebc78-29, col_values=(('external_ids', {'iface-id': 'e60ebc78-297c-4479-a778-c4aee9d207ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:33:f4', 'vm-uuid': '4848bd0b-c05f-4938-806b-a36bfdb043a7'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:44 user nova-compute[75014]: INFO os_vif [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:33:f4,bridge_name='br-int',has_traffic_filtering=True,id=e60ebc78-297c-4479-a778-c4aee9d207ae,network=Network(24ff600e-3d1c-49d0-90cf-84e1aa25d978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape60ebc78-29')
Nov 08 03:54:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] No VIF found with MAC fa:16:3e:46:33:f4, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG nova.network.neutron [req-08c7473c-b968-4ed5-88c8-a357715c0982 req-af8161ec-f247-45ab-b38b-2085ed19f5e5 service nova] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Updated VIF entry in instance network info cache for port e60ebc78-297c-4479-a778-c4aee9d207ae. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG nova.network.neutron [req-08c7473c-b968-4ed5-88c8-a357715c0982 req-af8161ec-f247-45ab-b38b-2085ed19f5e5 service nova] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Updating instance_info_cache with network_info: [{"id": "e60ebc78-297c-4479-a778-c4aee9d207ae", "address": "fa:16:3e:46:33:f4", "network": {"id": "24ff600e-3d1c-49d0-90cf-84e1aa25d978", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1636920770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4e7f2292f74b0a88221144ad5220f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60ebc78-29", "ovs_interfaceid": "e60ebc78-297c-4479-a778-c4aee9d207ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-08c7473c-b968-4ed5-88c8-a357715c0982 req-af8161ec-f247-45ab-b38b-2085ed19f5e5 service nova] Releasing lock "refresh_cache-4848bd0b-c05f-4938-806b-a36bfdb043a7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:54:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 -F raw /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk" returned: 0 in 2.435s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Ensure instance console log exists: /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Start _get_guest_xml network_info=[{"id": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "address": "fa:16:3e:32:e2:a4", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd443c9-89", "ovs_interfaceid": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='7faefc530bdba581905adedb04d2165a',container_format='bare',created_at=2023-11-08T03:51:33Z,direct_url=<?>,disk_format='qcow2',id=f21343d3-6ed2-4c4e-b5db-c93c1e2c0c53,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-937810668-shelved',owner='a1d70b55f2bb42e5b7123acfcd621b2f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T03:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HPjOVxXw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'f1d49f43-145b-4a9e-acbc-ca3759be49d5', 'attached_at': '', 'detached_at': '', 'volume_id': '356aca91-a548-47f4-9a03-0dc73b9a24a9', 'serial': '356aca91-a548-47f4-9a03-0dc73b9a24a9'}, 'device_type': 'disk', 'attachment_id': '0f7e23b2-8428-4e93-a44b-9f02d6b8ecc5', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 03:54:45 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:54:45 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:54:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='7faefc530bdba581905adedb04d2165a',container_format='bare',created_at=2023-11-08T03:51:33Z,direct_url=<?>,disk_format='qcow2',id=f21343d3-6ed2-4c4e-b5db-c93c1e2c0c53,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-937810668-shelved',owner='a1d70b55f2bb42e5b7123acfcd621b2f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T03:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG nova.objects.instance [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lazy-loading 'vcpu_model' on Instance uuid f1d49f43-145b-4a9e-acbc-ca3759be49d5 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG nova.objects.base [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Object Instance<f1d49f43-145b-4a9e-acbc-ca3759be49d5> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HPjOVxXw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:54:45 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 03:54:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:54:45 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 03:54:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:54:45 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 03:54:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7bca53-49de-4365-92ad-12c21428fb2f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 03:54:45 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc719311-f984-4947-bd4e-51a028e14c5e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9] added
Nov 08 03:54:45 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.200s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8868af9c-6779-4e77-9ff3-00fea09ed795]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.048s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6c965e-059a-45fa-99b6-e1f1464b1dd8]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HPjOVxXw {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HPjOVxXw" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89988eb-17ee-44d9-ae75-c75481970ee3]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HPjOVxXw'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.100s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[786d1c9d-c7f9-449b-9c24-2e655dc4544b]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[140d8ba0-9da7-4723-9ec6-970885039bd1]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)
Nov 08 03:54:45 user nova-compute[75014]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)
Nov 08 03:54:45 user nova-compute[75014]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)
Nov 08 03:54:45 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:54:45 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)
Nov 08 03:54:45 user nova-compute[75014]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)
Nov 08 03:54:45 user nova-compute[75014]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)
Nov 08 03:54:45 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:54:45 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:46 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:46 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:46 user nova-compute[75014]: DEBUG nova.compute.manager [req-4b66b0c0-962d-40ec-abf5-2c40ed5dd3b7 req-a20b1a8c-e348-41ff-8241-40241077c175 service nova] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Received event network-vif-plugged-e60ebc78-297c-4479-a778-c4aee9d207ae {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:54:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4b66b0c0-962d-40ec-abf5-2c40ed5dd3b7 req-a20b1a8c-e348-41ff-8241-40241077c175 service nova] Acquiring lock "4848bd0b-c05f-4938-806b-a36bfdb043a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:54:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4b66b0c0-962d-40ec-abf5-2c40ed5dd3b7 req-a20b1a8c-e348-41ff-8241-40241077c175 service nova] Lock "4848bd0b-c05f-4938-806b-a36bfdb043a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:54:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4b66b0c0-962d-40ec-abf5-2c40ed5dd3b7 req-a20b1a8c-e348-41ff-8241-40241077c175 service nova] Lock "4848bd0b-c05f-4938-806b-a36bfdb043a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:54:46 user nova-compute[75014]: DEBUG nova.compute.manager [req-4b66b0c0-962d-40ec-abf5-2c40ed5dd3b7 req-a20b1a8c-e348-41ff-8241-40241077c175 service nova] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] No waiting events found dispatching network-vif-plugged-e60ebc78-297c-4479-a778-c4aee9d207ae {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:54:46 user nova-compute[75014]: WARNING nova.compute.manager [req-4b66b0c0-962d-40ec-abf5-2c40ed5dd3b7 req-a20b1a8c-e348-41ff-8241-40241077c175 service nova] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Received unexpected event network-vif-plugged-e60ebc78-297c-4479-a778-c4aee9d207ae for instance with vm_state building and task_state spawning.
Nov 08 03:54:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 -p 172.16.0.220:3260 --login" returned: 0 in 1.209s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:46 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ef389a-3c95-4097-adc6-f5ee49aa104b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9, portal: 172.16.0.220,3260]
Nov 08 03:54:46 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9, portal: 172.16.0.220,3260] successful.
Nov 08 03:54:46 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:54:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:46 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[62609f45-127f-410b-9fe1-335fc80d8b09]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:54:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:46 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7456fd4-a1da-411f-b506-433ba6a2de3a]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)
Nov 08 03:54:46 user nova-compute[75014]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)
Nov 08 03:54:46 user nova-compute[75014]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)
Nov 08 03:54:46 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:54:46 user nova-compute[75014]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 (non-flash)
Nov 08 03:54:46 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:54:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)
Nov 08 03:54:46 user nova-compute[75014]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)
Nov 08 03:54:46 user nova-compute[75014]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)
Nov 08 03:54:46 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:54:46 user nova-compute[75014]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 (non-flash)
Nov 08 03:54:46 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:54:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.783s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:54:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 03:54:47 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] HCTL ('35', '-', '-', 0) found on session 9 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 03:54:47 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 03:54:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:47 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a410471e-429f-4fc8-8066-2323fbe7a17b]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:47 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Searching for a device in session 9 and hctl ['35', '*', '*', 0] yield: None {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Searching for a device in session 9 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HPjOVxXw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.823s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] <== connect_volume: return (2825ms) {'type': 'block', 'scsi_wwn': '23535353163633964', 'path': '/dev/sdd'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535353163633964', 'path': '/dev/sdd'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T03:49:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-937810668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-937810668',id=5,image_ref='f21343d3-6ed2-4c4e-b5db-c93c1e2c0c53',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1162981834',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:49:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a1d70b55f2bb42e5b7123acfcd621b2f',ramdisk_id='',reservation_id='r-0ts9n0ef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-650261566',owner_user_name='tempest-AttachVolumeShelveTestJSON-650261566-project-member',shelved_at='2023-11-08T03:51:39.019626',shelved_host='user',shelved_image_id='f21343d3-6ed2-4c4e-b5db-c93c1e2c0c53'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:54:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74a49a9155064771bd4e8a179f9111ac',uuid=f1d49f43-145b-4a9e-acbc-ca3759be49d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "address": "fa:16:3e:32:e2:a4", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd443c9-89", "ovs_interfaceid": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Converting VIF {"id": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "address": "fa:16:3e:32:e2:a4", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd443c9-89", "ovs_interfaceid": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:e2:a4,bridge_name='br-int',has_traffic_filtering=True,id=2dd443c9-89d2-4a7c-b2fe-e842507e24d7,network=Network(6ebf42ac-ab65-4622-8529-4c508f9d563c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd443c9-89') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG nova.objects.instance [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lazy-loading 'pci_devices' on Instance uuid f1d49f43-145b-4a9e-acbc-ca3759be49d5 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG nova.objects.base [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Object Instance<f1d49f43-145b-4a9e-acbc-ca3759be49d5> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] End _get_guest_xml xml=<domain type="kvm">
Nov 08 03:54:48 user nova-compute[75014]:   <uuid>f1d49f43-145b-4a9e-acbc-ca3759be49d5</uuid>
Nov 08 03:54:48 user nova-compute[75014]:   <name>instance-00000005</name>
Nov 08 03:54:48 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 03:54:48 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 03:54:48 user nova-compute[75014]:   <metadata>
Nov 08 03:54:48 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 03:54:48 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 03:54:48 user nova-compute[75014]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-937810668</nova:name>
Nov 08 03:54:48 user nova-compute[75014]:       <nova:creationTime>2023-11-08 03:54:45</nova:creationTime>
Nov 08 03:54:48 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 03:54:48 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 03:54:48 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 03:54:48 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 03:54:48 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 03:54:48 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 03:54:48 user nova-compute[75014]:       </nova:flavor>
Nov 08 03:54:48 user nova-compute[75014]:       <nova:owner>
Nov 08 03:54:48 user nova-compute[75014]:         <nova:user uuid="74a49a9155064771bd4e8a179f9111ac">tempest-AttachVolumeShelveTestJSON-650261566-project-member</nova:user>
Nov 08 03:54:48 user nova-compute[75014]:         <nova:project uuid="a1d70b55f2bb42e5b7123acfcd621b2f">tempest-AttachVolumeShelveTestJSON-650261566</nova:project>
Nov 08 03:54:48 user nova-compute[75014]:       </nova:owner>
Nov 08 03:54:48 user nova-compute[75014]:       <nova:root type="image" uuid="f21343d3-6ed2-4c4e-b5db-c93c1e2c0c53"/>
Nov 08 03:54:48 user nova-compute[75014]:       <nova:ports>
Nov 08 03:54:48 user nova-compute[75014]:         <nova:port uuid="2dd443c9-89d2-4a7c-b2fe-e842507e24d7">
Nov 08 03:54:48 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 03:54:48 user nova-compute[75014]:         </nova:port>
Nov 08 03:54:48 user nova-compute[75014]:       </nova:ports>
Nov 08 03:54:48 user nova-compute[75014]:     </nova:instance>
Nov 08 03:54:48 user nova-compute[75014]:   </metadata>
Nov 08 03:54:48 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 03:54:48 user nova-compute[75014]:     <system>
Nov 08 03:54:48 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 03:54:48 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 03:54:48 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 03:54:48 user nova-compute[75014]:       <entry name="serial">f1d49f43-145b-4a9e-acbc-ca3759be49d5</entry>
Nov 08 03:54:48 user nova-compute[75014]:       <entry name="uuid">f1d49f43-145b-4a9e-acbc-ca3759be49d5</entry>
Nov 08 03:54:48 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 03:54:48 user nova-compute[75014]:     </system>
Nov 08 03:54:48 user nova-compute[75014]:   </sysinfo>
Nov 08 03:54:48 user nova-compute[75014]:   <os>
Nov 08 03:54:48 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 03:54:48 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 03:54:48 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 03:54:48 user nova-compute[75014]:   </os>
Nov 08 03:54:48 user nova-compute[75014]:   <features>
Nov 08 03:54:48 user nova-compute[75014]:     <acpi/>
Nov 08 03:54:48 user nova-compute[75014]:     <apic/>
Nov 08 03:54:48 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 03:54:48 user nova-compute[75014]:   </features>
Nov 08 03:54:48 user nova-compute[75014]:   <clock offset="utc">
Nov 08 03:54:48 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 03:54:48 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 03:54:48 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 03:54:48 user nova-compute[75014]:   </clock>
Nov 08 03:54:48 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 03:54:48 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 03:54:48 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 03:54:48 user nova-compute[75014]:   </cpu>
Nov 08 03:54:48 user nova-compute[75014]:   <devices>
Nov 08 03:54:48 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 03:54:48 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 03:54:48 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk"/>
Nov 08 03:54:48 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 03:54:48 user nova-compute[75014]:     </disk>
Nov 08 03:54:48 user nova-compute[75014]:     <disk type="block" device="disk">
Nov 08 03:54:48 user nova-compute[75014]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 03:54:48 user nova-compute[75014]:       <source dev="/dev/sdd"/>
Nov 08 03:54:48 user nova-compute[75014]:       <target dev="vdc" bus="virtio"/>
Nov 08 03:54:48 user nova-compute[75014]:       <serial>356aca91-a548-47f4-9a03-0dc73b9a24a9</serial>
Nov 08 03:54:48 user nova-compute[75014]:     </disk>
Nov 08 03:54:48 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:54:48 user nova-compute[75014]:       <mac address="fa:16:3e:32:e2:a4"/>
Nov 08 03:54:48 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:54:48 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:54:48 user nova-compute[75014]:       <target dev="tap2dd443c9-89"/>
Nov 08 03:54:48 user nova-compute[75014]:     </interface>
Nov 08 03:54:48 user nova-compute[75014]:     <serial type="pty">
Nov 08 03:54:48 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/console.log" append="off"/>
Nov 08 03:54:48 user nova-compute[75014]:     </serial>
Nov 08 03:54:48 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 03:54:48 user nova-compute[75014]:     <video>
Nov 08 03:54:48 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:54:48 user nova-compute[75014]:     </video>
Nov 08 03:54:48 user nova-compute[75014]:     <rng model="virtio">
Nov 08 03:54:48 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 03:54:48 user nova-compute[75014]:     </rng>
Nov 08 03:54:48 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 03:54:48 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 03:54:48 user nova-compute[75014]:       <stats period="10"/>
Nov 08 03:54:48 user nova-compute[75014]:     </memballoon>
Nov 08 03:54:48 user nova-compute[75014]:   </devices>
Nov 08 03:54:48 user nova-compute[75014]: </domain>
Nov 08 03:54:48 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T03:49:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-937810668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-937810668',id=5,image_ref='f21343d3-6ed2-4c4e-b5db-c93c1e2c0c53',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1162981834',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:49:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a1d70b55f2bb42e5b7123acfcd621b2f',ramdisk_id='',reservation_id='r-0ts9n0ef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-650261566',owner_user_name='tempest-AttachVolumeShelveTestJSON-650261566-project-member',shelved_at='2023-11-08T03:51:39.019626',shelved_host='user',shelved_image_id='f21343d3-6ed2-4c4e-b5db-c93c1e2c0c53'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:54:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74a49a9155064771bd4e8a179f9111ac',uuid=f1d49f43-145b-4a9e-acbc-ca3759be49d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "address": "fa:16:3e:32:e2:a4", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd443c9-89", "ovs_interfaceid": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Converting VIF {"id": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "address": "fa:16:3e:32:e2:a4", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd443c9-89", "ovs_interfaceid": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:e2:a4,bridge_name='br-int',has_traffic_filtering=True,id=2dd443c9-89d2-4a7c-b2fe-e842507e24d7,network=Network(6ebf42ac-ab65-4622-8529-4c508f9d563c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd443c9-89') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG os_vif [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:e2:a4,bridge_name='br-int',has_traffic_filtering=True,id=2dd443c9-89d2-4a7c-b2fe-e842507e24d7,network=Network(6ebf42ac-ab65-4622-8529-4c508f9d563c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd443c9-89') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db907eb9-1650-5017-a8d0-a1b615901978', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dd443c9-89, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2dd443c9-89, col_values=(('qos', UUID('a20a75e1-31fa-42f6-9e7c-50bdbaf888e2')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2dd443c9-89, col_values=(('external_ids', {'iface-id': '2dd443c9-89d2-4a7c-b2fe-e842507e24d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:e2:a4', 'vm-uuid': 'f1d49f43-145b-4a9e-acbc-ca3759be49d5'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:48 user nova-compute[75014]: INFO os_vif [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:e2:a4,bridge_name='br-int',has_traffic_filtering=True,id=2dd443c9-89d2-4a7c-b2fe-e842507e24d7,network=Network(6ebf42ac-ab65-4622-8529-4c508f9d563c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd443c9-89')
Nov 08 03:54:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] No VIF found with MAC fa:16:3e:32:e2:a4, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG nova.compute.manager [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 03:54:48 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Instance spawned successfully.
Nov 08 03:54:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:54:48 user nova-compute[75014]: INFO nova.compute.manager [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Took 6.31 seconds to spawn the instance on the hypervisor.
Nov 08 03:54:48 user nova-compute[75014]: DEBUG nova.compute.manager [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:54:48 user nova-compute[75014]: INFO nova.compute.manager [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Took 8.64 seconds to build instance.
Nov 08 03:54:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-72aa2d27-4bcf-46a7-8e5b-35c8f8e81b6f tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "4848bd0b-c05f-4938-806b-a36bfdb043a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.753s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG nova.compute.manager [req-48411849-5e69-42ec-8af4-1b18ba3e166f req-1890397a-4279-48d4-a680-7f9adf69501e service nova] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Received event network-vif-plugged-e60ebc78-297c-4479-a778-c4aee9d207ae {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-48411849-5e69-42ec-8af4-1b18ba3e166f req-1890397a-4279-48d4-a680-7f9adf69501e service nova] Acquiring lock "4848bd0b-c05f-4938-806b-a36bfdb043a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-48411849-5e69-42ec-8af4-1b18ba3e166f req-1890397a-4279-48d4-a680-7f9adf69501e service nova] Lock "4848bd0b-c05f-4938-806b-a36bfdb043a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-48411849-5e69-42ec-8af4-1b18ba3e166f req-1890397a-4279-48d4-a680-7f9adf69501e service nova] Lock "4848bd0b-c05f-4938-806b-a36bfdb043a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:54:48 user nova-compute[75014]: DEBUG nova.compute.manager [req-48411849-5e69-42ec-8af4-1b18ba3e166f req-1890397a-4279-48d4-a680-7f9adf69501e service nova] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] No waiting events found dispatching network-vif-plugged-e60ebc78-297c-4479-a778-c4aee9d207ae {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:54:48 user nova-compute[75014]: WARNING nova.compute.manager [req-48411849-5e69-42ec-8af4-1b18ba3e166f req-1890397a-4279-48d4-a680-7f9adf69501e service nova] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Received unexpected event network-vif-plugged-e60ebc78-297c-4479-a778-c4aee9d207ae for instance with vm_state active and task_state None.
Nov 08 03:54:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:50 user nova-compute[75014]: DEBUG nova.compute.manager [req-4b8e9ddb-d49e-4b52-9d23-e50f11d28870 req-aa8dc486-44c1-46dd-a7c7-b413f155c687 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Received event network-vif-plugged-2dd443c9-89d2-4a7c-b2fe-e842507e24d7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:54:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4b8e9ddb-d49e-4b52-9d23-e50f11d28870 req-aa8dc486-44c1-46dd-a7c7-b413f155c687 service nova] Acquiring lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:54:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4b8e9ddb-d49e-4b52-9d23-e50f11d28870 req-aa8dc486-44c1-46dd-a7c7-b413f155c687 service nova] Lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:54:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4b8e9ddb-d49e-4b52-9d23-e50f11d28870 req-aa8dc486-44c1-46dd-a7c7-b413f155c687 service nova] Lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:54:50 user nova-compute[75014]: DEBUG nova.compute.manager [req-4b8e9ddb-d49e-4b52-9d23-e50f11d28870 req-aa8dc486-44c1-46dd-a7c7-b413f155c687 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] No waiting events found dispatching network-vif-plugged-2dd443c9-89d2-4a7c-b2fe-e842507e24d7 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:54:50 user nova-compute[75014]: WARNING nova.compute.manager [req-4b8e9ddb-d49e-4b52-9d23-e50f11d28870 req-aa8dc486-44c1-46dd-a7c7-b413f155c687 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Received unexpected event network-vif-plugged-2dd443c9-89d2-4a7c-b2fe-e842507e24d7 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 03:54:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:52 user nova-compute[75014]: DEBUG nova.compute.manager [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 03:54:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 03:54:52 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Instance spawned successfully.
Nov 08 03:54:52 user nova-compute[75014]: DEBUG nova.compute.manager [req-dc06a40f-3995-4193-bc33-ab83a996d0e2 req-b32da591-2406-4bf7-855c-af711e3eaeb6 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Received event network-vif-plugged-2dd443c9-89d2-4a7c-b2fe-e842507e24d7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:54:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dc06a40f-3995-4193-bc33-ab83a996d0e2 req-b32da591-2406-4bf7-855c-af711e3eaeb6 service nova] Acquiring lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:54:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dc06a40f-3995-4193-bc33-ab83a996d0e2 req-b32da591-2406-4bf7-855c-af711e3eaeb6 service nova] Lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:54:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dc06a40f-3995-4193-bc33-ab83a996d0e2 req-b32da591-2406-4bf7-855c-af711e3eaeb6 service nova] Lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:54:52 user nova-compute[75014]: DEBUG nova.compute.manager [req-dc06a40f-3995-4193-bc33-ab83a996d0e2 req-b32da591-2406-4bf7-855c-af711e3eaeb6 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] No waiting events found dispatching network-vif-plugged-2dd443c9-89d2-4a7c-b2fe-e842507e24d7 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:54:52 user nova-compute[75014]: WARNING nova.compute.manager [req-dc06a40f-3995-4193-bc33-ab83a996d0e2 req-b32da591-2406-4bf7-855c-af711e3eaeb6 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Received unexpected event network-vif-plugged-2dd443c9-89d2-4a7c-b2fe-e842507e24d7 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 03:54:53 user nova-compute[75014]: DEBUG nova.compute.manager [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:54:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-45767804-35b0-4c53-8334-a3e203dc65f0 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 41.482s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFBcmlxW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:54:55 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 03:54:55 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:54:55 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 03:54:55 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:54:55 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 03:54:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7377674e-daa4-41a7-8f9c-f11bfd33545a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 03:54:55 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2adce42-3924-4971-bb60-3eeaf196dcaf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06] added
Nov 08 03:54:55 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[af15d784-0684-4628-b0f9-d1c735924663]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[80549645-6057-4d72-9fdd-355cf70534bf]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qFBcmlxW {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qFBcmlxW" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[678ff9bc-dcfa-47b1-a787-97a2a8fd4db8]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qFBcmlxW'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5974cefc-8958-4406-82c3-55d933deffdb]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[246a820a-645c-4340-8418-18adc86ea168]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)
Nov 08 03:54:55 user nova-compute[75014]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)
Nov 08 03:54:55 user nova-compute[75014]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)
Nov 08 03:54:55 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:54:55 user nova-compute[75014]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 (non-flash)
Nov 08 03:54:55 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)
Nov 08 03:54:55 user nova-compute[75014]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)
Nov 08 03:54:55 user nova-compute[75014]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)
Nov 08 03:54:55 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:54:55 user nova-compute[75014]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 (non-flash)
Nov 08 03:54:55 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2803d359-279c-48a9-96d4-719d980fd730]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:55 user nova-compute[75014]: INFO nova.virt.block_device [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Booting with volume 1faffa6f-e6c1-4c89-9be7-3cb9e0769e54 at /dev/vdb
Nov 08 03:54:55 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06, portal: 172.16.0.220,3260]
Nov 08 03:54:55 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06, portal: 172.16.0.220,3260] successful.
Nov 08 03:54:55 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:54:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09b811e-e104-4757-a6c1-f7d292486a99]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda9c38d-37ad-4ab9-8b5c-ebeb21dfec68]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c4f28e-6903-402c-a575-9dcc52949a68 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 03:54:56 user nova-compute[75014]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c4f28e-6903-402c-a575-9dcc52949a68 (non-flash)
Nov 08 03:54:56 user nova-compute[75014]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)
Nov 08 03:54:56 user nova-compute[75014]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)
Nov 08 03:54:56 user nova-compute[75014]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)
Nov 08 03:54:56 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:54:56 user nova-compute[75014]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 (non-flash)
Nov 08 03:54:56 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 03:54:56 user nova-compute[75014]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c4f28e-6903-402c-a575-9dcc52949a68 (non-flash)
Nov 08 03:54:56 user nova-compute[75014]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)
Nov 08 03:54:56 user nova-compute[75014]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)
Nov 08 03:54:56 user nova-compute[75014]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)
Nov 08 03:54:56 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:54:56 user nova-compute[75014]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 (non-flash)
Nov 08 03:54:56 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.424s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] HCTL ('38', '-', '-', 0) found on session 10 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG os_brick.utils [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.052s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[12401e17-1ff4-4013-a8ad-8edd4d20945b]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Searching for a device in session 10 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFBcmlxW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.029s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c72052-af74-4699-a389-f8ae574282f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.033s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfcce03-88c2-4a21-a526-4d076059afa0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0849b1ef-8cf5-4c4b-aa9a-40edcdf5aba5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb5507d-5f56-4f21-8f15-bec58ba93dcc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 03:54:56 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 03:54:56 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c362df-9f9d-4cbb-8640-3e986079e373]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG os_brick.utils [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] <== get_connector_properties: return (185ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Updating existing volume attachment record: 8fe96b74-0e1a-4f7b-b119-7169dfc47e92 {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 03:54:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.510s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:54:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] <== connect_volume: return (1511ms) {'type': 'block', 'scsi_wwn': '23632653237666237', 'path': '/dev/sdg'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:54:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632653237666237', 'path': '/dev/sdg'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 03:54:57 user nova-compute[75014]: DEBUG nova.objects.instance [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Lazy-loading 'flavor' on Instance uuid 2ab81192-8890-499c-ad4b-b93664da45fb {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:54:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 03:54:57 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 03:54:57 user nova-compute[75014]:   <source dev="/dev/sdg"/>
Nov 08 03:54:57 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 03:54:57 user nova-compute[75014]:   <serial>735a233b-2c2f-4d50-99ea-9f457c541f06</serial>
Nov 08 03:54:57 user nova-compute[75014]: </disk>
Nov 08 03:54:57 user nova-compute[75014]:  {{(pid=75014) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 03:54:58 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:54:58 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:54:58 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] No VIF found with MAC fa:16:3e:ac:c2:d9, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:54:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d885bf59-78a4-4c1e-949c-6a1e790e683d tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Lock "2ab81192-8890-499c-ad4b-b93664da45fb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 112.113s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:54:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6a7898b2-010f-434c-84ef-43fa8b6e3b33 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Lock "2ab81192-8890-499c-ad4b-b93664da45fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 111.406s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:54:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6a7898b2-010f-434c-84ef-43fa8b6e3b33 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Acquiring lock "2ab81192-8890-499c-ad4b-b93664da45fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:54:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6a7898b2-010f-434c-84ef-43fa8b6e3b33 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Lock "2ab81192-8890-499c-ad4b-b93664da45fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:54:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6a7898b2-010f-434c-84ef-43fa8b6e3b33 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Lock "2ab81192-8890-499c-ad4b-b93664da45fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:54:58 user nova-compute[75014]: INFO nova.compute.manager [None req-6a7898b2-010f-434c-84ef-43fa8b6e3b33 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Terminating instance
Nov 08 03:54:58 user nova-compute[75014]: DEBUG nova.compute.manager [None req-6a7898b2-010f-434c-84ef-43fa8b6e3b33 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 03:54:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:58 user nova-compute[75014]: DEBUG nova.compute.manager [req-833f9fd0-c9ac-41ed-93c9-9126a10d01ca req-c6aec245-720a-4a6f-99b8-f048756973b1 service nova] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Received event network-vif-unplugged-9560a102-ba69-4b8d-a190-4c328fd75152 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:54:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-833f9fd0-c9ac-41ed-93c9-9126a10d01ca req-c6aec245-720a-4a6f-99b8-f048756973b1 service nova] Acquiring lock "2ab81192-8890-499c-ad4b-b93664da45fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:54:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-833f9fd0-c9ac-41ed-93c9-9126a10d01ca req-c6aec245-720a-4a6f-99b8-f048756973b1 service nova] Lock "2ab81192-8890-499c-ad4b-b93664da45fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:54:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-833f9fd0-c9ac-41ed-93c9-9126a10d01ca req-c6aec245-720a-4a6f-99b8-f048756973b1 service nova] Lock "2ab81192-8890-499c-ad4b-b93664da45fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:54:58 user nova-compute[75014]: DEBUG nova.compute.manager [req-833f9fd0-c9ac-41ed-93c9-9126a10d01ca req-c6aec245-720a-4a6f-99b8-f048756973b1 service nova] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] No waiting events found dispatching network-vif-unplugged-9560a102-ba69-4b8d-a190-4c328fd75152 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:54:58 user nova-compute[75014]: DEBUG nova.compute.manager [req-833f9fd0-c9ac-41ed-93c9-9126a10d01ca req-c6aec245-720a-4a6f-99b8-f048756973b1 service nova] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Received event network-vif-unplugged-9560a102-ba69-4b8d-a190-4c328fd75152 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 03:54:59 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Instance destroyed successfully.
Nov 08 03:54:59 user nova-compute[75014]: DEBUG nova.objects.instance [None req-6a7898b2-010f-434c-84ef-43fa8b6e3b33 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Lazy-loading 'resources' on Instance uuid 2ab81192-8890-499c-ad4b-b93664da45fb {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:54:59 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-6a7898b2-010f-434c-84ef-43fa8b6e3b33 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:50:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2120142222',display_name='tempest-TestVolumeSwap-server-2120142222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2120142222',id=8,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDee/x44gpD2qveGqI7Qnm2TSqrDL9M5FYEuNzopTlXXeUxC021f24dXpE8MXDY01Y5w3Ocjwb28WoK9Q7qQAdKM8xH9kSlunDbA0znyPbkHZV30sxR/CXudoLgVMepBZQ==',key_name='tempest-keypair-1918879649',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:50:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29ed0da9041f4975940636f88112cce2',ramdisk_id='',reservation_id='r-usrzxfo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1359819208',owner_user_name='tempest-TestVolumeSwap-1359819208-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T03:50:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4cafe48fe574e2995a86e80d3df89d3',uuid=2ab81192-8890-499c-ad4b-b93664da45fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9560a102-ba69-4b8d-a190-4c328fd75152", "address": "fa:16:3e:ac:c2:d9", "network": {"id": "cd4479bd-ef72-411c-bbab-3738ca8d79d4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1925691320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ed0da9041f4975940636f88112cce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9560a102-ba", "ovs_interfaceid": "9560a102-ba69-4b8d-a190-4c328fd75152", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 03:54:59 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-6a7898b2-010f-434c-84ef-43fa8b6e3b33 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Converting VIF {"id": "9560a102-ba69-4b8d-a190-4c328fd75152", "address": "fa:16:3e:ac:c2:d9", "network": {"id": "cd4479bd-ef72-411c-bbab-3738ca8d79d4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1925691320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ed0da9041f4975940636f88112cce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9560a102-ba", "ovs_interfaceid": "9560a102-ba69-4b8d-a190-4c328fd75152", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:54:59 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-6a7898b2-010f-434c-84ef-43fa8b6e3b33 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:c2:d9,bridge_name='br-int',has_traffic_filtering=True,id=9560a102-ba69-4b8d-a190-4c328fd75152,network=Network(cd4479bd-ef72-411c-bbab-3738ca8d79d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9560a102-ba') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:54:59 user nova-compute[75014]: DEBUG os_vif [None req-6a7898b2-010f-434c-84ef-43fa8b6e3b33 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:c2:d9,bridge_name='br-int',has_traffic_filtering=True,id=9560a102-ba69-4b8d-a190-4c328fd75152,network=Network(cd4479bd-ef72-411c-bbab-3738ca8d79d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9560a102-ba') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 03:54:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9560a102-ba, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:54:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8752877-3a03-40ae-befb-e4729fc5cc61) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:54:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:54:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:54:59 user nova-compute[75014]: INFO os_vif [None req-6a7898b2-010f-434c-84ef-43fa8b6e3b33 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:c2:d9,bridge_name='br-int',has_traffic_filtering=True,id=9560a102-ba69-4b8d-a190-4c328fd75152,network=Network(cd4479bd-ef72-411c-bbab-3738ca8d79d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9560a102-ba')
Nov 08 03:54:59 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-6a7898b2-010f-434c-84ef-43fa8b6e3b33 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Deleting instance files /opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb_del
Nov 08 03:54:59 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-6a7898b2-010f-434c-84ef-43fa8b6e3b33 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Deletion of /opt/stack/data/nova/instances/2ab81192-8890-499c-ad4b-b93664da45fb_del complete
Nov 08 03:54:59 user nova-compute[75014]: INFO nova.compute.manager [None req-6a7898b2-010f-434c-84ef-43fa8b6e3b33 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Took 1.10 seconds to destroy the instance on the hypervisor.
Nov 08 03:54:59 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-6a7898b2-010f-434c-84ef-43fa8b6e3b33 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 03:54:59 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 03:54:59 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 03:54:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:00 user nova-compute[75014]: DEBUG nova.compute.manager [req-a1162f85-cfe0-4e7b-b32f-6d7d1b50d370 req-30d653dc-0342-4ca7-a55e-860af7f40f50 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-changed-22b161cc-78f9-43ab-a91f-bdda3cb031fe {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:00 user nova-compute[75014]: DEBUG nova.compute.manager [req-a1162f85-cfe0-4e7b-b32f-6d7d1b50d370 req-30d653dc-0342-4ca7-a55e-860af7f40f50 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Refreshing instance network info cache due to event network-changed-22b161cc-78f9-43ab-a91f-bdda3cb031fe. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:55:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a1162f85-cfe0-4e7b-b32f-6d7d1b50d370 req-30d653dc-0342-4ca7-a55e-860af7f40f50 service nova] Acquiring lock "refresh_cache-e8eb4171-aa3d-48bd-90e1-dc371da7a77b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:55:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a1162f85-cfe0-4e7b-b32f-6d7d1b50d370 req-30d653dc-0342-4ca7-a55e-860af7f40f50 service nova] Acquired lock "refresh_cache-e8eb4171-aa3d-48bd-90e1-dc371da7a77b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:55:00 user nova-compute[75014]: DEBUG nova.network.neutron [req-a1162f85-cfe0-4e7b-b32f-6d7d1b50d370 req-30d653dc-0342-4ca7-a55e-860af7f40f50 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Refreshing network info cache for port 22b161cc-78f9-43ab-a91f-bdda3cb031fe {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:55:00 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:55:00 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Took 1.42 seconds to deallocate network for instance.
Nov 08 03:55:00 user nova-compute[75014]: DEBUG nova.compute.manager [req-d9fb1495-a60b-427d-936f-a118460c3102 req-697313e1-2a8d-4df4-b40f-eda38e23a2f0 service nova] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Received event network-vif-deleted-9560a102-ba69-4b8d-a190-4c328fd75152 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:00 user nova-compute[75014]: INFO nova.compute.manager [req-d9fb1495-a60b-427d-936f-a118460c3102 req-697313e1-2a8d-4df4-b40f-eda38e23a2f0 service nova] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Neutron deleted interface 9560a102-ba69-4b8d-a190-4c328fd75152; detaching it from the instance and deleting it from the info cache
Nov 08 03:55:00 user nova-compute[75014]: DEBUG nova.network.neutron [req-d9fb1495-a60b-427d-936f-a118460c3102 req-697313e1-2a8d-4df4-b40f-eda38e23a2f0 service nova] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:55:00 user nova-compute[75014]: DEBUG nova.compute.manager [req-d9fb1495-a60b-427d-936f-a118460c3102 req-697313e1-2a8d-4df4-b40f-eda38e23a2f0 service nova] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Detach interface failed, port_id=9560a102-ba69-4b8d-a190-4c328fd75152, reason: Instance 2ab81192-8890-499c-ad4b-b93664da45fb could not be found. {{(pid=75014) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 03:55:00 user nova-compute[75014]: DEBUG nova.compute.manager [req-ac04bf8b-04a3-426b-8db0-ae74920870d3 req-b3635805-ca42-46c0-b266-5b7fbbd17284 service nova] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Received event network-vif-plugged-9560a102-ba69-4b8d-a190-4c328fd75152 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ac04bf8b-04a3-426b-8db0-ae74920870d3 req-b3635805-ca42-46c0-b266-5b7fbbd17284 service nova] Acquiring lock "2ab81192-8890-499c-ad4b-b93664da45fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ac04bf8b-04a3-426b-8db0-ae74920870d3 req-b3635805-ca42-46c0-b266-5b7fbbd17284 service nova] Lock "2ab81192-8890-499c-ad4b-b93664da45fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ac04bf8b-04a3-426b-8db0-ae74920870d3 req-b3635805-ca42-46c0-b266-5b7fbbd17284 service nova] Lock "2ab81192-8890-499c-ad4b-b93664da45fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:00 user nova-compute[75014]: DEBUG nova.compute.manager [req-ac04bf8b-04a3-426b-8db0-ae74920870d3 req-b3635805-ca42-46c0-b266-5b7fbbd17284 service nova] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] No waiting events found dispatching network-vif-plugged-9560a102-ba69-4b8d-a190-4c328fd75152 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:55:00 user nova-compute[75014]: WARNING nova.compute.manager [req-ac04bf8b-04a3-426b-8db0-ae74920870d3 req-b3635805-ca42-46c0-b266-5b7fbbd17284 service nova] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Received unexpected event network-vif-plugged-9560a102-ba69-4b8d-a190-4c328fd75152 for instance with vm_state active and task_state deleting.
Nov 08 03:55:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:01 user nova-compute[75014]: DEBUG nova.network.neutron [req-a1162f85-cfe0-4e7b-b32f-6d7d1b50d370 req-30d653dc-0342-4ca7-a55e-860af7f40f50 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Updated VIF entry in instance network info cache for port 22b161cc-78f9-43ab-a91f-bdda3cb031fe. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:55:01 user nova-compute[75014]: DEBUG nova.network.neutron [req-a1162f85-cfe0-4e7b-b32f-6d7d1b50d370 req-30d653dc-0342-4ca7-a55e-860af7f40f50 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Updating instance_info_cache with network_info: [{"id": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "address": "fa:16:3e:e7:72:75", "network": {"id": "f0d5c3f6-95de-4bae-8891-ecf46615f6e0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2062952809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b161cc-78", "ovs_interfaceid": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "address": "fa:16:3e:d1:7b:69", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865f50bd-f6", "ovs_interfaceid": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "address": "fa:16:3e:83:47:72", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea5c8c-9b", "ovs_interfaceid": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1bf169f7-c039-4b88-a7de-3da18a368b14", "address": "fa:16:3e:66:75:a0", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf169f7-c0", "ovs_interfaceid": "1bf169f7-c039-4b88-a7de-3da18a368b14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e", "address": "fa:16:3e:bf:c2:75", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca24a270-f9", "ovs_interfaceid": "ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3e63c197-4437-4b03-82c9-a570406f7d38", "address": "fa:16:3e:6b:d2:09", "network": {"id": "dc41b474-59dc-43ae-9724-45c03cddae19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495507142", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e63c197-44", "ovs_interfaceid": "3e63c197-4437-4b03-82c9-a570406f7d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef47ac6e-fbd7-47f6-bb62-1d2e1d155179", "address": "fa:16:3e:a8:c1:6a", "network": {"id": "dc41b474-59dc-43ae-9724-45c03cddae19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495507142", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef47ac6e-fb", "ovs_interfaceid": "ef47ac6e-fbd7-47f6-bb62-1d2e1d155179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:55:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a1162f85-cfe0-4e7b-b32f-6d7d1b50d370 req-30d653dc-0342-4ca7-a55e-860af7f40f50 service nova] Releasing lock "refresh_cache-e8eb4171-aa3d-48bd-90e1-dc371da7a77b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:55:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Acquiring lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Acquiring lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:04 user nova-compute[75014]: INFO nova.compute.manager [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Terminating instance
Nov 08 03:55:04 user nova-compute[75014]: DEBUG nova.compute.manager [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 03:55:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:04 user nova-compute[75014]: DEBUG nova.compute.manager [req-e02e298d-505a-44af-a3b2-5411abefd400 req-45c35315-e20f-46e4-a7ec-ef974782e105 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-unplugged-22b161cc-78f9-43ab-a91f-bdda3cb031fe {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e02e298d-505a-44af-a3b2-5411abefd400 req-45c35315-e20f-46e4-a7ec-ef974782e105 service nova] Acquiring lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e02e298d-505a-44af-a3b2-5411abefd400 req-45c35315-e20f-46e4-a7ec-ef974782e105 service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e02e298d-505a-44af-a3b2-5411abefd400 req-45c35315-e20f-46e4-a7ec-ef974782e105 service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:04 user nova-compute[75014]: DEBUG nova.compute.manager [req-e02e298d-505a-44af-a3b2-5411abefd400 req-45c35315-e20f-46e4-a7ec-ef974782e105 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] No waiting events found dispatching network-vif-unplugged-22b161cc-78f9-43ab-a91f-bdda3cb031fe {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:55:04 user nova-compute[75014]: DEBUG nova.compute.manager [req-e02e298d-505a-44af-a3b2-5411abefd400 req-45c35315-e20f-46e4-a7ec-ef974782e105 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-unplugged-22b161cc-78f9-43ab-a91f-bdda3cb031fe for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 03:55:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:05 user nova-compute[75014]: DEBUG nova.compute.manager [req-cc91e67e-dbe9-43ae-aee6-49fd5b9e2949 req-6f2f18e9-7c44-4231-8341-b310935ac564 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-unplugged-865f50bd-f6c7-45d9-8fd9-807910ccd477 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-cc91e67e-dbe9-43ae-aee6-49fd5b9e2949 req-6f2f18e9-7c44-4231-8341-b310935ac564 service nova] Acquiring lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-cc91e67e-dbe9-43ae-aee6-49fd5b9e2949 req-6f2f18e9-7c44-4231-8341-b310935ac564 service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-cc91e67e-dbe9-43ae-aee6-49fd5b9e2949 req-6f2f18e9-7c44-4231-8341-b310935ac564 service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:05 user nova-compute[75014]: DEBUG nova.compute.manager [req-cc91e67e-dbe9-43ae-aee6-49fd5b9e2949 req-6f2f18e9-7c44-4231-8341-b310935ac564 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] No waiting events found dispatching network-vif-unplugged-865f50bd-f6c7-45d9-8fd9-807910ccd477 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:55:05 user nova-compute[75014]: DEBUG nova.compute.manager [req-cc91e67e-dbe9-43ae-aee6-49fd5b9e2949 req-6f2f18e9-7c44-4231-8341-b310935ac564 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-unplugged-865f50bd-f6c7-45d9-8fd9-807910ccd477 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 03:55:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:06 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Instance destroyed successfully.
Nov 08 03:55:06 user nova-compute[75014]: DEBUG nova.objects.instance [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Lazy-loading 'resources' on Instance uuid e8eb4171-aa3d-48bd-90e1-dc371da7a77b {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1240423537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1240423537',id=10,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMAMUsnsS0BAVlPK/lbZXgX4HwHuisLn+3uma5f8FEdUnJ0NVdubfRUA7pxoNgCgGlRukeGayveJawKOl/Wf1Q+R5tg5uVlLxhvOrUbJo0dZMB0awYHSdF62JBQPRP+5A==',key_name='tempest-keypair-692880222',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:53:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd6fce809fab44789c36f2981972b5b8',ramdisk_id='',reservation_id='r-5ot67hpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-198201622',owner_user_name='tempest-TaggedBootDevicesTest_v242-198201622-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T03:53:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7a5ed8cff034542baf6697046f9c851',uuid=e8eb4171-aa3d-48bd-90e1-dc371da7a77b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "address": "fa:16:3e:e7:72:75", "network": {"id": "f0d5c3f6-95de-4bae-8891-ecf46615f6e0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2062952809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b161cc-78", "ovs_interfaceid": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converting VIF {"id": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "address": "fa:16:3e:e7:72:75", "network": {"id": "f0d5c3f6-95de-4bae-8891-ecf46615f6e0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2062952809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b161cc-78", "ovs_interfaceid": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:72:75,bridge_name='br-int',has_traffic_filtering=True,id=22b161cc-78f9-43ab-a91f-bdda3cb031fe,network=Network(f0d5c3f6-95de-4bae-8891-ecf46615f6e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b161cc-78') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG os_vif [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:72:75,bridge_name='br-int',has_traffic_filtering=True,id=22b161cc-78f9-43ab-a91f-bdda3cb031fe,network=Network(f0d5c3f6-95de-4bae-8891-ecf46615f6e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b161cc-78') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22b161cc-78, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0fa10d59-2b50-4ae5-bae4-3e25757e4a94) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:06 user nova-compute[75014]: INFO os_vif [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:72:75,bridge_name='br-int',has_traffic_filtering=True,id=22b161cc-78f9-43ab-a91f-bdda3cb031fe,network=Network(f0d5c3f6-95de-4bae-8891-ecf46615f6e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b161cc-78')
Nov 08 03:55:06 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1240423537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1240423537',id=10,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMAMUsnsS0BAVlPK/lbZXgX4HwHuisLn+3uma5f8FEdUnJ0NVdubfRUA7pxoNgCgGlRukeGayveJawKOl/Wf1Q+R5tg5uVlLxhvOrUbJo0dZMB0awYHSdF62JBQPRP+5A==',key_name='tempest-keypair-692880222',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:53:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd6fce809fab44789c36f2981972b5b8',ramdisk_id='',reservation_id='r-5ot67hpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-198201622',owner_user_name='tempest-TaggedBootDevicesTest_v242-198201622-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T03:53:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7a5ed8cff034542baf6697046f9c851',uuid=e8eb4171-aa3d-48bd-90e1-dc371da7a77b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "address": "fa:16:3e:d1:7b:69", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865f50bd-f6", "ovs_interfaceid": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converting VIF {"id": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "address": "fa:16:3e:d1:7b:69", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865f50bd-f6", "ovs_interfaceid": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:7b:69,bridge_name='br-int',has_traffic_filtering=True,id=865f50bd-f6c7-45d9-8fd9-807910ccd477,network=Network(8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap865f50bd-f6') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG os_vif [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:7b:69,bridge_name='br-int',has_traffic_filtering=True,id=865f50bd-f6c7-45d9-8fd9-807910ccd477,network=Network(8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap865f50bd-f6') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap865f50bd-f6, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6629a47-c8bc-4fa4-b414-760ea46e98e5) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:06 user nova-compute[75014]: INFO os_vif [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:7b:69,bridge_name='br-int',has_traffic_filtering=True,id=865f50bd-f6c7-45d9-8fd9-807910ccd477,network=Network(8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap865f50bd-f6')
Nov 08 03:55:06 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1240423537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1240423537',id=10,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMAMUsnsS0BAVlPK/lbZXgX4HwHuisLn+3uma5f8FEdUnJ0NVdubfRUA7pxoNgCgGlRukeGayveJawKOl/Wf1Q+R5tg5uVlLxhvOrUbJo0dZMB0awYHSdF62JBQPRP+5A==',key_name='tempest-keypair-692880222',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:53:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd6fce809fab44789c36f2981972b5b8',ramdisk_id='',reservation_id='r-5ot67hpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-198201622',owner_user_name='tempest-TaggedBootDevicesTest_v242-198201622-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T03:53:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7a5ed8cff034542baf6697046f9c851',uuid=e8eb4171-aa3d-48bd-90e1-dc371da7a77b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "address": "fa:16:3e:83:47:72", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea5c8c-9b", "ovs_interfaceid": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converting VIF {"id": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "address": "fa:16:3e:83:47:72", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea5c8c-9b", "ovs_interfaceid": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:47:72,bridge_name='br-int',has_traffic_filtering=True,id=b8ea5c8c-9b61-42be-bea3-0773a45eddcc,network=Network(8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb8ea5c8c-9b') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG os_vif [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:47:72,bridge_name='br-int',has_traffic_filtering=True,id=b8ea5c8c-9b61-42be-bea3-0773a45eddcc,network=Network(8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb8ea5c8c-9b') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8ea5c8c-9b, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=57ca2181-9879-45a2-9093-31ba43f06d94) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:06 user nova-compute[75014]: INFO os_vif [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:47:72,bridge_name='br-int',has_traffic_filtering=True,id=b8ea5c8c-9b61-42be-bea3-0773a45eddcc,network=Network(8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb8ea5c8c-9b')
Nov 08 03:55:06 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1240423537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1240423537',id=10,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMAMUsnsS0BAVlPK/lbZXgX4HwHuisLn+3uma5f8FEdUnJ0NVdubfRUA7pxoNgCgGlRukeGayveJawKOl/Wf1Q+R5tg5uVlLxhvOrUbJo0dZMB0awYHSdF62JBQPRP+5A==',key_name='tempest-keypair-692880222',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:53:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd6fce809fab44789c36f2981972b5b8',ramdisk_id='',reservation_id='r-5ot67hpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-198201622',owner_user_name='tempest-TaggedBootDevicesTest_v242-198201622-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T03:53:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7a5ed8cff034542baf6697046f9c851',uuid=e8eb4171-aa3d-48bd-90e1-dc371da7a77b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1bf169f7-c039-4b88-a7de-3da18a368b14", "address": "fa:16:3e:66:75:a0", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf169f7-c0", "ovs_interfaceid": "1bf169f7-c039-4b88-a7de-3da18a368b14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converting VIF {"id": "1bf169f7-c039-4b88-a7de-3da18a368b14", "address": "fa:16:3e:66:75:a0", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf169f7-c0", "ovs_interfaceid": "1bf169f7-c039-4b88-a7de-3da18a368b14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:75:a0,bridge_name='br-int',has_traffic_filtering=True,id=1bf169f7-c039-4b88-a7de-3da18a368b14,network=Network(8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf169f7-c0') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG os_vif [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:75:a0,bridge_name='br-int',has_traffic_filtering=True,id=1bf169f7-c039-4b88-a7de-3da18a368b14,network=Network(8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf169f7-c0') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1bf169f7-c0, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=178fe6e5-61d3-4a46-9617-0b6fbce0e976) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG nova.compute.manager [req-b1670b51-1feb-4f66-9f3f-1447f0d17e7c req-2573015b-c367-42b0-83b3-944d8d378dc4 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-plugged-22b161cc-78f9-43ab-a91f-bdda3cb031fe {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b1670b51-1feb-4f66-9f3f-1447f0d17e7c req-2573015b-c367-42b0-83b3-944d8d378dc4 service nova] Acquiring lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b1670b51-1feb-4f66-9f3f-1447f0d17e7c req-2573015b-c367-42b0-83b3-944d8d378dc4 service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b1670b51-1feb-4f66-9f3f-1447f0d17e7c req-2573015b-c367-42b0-83b3-944d8d378dc4 service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG nova.compute.manager [req-b1670b51-1feb-4f66-9f3f-1447f0d17e7c req-2573015b-c367-42b0-83b3-944d8d378dc4 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] No waiting events found dispatching network-vif-plugged-22b161cc-78f9-43ab-a91f-bdda3cb031fe {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:55:07 user nova-compute[75014]: WARNING nova.compute.manager [req-b1670b51-1feb-4f66-9f3f-1447f0d17e7c req-2573015b-c367-42b0-83b3-944d8d378dc4 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received unexpected event network-vif-plugged-22b161cc-78f9-43ab-a91f-bdda3cb031fe for instance with vm_state active and task_state deleting.
Nov 08 03:55:07 user nova-compute[75014]: DEBUG nova.compute.manager [req-b1670b51-1feb-4f66-9f3f-1447f0d17e7c req-2573015b-c367-42b0-83b3-944d8d378dc4 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-unplugged-3e63c197-4437-4b03-82c9-a570406f7d38 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b1670b51-1feb-4f66-9f3f-1447f0d17e7c req-2573015b-c367-42b0-83b3-944d8d378dc4 service nova] Acquiring lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b1670b51-1feb-4f66-9f3f-1447f0d17e7c req-2573015b-c367-42b0-83b3-944d8d378dc4 service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b1670b51-1feb-4f66-9f3f-1447f0d17e7c req-2573015b-c367-42b0-83b3-944d8d378dc4 service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG nova.compute.manager [req-b1670b51-1feb-4f66-9f3f-1447f0d17e7c req-2573015b-c367-42b0-83b3-944d8d378dc4 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] No waiting events found dispatching network-vif-unplugged-3e63c197-4437-4b03-82c9-a570406f7d38 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG nova.compute.manager [req-b1670b51-1feb-4f66-9f3f-1447f0d17e7c req-2573015b-c367-42b0-83b3-944d8d378dc4 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-unplugged-3e63c197-4437-4b03-82c9-a570406f7d38 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG nova.compute.manager [req-b1670b51-1feb-4f66-9f3f-1447f0d17e7c req-2573015b-c367-42b0-83b3-944d8d378dc4 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-plugged-3e63c197-4437-4b03-82c9-a570406f7d38 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b1670b51-1feb-4f66-9f3f-1447f0d17e7c req-2573015b-c367-42b0-83b3-944d8d378dc4 service nova] Acquiring lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b1670b51-1feb-4f66-9f3f-1447f0d17e7c req-2573015b-c367-42b0-83b3-944d8d378dc4 service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b1670b51-1feb-4f66-9f3f-1447f0d17e7c req-2573015b-c367-42b0-83b3-944d8d378dc4 service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG nova.compute.manager [req-b1670b51-1feb-4f66-9f3f-1447f0d17e7c req-2573015b-c367-42b0-83b3-944d8d378dc4 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] No waiting events found dispatching network-vif-plugged-3e63c197-4437-4b03-82c9-a570406f7d38 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:55:07 user nova-compute[75014]: WARNING nova.compute.manager [req-b1670b51-1feb-4f66-9f3f-1447f0d17e7c req-2573015b-c367-42b0-83b3-944d8d378dc4 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received unexpected event network-vif-plugged-3e63c197-4437-4b03-82c9-a570406f7d38 for instance with vm_state active and task_state deleting.
Nov 08 03:55:07 user nova-compute[75014]: INFO os_vif [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:75:a0,bridge_name='br-int',has_traffic_filtering=True,id=1bf169f7-c039-4b88-a7de-3da18a368b14,network=Network(8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf169f7-c0')
Nov 08 03:55:07 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1240423537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1240423537',id=10,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMAMUsnsS0BAVlPK/lbZXgX4HwHuisLn+3uma5f8FEdUnJ0NVdubfRUA7pxoNgCgGlRukeGayveJawKOl/Wf1Q+R5tg5uVlLxhvOrUbJo0dZMB0awYHSdF62JBQPRP+5A==',key_name='tempest-keypair-692880222',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:53:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd6fce809fab44789c36f2981972b5b8',ramdisk_id='',reservation_id='r-5ot67hpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-198201622',owner_user_name='tempest-TaggedBootDevicesTest_v242-198201622-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T03:53:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7a5ed8cff034542baf6697046f9c851',uuid=e8eb4171-aa3d-48bd-90e1-dc371da7a77b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e", "address": "fa:16:3e:bf:c2:75", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca24a270-f9", "ovs_interfaceid": "ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converting VIF {"id": "ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e", "address": "fa:16:3e:bf:c2:75", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca24a270-f9", "ovs_interfaceid": "ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:c2:75,bridge_name='br-int',has_traffic_filtering=True,id=ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e,network=Network(8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca24a270-f9') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_vif [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:c2:75,bridge_name='br-int',has_traffic_filtering=True,id=ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e,network=Network(8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca24a270-f9') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca24a270-f9, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8467bc32-e631-4515-8766-a7ba63462294) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:07 user nova-compute[75014]: INFO os_vif [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:c2:75,bridge_name='br-int',has_traffic_filtering=True,id=ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e,network=Network(8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca24a270-f9')
Nov 08 03:55:07 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1240423537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1240423537',id=10,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMAMUsnsS0BAVlPK/lbZXgX4HwHuisLn+3uma5f8FEdUnJ0NVdubfRUA7pxoNgCgGlRukeGayveJawKOl/Wf1Q+R5tg5uVlLxhvOrUbJo0dZMB0awYHSdF62JBQPRP+5A==',key_name='tempest-keypair-692880222',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:53:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd6fce809fab44789c36f2981972b5b8',ramdisk_id='',reservation_id='r-5ot67hpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-198201622',owner_user_name='tempest-TaggedBootDevicesTest_v242-198201622-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T03:53:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7a5ed8cff034542baf6697046f9c851',uuid=e8eb4171-aa3d-48bd-90e1-dc371da7a77b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e63c197-4437-4b03-82c9-a570406f7d38", "address": "fa:16:3e:6b:d2:09", "network": {"id": "dc41b474-59dc-43ae-9724-45c03cddae19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495507142", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e63c197-44", "ovs_interfaceid": "3e63c197-4437-4b03-82c9-a570406f7d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converting VIF {"id": "3e63c197-4437-4b03-82c9-a570406f7d38", "address": "fa:16:3e:6b:d2:09", "network": {"id": "dc41b474-59dc-43ae-9724-45c03cddae19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495507142", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e63c197-44", "ovs_interfaceid": "3e63c197-4437-4b03-82c9-a570406f7d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:d2:09,bridge_name='br-int',has_traffic_filtering=True,id=3e63c197-4437-4b03-82c9-a570406f7d38,network=Network(dc41b474-59dc-43ae-9724-45c03cddae19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e63c197-44') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_vif [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:d2:09,bridge_name='br-int',has_traffic_filtering=True,id=3e63c197-4437-4b03-82c9-a570406f7d38,network=Network(dc41b474-59dc-43ae-9724-45c03cddae19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e63c197-44') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e63c197-44, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e5609f1e-56de-4b03-8efe-1438a8c1bf83) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:07 user nova-compute[75014]: INFO os_vif [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:d2:09,bridge_name='br-int',has_traffic_filtering=True,id=3e63c197-4437-4b03-82c9-a570406f7d38,network=Network(dc41b474-59dc-43ae-9724-45c03cddae19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e63c197-44')
Nov 08 03:55:07 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1240423537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1240423537',id=10,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMAMUsnsS0BAVlPK/lbZXgX4HwHuisLn+3uma5f8FEdUnJ0NVdubfRUA7pxoNgCgGlRukeGayveJawKOl/Wf1Q+R5tg5uVlLxhvOrUbJo0dZMB0awYHSdF62JBQPRP+5A==',key_name='tempest-keypair-692880222',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:53:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd6fce809fab44789c36f2981972b5b8',ramdisk_id='',reservation_id='r-5ot67hpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-198201622',owner_user_name='tempest-TaggedBootDevicesTest_v242-198201622-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T03:53:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7a5ed8cff034542baf6697046f9c851',uuid=e8eb4171-aa3d-48bd-90e1-dc371da7a77b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef47ac6e-fbd7-47f6-bb62-1d2e1d155179", "address": "fa:16:3e:a8:c1:6a", "network": {"id": "dc41b474-59dc-43ae-9724-45c03cddae19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495507142", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef47ac6e-fb", "ovs_interfaceid": "ef47ac6e-fbd7-47f6-bb62-1d2e1d155179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converting VIF {"id": "ef47ac6e-fbd7-47f6-bb62-1d2e1d155179", "address": "fa:16:3e:a8:c1:6a", "network": {"id": "dc41b474-59dc-43ae-9724-45c03cddae19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495507142", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef47ac6e-fb", "ovs_interfaceid": "ef47ac6e-fbd7-47f6-bb62-1d2e1d155179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:c1:6a,bridge_name='br-int',has_traffic_filtering=True,id=ef47ac6e-fbd7-47f6-bb62-1d2e1d155179,network=Network(dc41b474-59dc-43ae-9724-45c03cddae19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef47ac6e-fb') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_vif [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:c1:6a,bridge_name='br-int',has_traffic_filtering=True,id=ef47ac6e-fbd7-47f6-bb62-1d2e1d155179,network=Network(dc41b474-59dc-43ae-9724-45c03cddae19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef47ac6e-fb') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef47ac6e-fb, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8315e8fa-5e5f-4046-898e-2dfb138ef2af) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:55:07 user nova-compute[75014]: INFO os_vif [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:c1:6a,bridge_name='br-int',has_traffic_filtering=True,id=ef47ac6e-fbd7-47f6-bb62-1d2e1d155179,network=Network(dc41b474-59dc-43ae-9724-45c03cddae19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef47ac6e-fb')
Nov 08 03:55:07 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OcfkZBto', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:55:07 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d900318-8181-48cd-97b7-19c42080f8ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 03:55:07 user nova-compute[75014]: No targets found.
Nov 08 03:55:07 user nova-compute[75014]: iSNS:
Nov 08 03:55:07 user nova-compute[75014]: No targets found.
Nov 08 03:55:07 user nova-compute[75014]: STATIC:
Nov 08 03:55:07 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec
Nov 08 03:55:07 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:55:07 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:55:07 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4
Nov 08 03:55:07 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:55:07 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:55:07 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 03:55:07 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:55:07 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:55:07 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad
Nov 08 03:55:07 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:55:07 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:55:07 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d
Nov 08 03:55:07 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:55:07 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:55:07 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9
Nov 08 03:55:07 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:55:07 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:55:07 user nova-compute[75014]: FIRMWARE:
Nov 08 03:55:07 user nova-compute[75014]: No targets found.
Nov 08 03:55:07 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 03:55:07 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 03:55:07 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87c40cb-8f10-4866-bff1-9728adf5f128]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cebe78-4b58-4d6a-a8a7-8ed46471191f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 03:55:07 user nova-compute[75014]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)
Nov 08 03:55:07 user nova-compute[75014]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)
Nov 08 03:55:07 user nova-compute[75014]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)
Nov 08 03:55:07 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:55:07 user nova-compute[75014]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 (non-flash)
Nov 08 03:55:07 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 03:55:07 user nova-compute[75014]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad (non-flash)
Nov 08 03:55:07 user nova-compute[75014]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)
Nov 08 03:55:07 user nova-compute[75014]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)
Nov 08 03:55:07 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:55:07 user nova-compute[75014]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 (non-flash)
Nov 08 03:55:07 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0418371090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad'): ({'sde'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Removing single pathed devices sde {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55bd6ce-a2e6-4b40-a5b6-6578e63b3bed]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a2fee8-a5f1-4b3f-a492-5de7e63f5978]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Flushing IO for device /dev/sde {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6800bb-fce6-4e35-817b-469106dcb21b]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG nova.compute.manager [req-4272aa44-a13f-4c06-8039-8cd90bc2cabe req-7a2dd541-455c-42f0-89da-aae39621508c service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-plugged-865f50bd-f6c7-45d9-8fd9-807910ccd477 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4272aa44-a13f-4c06-8039-8cd90bc2cabe req-7a2dd541-455c-42f0-89da-aae39621508c service nova] Acquiring lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4272aa44-a13f-4c06-8039-8cd90bc2cabe req-7a2dd541-455c-42f0-89da-aae39621508c service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4272aa44-a13f-4c06-8039-8cd90bc2cabe req-7a2dd541-455c-42f0-89da-aae39621508c service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG nova.compute.manager [req-4272aa44-a13f-4c06-8039-8cd90bc2cabe req-7a2dd541-455c-42f0-89da-aae39621508c service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] No waiting events found dispatching network-vif-plugged-865f50bd-f6c7-45d9-8fd9-807910ccd477 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:55:07 user nova-compute[75014]: WARNING nova.compute.manager [req-4272aa44-a13f-4c06-8039-8cd90bc2cabe req-7a2dd541-455c-42f0-89da-aae39621508c service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received unexpected event network-vif-plugged-865f50bd-f6c7-45d9-8fd9-807910ccd477 for instance with vm_state active and task_state deleting.
Nov 08 03:55:07 user nova-compute[75014]: DEBUG nova.compute.manager [req-4272aa44-a13f-4c06-8039-8cd90bc2cabe req-7a2dd541-455c-42f0-89da-aae39621508c service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-unplugged-ef47ac6e-fbd7-47f6-bb62-1d2e1d155179 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4272aa44-a13f-4c06-8039-8cd90bc2cabe req-7a2dd541-455c-42f0-89da-aae39621508c service nova] Acquiring lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4272aa44-a13f-4c06-8039-8cd90bc2cabe req-7a2dd541-455c-42f0-89da-aae39621508c service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4272aa44-a13f-4c06-8039-8cd90bc2cabe req-7a2dd541-455c-42f0-89da-aae39621508c service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG nova.compute.manager [req-4272aa44-a13f-4c06-8039-8cd90bc2cabe req-7a2dd541-455c-42f0-89da-aae39621508c service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] No waiting events found dispatching network-vif-unplugged-ef47ac6e-fbd7-47f6-bb62-1d2e1d155179 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG nova.compute.manager [req-4272aa44-a13f-4c06-8039-8cd90bc2cabe req-7a2dd541-455c-42f0-89da-aae39621508c service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-unplugged-ef47ac6e-fbd7-47f6-bb62-1d2e1d155179 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG nova.compute.manager [req-4272aa44-a13f-4c06-8039-8cd90bc2cabe req-7a2dd541-455c-42f0-89da-aae39621508c service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-plugged-ef47ac6e-fbd7-47f6-bb62-1d2e1d155179 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4272aa44-a13f-4c06-8039-8cd90bc2cabe req-7a2dd541-455c-42f0-89da-aae39621508c service nova] Acquiring lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4272aa44-a13f-4c06-8039-8cd90bc2cabe req-7a2dd541-455c-42f0-89da-aae39621508c service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4272aa44-a13f-4c06-8039-8cd90bc2cabe req-7a2dd541-455c-42f0-89da-aae39621508c service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG nova.compute.manager [req-4272aa44-a13f-4c06-8039-8cd90bc2cabe req-7a2dd541-455c-42f0-89da-aae39621508c service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] No waiting events found dispatching network-vif-plugged-ef47ac6e-fbd7-47f6-bb62-1d2e1d155179 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:55:07 user nova-compute[75014]: WARNING nova.compute.manager [req-4272aa44-a13f-4c06-8039-8cd90bc2cabe req-7a2dd541-455c-42f0-89da-aae39621508c service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received unexpected event network-vif-plugged-ef47ac6e-fbd7-47f6-bb62-1d2e1d155179 for instance with vm_state active and task_state deleting.
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.068s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc955bc1-b43e-4e0f-94ff-1f1299fefe2e]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] SCSI volumes sde have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[987d71dc-1ff5-45bc-93f4-49f2e7e574c8]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c4c8df-1ec4-4d4c-8656-ea17cfae70f0]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad, portal: 172.16.0.220,3260]
Nov 08 03:55:07 user nova-compute[75014]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad, portal: 172.16.0.220,3260] successful.
Nov 08 03:55:07 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2582dcd2-17c6-4521-b955-cafb600221ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dedc6d6-f322-48b1-ac46-69c9d527bc8f]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] <== disconnect_volume: return (413ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MNzlYxJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:55:07 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[95daf0c9-630a-4274-bc5f-d51899c48929]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 03:55:07 user nova-compute[75014]: No targets found.
Nov 08 03:55:07 user nova-compute[75014]: iSNS:
Nov 08 03:55:07 user nova-compute[75014]: No targets found.
Nov 08 03:55:07 user nova-compute[75014]: STATIC:
Nov 08 03:55:07 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec
Nov 08 03:55:07 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:55:07 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:55:07 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4
Nov 08 03:55:07 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:55:07 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:55:07 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 03:55:07 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:55:07 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:55:07 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d
Nov 08 03:55:07 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:55:07 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:55:07 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9
Nov 08 03:55:07 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:55:07 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:55:07 user nova-compute[75014]: FIRMWARE:
Nov 08 03:55:07 user nova-compute[75014]: No targets found.
Nov 08 03:55:07 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 03:55:07 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 03:55:07 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fae0eab-222a-47df-8746-e7177dd08fd1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[562a9516-e37a-4931-b267-0787709f535d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 03:55:07 user nova-compute[75014]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)
Nov 08 03:55:07 user nova-compute[75014]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)
Nov 08 03:55:07 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:55:07 user nova-compute[75014]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 (non-flash)
Nov 08 03:55:07 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 03:55:07 user nova-compute[75014]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d (non-flash)
Nov 08 03:55:07 user nova-compute[75014]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)
Nov 08 03:55:07 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:55:07 user nova-compute[75014]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 (non-flash)
Nov 08 03:55:07 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f04244d3880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d'): ({'sdb'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Removing single pathed devices sdb {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1c4dca-0940-4567-bb39-7990bb588d0e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[110f20b8-0ab1-445f-bb1a-e37b6179ea64]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Flushing IO for device /dev/sdb {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dd25cb-341b-4e7c-b656-d509511922e4]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[548ab16a-5192-4e0f-a73f-fca48de59ebb]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] SCSI volumes sdb have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[40849831-c305-4925-8712-04a81d52b33b]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b04c80-2e36-4174-af18-1437b9565401]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d, portal: 172.16.0.220,3260]
Nov 08 03:55:07 user nova-compute[75014]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d, portal: 172.16.0.220,3260] successful.
Nov 08 03:55:07 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:915cfc8b-84fe-49c9-b514-353b6cf4578d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5410819a-e88d-401b-8ad6-be5cdfffb300]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] <== disconnect_volume: return (362ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uyoKSREC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:55:07 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9143c39-27a2-4d06-b494-1908ce3206da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 03:55:08 user nova-compute[75014]: No targets found.
Nov 08 03:55:08 user nova-compute[75014]: iSNS:
Nov 08 03:55:08 user nova-compute[75014]: No targets found.
Nov 08 03:55:08 user nova-compute[75014]: STATIC:
Nov 08 03:55:08 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec
Nov 08 03:55:08 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:55:08 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:55:08 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4
Nov 08 03:55:08 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:55:08 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:55:08 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 03:55:08 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:55:08 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:55:08 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9
Nov 08 03:55:08 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:55:08 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:55:08 user nova-compute[75014]: FIRMWARE:
Nov 08 03:55:08 user nova-compute[75014]: No targets found.
Nov 08 03:55:08 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 03:55:08 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 03:55:08 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc263e5f-a40e-4b81-a1fa-5be0e5cf5802]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[731b7c3d-3c28-477a-8677-92b9674f6864]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 03:55:08 user nova-compute[75014]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)
Nov 08 03:55:08 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:55:08 user nova-compute[75014]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 (non-flash)
Nov 08 03:55:08 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 03:55:08 user nova-compute[75014]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 (non-flash)
Nov 08 03:55:08 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:55:08 user nova-compute[75014]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 (non-flash)
Nov 08 03:55:08 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f04244d3880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4'): ({'sdf'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Removing single pathed devices sdf {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae2c25a-3354-4261-b588-435ee2e57619]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d412451-4036-47c6-b711-842e094f84db]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Flushing IO for device /dev/sdf {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[961c8b3b-33d4-4110-b408-cb4810b8b4c0]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.033s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0afa2e4-fcee-40fb-ad23-b43558fe2375]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] SCSI volumes sdf have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4a2645-568f-49ba-975d-4c9deaac4bbe]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f1d22c-8c53-4e9a-adee-4e08b8e0b63c]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4, portal: 172.16.0.220,3260]
Nov 08 03:55:08 user nova-compute[75014]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4, portal: 172.16.0.220,3260] successful.
Nov 08 03:55:08 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3140f712-f683-4bd3-937a-aa1fe47ca9f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d096a7-6f7e-4309-a3b1-02434955a8b1]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] <== disconnect_volume: return (337ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 03:55:08 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Deleting instance files /opt/stack/data/nova/instances/e8eb4171-aa3d-48bd-90e1-dc371da7a77b_del
Nov 08 03:55:08 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Deletion of /opt/stack/data/nova/instances/e8eb4171-aa3d-48bd-90e1-dc371da7a77b_del complete
Nov 08 03:55:08 user nova-compute[75014]: INFO nova.compute.manager [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Took 3.90 seconds to destroy the instance on the hypervisor.
Nov 08 03:55:08 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 03:55:08 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 03:55:09 user nova-compute[75014]: DEBUG nova.compute.manager [req-b4fb3175-faca-4f0a-b99e-7f0fba79e6c5 req-6099a76f-b53d-4aca-860b-54254fff707b service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-unplugged-b8ea5c8c-9b61-42be-bea3-0773a45eddcc {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b4fb3175-faca-4f0a-b99e-7f0fba79e6c5 req-6099a76f-b53d-4aca-860b-54254fff707b service nova] Acquiring lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b4fb3175-faca-4f0a-b99e-7f0fba79e6c5 req-6099a76f-b53d-4aca-860b-54254fff707b service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b4fb3175-faca-4f0a-b99e-7f0fba79e6c5 req-6099a76f-b53d-4aca-860b-54254fff707b service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:09 user nova-compute[75014]: DEBUG nova.compute.manager [req-b4fb3175-faca-4f0a-b99e-7f0fba79e6c5 req-6099a76f-b53d-4aca-860b-54254fff707b service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] No waiting events found dispatching network-vif-unplugged-b8ea5c8c-9b61-42be-bea3-0773a45eddcc {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:55:09 user nova-compute[75014]: DEBUG nova.compute.manager [req-b4fb3175-faca-4f0a-b99e-7f0fba79e6c5 req-6099a76f-b53d-4aca-860b-54254fff707b service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-unplugged-b8ea5c8c-9b61-42be-bea3-0773a45eddcc for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 03:55:11 user nova-compute[75014]: DEBUG nova.compute.manager [req-e91f2d34-99cd-4c42-a290-60b1e3a911a9 req-dfea779c-1bd6-447a-9d8e-633b90f674fe service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-plugged-b8ea5c8c-9b61-42be-bea3-0773a45eddcc {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e91f2d34-99cd-4c42-a290-60b1e3a911a9 req-dfea779c-1bd6-447a-9d8e-633b90f674fe service nova] Acquiring lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e91f2d34-99cd-4c42-a290-60b1e3a911a9 req-dfea779c-1bd6-447a-9d8e-633b90f674fe service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e91f2d34-99cd-4c42-a290-60b1e3a911a9 req-dfea779c-1bd6-447a-9d8e-633b90f674fe service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:11 user nova-compute[75014]: DEBUG nova.compute.manager [req-e91f2d34-99cd-4c42-a290-60b1e3a911a9 req-dfea779c-1bd6-447a-9d8e-633b90f674fe service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] No waiting events found dispatching network-vif-plugged-b8ea5c8c-9b61-42be-bea3-0773a45eddcc {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:55:11 user nova-compute[75014]: WARNING nova.compute.manager [req-e91f2d34-99cd-4c42-a290-60b1e3a911a9 req-dfea779c-1bd6-447a-9d8e-633b90f674fe service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received unexpected event network-vif-plugged-b8ea5c8c-9b61-42be-bea3-0773a45eddcc for instance with vm_state active and task_state deleting.
Nov 08 03:55:11 user nova-compute[75014]: DEBUG nova.compute.manager [req-e91f2d34-99cd-4c42-a290-60b1e3a911a9 req-dfea779c-1bd6-447a-9d8e-633b90f674fe service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-unplugged-1bf169f7-c039-4b88-a7de-3da18a368b14 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e91f2d34-99cd-4c42-a290-60b1e3a911a9 req-dfea779c-1bd6-447a-9d8e-633b90f674fe service nova] Acquiring lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e91f2d34-99cd-4c42-a290-60b1e3a911a9 req-dfea779c-1bd6-447a-9d8e-633b90f674fe service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e91f2d34-99cd-4c42-a290-60b1e3a911a9 req-dfea779c-1bd6-447a-9d8e-633b90f674fe service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:11 user nova-compute[75014]: DEBUG nova.compute.manager [req-e91f2d34-99cd-4c42-a290-60b1e3a911a9 req-dfea779c-1bd6-447a-9d8e-633b90f674fe service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] No waiting events found dispatching network-vif-unplugged-1bf169f7-c039-4b88-a7de-3da18a368b14 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:55:11 user nova-compute[75014]: DEBUG nova.compute.manager [req-e91f2d34-99cd-4c42-a290-60b1e3a911a9 req-dfea779c-1bd6-447a-9d8e-633b90f674fe service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-unplugged-1bf169f7-c039-4b88-a7de-3da18a368b14 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 03:55:11 user nova-compute[75014]: DEBUG nova.compute.manager [req-e91f2d34-99cd-4c42-a290-60b1e3a911a9 req-dfea779c-1bd6-447a-9d8e-633b90f674fe service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-plugged-1bf169f7-c039-4b88-a7de-3da18a368b14 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e91f2d34-99cd-4c42-a290-60b1e3a911a9 req-dfea779c-1bd6-447a-9d8e-633b90f674fe service nova] Acquiring lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e91f2d34-99cd-4c42-a290-60b1e3a911a9 req-dfea779c-1bd6-447a-9d8e-633b90f674fe service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e91f2d34-99cd-4c42-a290-60b1e3a911a9 req-dfea779c-1bd6-447a-9d8e-633b90f674fe service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:11 user nova-compute[75014]: DEBUG nova.compute.manager [req-e91f2d34-99cd-4c42-a290-60b1e3a911a9 req-dfea779c-1bd6-447a-9d8e-633b90f674fe service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] No waiting events found dispatching network-vif-plugged-1bf169f7-c039-4b88-a7de-3da18a368b14 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:55:11 user nova-compute[75014]: WARNING nova.compute.manager [req-e91f2d34-99cd-4c42-a290-60b1e3a911a9 req-dfea779c-1bd6-447a-9d8e-633b90f674fe service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received unexpected event network-vif-plugged-1bf169f7-c039-4b88-a7de-3da18a368b14 for instance with vm_state active and task_state deleting.
Nov 08 03:55:11 user nova-compute[75014]: DEBUG nova.compute.manager [req-e91f2d34-99cd-4c42-a290-60b1e3a911a9 req-dfea779c-1bd6-447a-9d8e-633b90f674fe service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-unplugged-ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e91f2d34-99cd-4c42-a290-60b1e3a911a9 req-dfea779c-1bd6-447a-9d8e-633b90f674fe service nova] Acquiring lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e91f2d34-99cd-4c42-a290-60b1e3a911a9 req-dfea779c-1bd6-447a-9d8e-633b90f674fe service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e91f2d34-99cd-4c42-a290-60b1e3a911a9 req-dfea779c-1bd6-447a-9d8e-633b90f674fe service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:11 user nova-compute[75014]: DEBUG nova.compute.manager [req-e91f2d34-99cd-4c42-a290-60b1e3a911a9 req-dfea779c-1bd6-447a-9d8e-633b90f674fe service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] No waiting events found dispatching network-vif-unplugged-ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:55:11 user nova-compute[75014]: DEBUG nova.compute.manager [req-e91f2d34-99cd-4c42-a290-60b1e3a911a9 req-dfea779c-1bd6-447a-9d8e-633b90f674fe service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-unplugged-ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 03:55:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:13 user nova-compute[75014]: INFO nova.compute.manager [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Rescuing
Nov 08 03:55:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "refresh_cache-9f205fe5-576f-4ef0-874b-1544c0307a7e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:55:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquired lock "refresh_cache-9f205fe5-576f-4ef0-874b-1544c0307a7e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:55:13 user nova-compute[75014]: DEBUG nova.network.neutron [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 03:55:13 user nova-compute[75014]: DEBUG nova.compute.manager [req-d31cf2f9-fed2-4e73-bc92-b86f736b9cdd req-16d1752d-9050-411b-a00c-e108507b8a32 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-plugged-ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d31cf2f9-fed2-4e73-bc92-b86f736b9cdd req-16d1752d-9050-411b-a00c-e108507b8a32 service nova] Acquiring lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d31cf2f9-fed2-4e73-bc92-b86f736b9cdd req-16d1752d-9050-411b-a00c-e108507b8a32 service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d31cf2f9-fed2-4e73-bc92-b86f736b9cdd req-16d1752d-9050-411b-a00c-e108507b8a32 service nova] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:13 user nova-compute[75014]: DEBUG nova.compute.manager [req-d31cf2f9-fed2-4e73-bc92-b86f736b9cdd req-16d1752d-9050-411b-a00c-e108507b8a32 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] No waiting events found dispatching network-vif-plugged-ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:55:13 user nova-compute[75014]: WARNING nova.compute.manager [req-d31cf2f9-fed2-4e73-bc92-b86f736b9cdd req-16d1752d-9050-411b-a00c-e108507b8a32 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received unexpected event network-vif-plugged-ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e for instance with vm_state active and task_state deleting.
Nov 08 03:55:13 user nova-compute[75014]: DEBUG nova.compute.manager [req-d31cf2f9-fed2-4e73-bc92-b86f736b9cdd req-16d1752d-9050-411b-a00c-e108507b8a32 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-deleted-3e63c197-4437-4b03-82c9-a570406f7d38 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:13 user nova-compute[75014]: INFO nova.compute.manager [req-d31cf2f9-fed2-4e73-bc92-b86f736b9cdd req-16d1752d-9050-411b-a00c-e108507b8a32 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Neutron deleted interface 3e63c197-4437-4b03-82c9-a570406f7d38; detaching it from the instance and deleting it from the info cache
Nov 08 03:55:13 user nova-compute[75014]: DEBUG nova.network.neutron [req-d31cf2f9-fed2-4e73-bc92-b86f736b9cdd req-16d1752d-9050-411b-a00c-e108507b8a32 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Updating instance_info_cache with network_info: [{"id": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "address": "fa:16:3e:e7:72:75", "network": {"id": "f0d5c3f6-95de-4bae-8891-ecf46615f6e0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2062952809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b161cc-78", "ovs_interfaceid": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "address": "fa:16:3e:d1:7b:69", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865f50bd-f6", "ovs_interfaceid": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "address": "fa:16:3e:83:47:72", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea5c8c-9b", "ovs_interfaceid": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1bf169f7-c039-4b88-a7de-3da18a368b14", "address": "fa:16:3e:66:75:a0", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf169f7-c0", "ovs_interfaceid": "1bf169f7-c039-4b88-a7de-3da18a368b14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e", "address": "fa:16:3e:bf:c2:75", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca24a270-f9", "ovs_interfaceid": "ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef47ac6e-fbd7-47f6-bb62-1d2e1d155179", "address": "fa:16:3e:a8:c1:6a", "network": {"id": "dc41b474-59dc-43ae-9724-45c03cddae19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495507142", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef47ac6e-fb", "ovs_interfaceid": "ef47ac6e-fbd7-47f6-bb62-1d2e1d155179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:55:13 user nova-compute[75014]: DEBUG nova.compute.manager [req-d31cf2f9-fed2-4e73-bc92-b86f736b9cdd req-16d1752d-9050-411b-a00c-e108507b8a32 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Detach interface failed, port_id=3e63c197-4437-4b03-82c9-a570406f7d38, reason: Instance e8eb4171-aa3d-48bd-90e1-dc371da7a77b could not be found. {{(pid=75014) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 03:55:13 user nova-compute[75014]: DEBUG nova.compute.manager [req-d31cf2f9-fed2-4e73-bc92-b86f736b9cdd req-16d1752d-9050-411b-a00c-e108507b8a32 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-deleted-1bf169f7-c039-4b88-a7de-3da18a368b14 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:13 user nova-compute[75014]: INFO nova.compute.manager [req-d31cf2f9-fed2-4e73-bc92-b86f736b9cdd req-16d1752d-9050-411b-a00c-e108507b8a32 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Neutron deleted interface 1bf169f7-c039-4b88-a7de-3da18a368b14; detaching it from the instance and deleting it from the info cache
Nov 08 03:55:13 user nova-compute[75014]: DEBUG nova.network.neutron [req-d31cf2f9-fed2-4e73-bc92-b86f736b9cdd req-16d1752d-9050-411b-a00c-e108507b8a32 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Updating instance_info_cache with network_info: [{"id": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "address": "fa:16:3e:e7:72:75", "network": {"id": "f0d5c3f6-95de-4bae-8891-ecf46615f6e0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2062952809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b161cc-78", "ovs_interfaceid": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "address": "fa:16:3e:d1:7b:69", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865f50bd-f6", "ovs_interfaceid": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "address": "fa:16:3e:83:47:72", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea5c8c-9b", "ovs_interfaceid": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e", "address": "fa:16:3e:bf:c2:75", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca24a270-f9", "ovs_interfaceid": "ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef47ac6e-fbd7-47f6-bb62-1d2e1d155179", "address": "fa:16:3e:a8:c1:6a", "network": {"id": "dc41b474-59dc-43ae-9724-45c03cddae19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495507142", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef47ac6e-fb", "ovs_interfaceid": "ef47ac6e-fbd7-47f6-bb62-1d2e1d155179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:55:13 user nova-compute[75014]: DEBUG nova.compute.manager [req-d31cf2f9-fed2-4e73-bc92-b86f736b9cdd req-16d1752d-9050-411b-a00c-e108507b8a32 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Detach interface failed, port_id=1bf169f7-c039-4b88-a7de-3da18a368b14, reason: Instance e8eb4171-aa3d-48bd-90e1-dc371da7a77b could not be found. {{(pid=75014) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 03:55:13 user nova-compute[75014]: DEBUG nova.compute.manager [req-d31cf2f9-fed2-4e73-bc92-b86f736b9cdd req-16d1752d-9050-411b-a00c-e108507b8a32 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-deleted-ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:13 user nova-compute[75014]: INFO nova.compute.manager [req-d31cf2f9-fed2-4e73-bc92-b86f736b9cdd req-16d1752d-9050-411b-a00c-e108507b8a32 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Neutron deleted interface ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e; detaching it from the instance and deleting it from the info cache
Nov 08 03:55:13 user nova-compute[75014]: DEBUG nova.network.neutron [req-d31cf2f9-fed2-4e73-bc92-b86f736b9cdd req-16d1752d-9050-411b-a00c-e108507b8a32 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Updating instance_info_cache with network_info: [{"id": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "address": "fa:16:3e:e7:72:75", "network": {"id": "f0d5c3f6-95de-4bae-8891-ecf46615f6e0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2062952809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b161cc-78", "ovs_interfaceid": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "address": "fa:16:3e:d1:7b:69", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865f50bd-f6", "ovs_interfaceid": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "address": "fa:16:3e:83:47:72", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea5c8c-9b", "ovs_interfaceid": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ef47ac6e-fbd7-47f6-bb62-1d2e1d155179", "address": "fa:16:3e:a8:c1:6a", "network": {"id": "dc41b474-59dc-43ae-9724-45c03cddae19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495507142", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef47ac6e-fb", "ovs_interfaceid": "ef47ac6e-fbd7-47f6-bb62-1d2e1d155179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:55:13 user nova-compute[75014]: DEBUG nova.compute.manager [req-d31cf2f9-fed2-4e73-bc92-b86f736b9cdd req-16d1752d-9050-411b-a00c-e108507b8a32 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Detach interface failed, port_id=ca24a270-f9f8-40b4-9ad2-aa82d8baaa0e, reason: Instance e8eb4171-aa3d-48bd-90e1-dc371da7a77b could not be found. {{(pid=75014) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 03:55:13 user nova-compute[75014]: DEBUG nova.compute.manager [req-d31cf2f9-fed2-4e73-bc92-b86f736b9cdd req-16d1752d-9050-411b-a00c-e108507b8a32 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-deleted-ef47ac6e-fbd7-47f6-bb62-1d2e1d155179 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:13 user nova-compute[75014]: INFO nova.compute.manager [req-d31cf2f9-fed2-4e73-bc92-b86f736b9cdd req-16d1752d-9050-411b-a00c-e108507b8a32 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Neutron deleted interface ef47ac6e-fbd7-47f6-bb62-1d2e1d155179; detaching it from the instance and deleting it from the info cache
Nov 08 03:55:13 user nova-compute[75014]: DEBUG nova.network.neutron [req-d31cf2f9-fed2-4e73-bc92-b86f736b9cdd req-16d1752d-9050-411b-a00c-e108507b8a32 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Updating instance_info_cache with network_info: [{"id": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "address": "fa:16:3e:e7:72:75", "network": {"id": "f0d5c3f6-95de-4bae-8891-ecf46615f6e0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2062952809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b161cc-78", "ovs_interfaceid": "22b161cc-78f9-43ab-a91f-bdda3cb031fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "address": "fa:16:3e:d1:7b:69", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865f50bd-f6", "ovs_interfaceid": "865f50bd-f6c7-45d9-8fd9-807910ccd477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "address": "fa:16:3e:83:47:72", "network": {"id": "8da0db40-89cd-42c9-bb0c-6ce5ed2e23c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1211275428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd6fce809fab44789c36f2981972b5b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ea5c8c-9b", "ovs_interfaceid": "b8ea5c8c-9b61-42be-bea3-0773a45eddcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:55:13 user nova-compute[75014]: DEBUG nova.compute.manager [req-d31cf2f9-fed2-4e73-bc92-b86f736b9cdd req-16d1752d-9050-411b-a00c-e108507b8a32 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Detach interface failed, port_id=ef47ac6e-fbd7-47f6-bb62-1d2e1d155179, reason: Instance e8eb4171-aa3d-48bd-90e1-dc371da7a77b could not be found. {{(pid=75014) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 03:55:13 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:55:13 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Took 5.05 seconds to deallocate network for instance.
Nov 08 03:55:13 user nova-compute[75014]: DEBUG nova.network.neutron [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Updating instance_info_cache with network_info: [{"id": "4979eddc-54c6-46e4-987a-640c4ccade99", "address": "fa:16:3e:4c:b6:69", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4979eddc-54", "ovs_interfaceid": "4979eddc-54c6-46e4-987a-640c4ccade99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:55:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Releasing lock "refresh_cache-9f205fe5-576f-4ef0-874b-1544c0307a7e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:55:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:14 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Instance destroyed successfully.
Nov 08 03:55:14 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Attempting rescue
Nov 08 03:55:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75014) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 03:55:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Instance directory exists: not creating {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 03:55:14 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Creating image(s)
Nov 08 03:55:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "/opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "/opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.024s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:14 user nova-compute[75014]: DEBUG nova.objects.instance [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9f205fe5-576f-4ef0-874b-1544c0307a7e {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:55:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.208s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk.rescue {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk.rescue" returned: 0 in 0.050s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:14 user nova-compute[75014]: DEBUG nova.objects.instance [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lazy-loading 'migration_context' on Instance uuid 9f205fe5-576f-4ef0-874b-1544c0307a7e {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:55:14 user nova-compute[75014]: DEBUG nova.objects.base [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Object Instance<9f205fe5-576f-4ef0-874b-1544c0307a7e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 03:55:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 03:55:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Start _get_guest_xml network_info=[{"id": "4979eddc-54c6-46e4-987a-640c4ccade99", "address": "fa:16:3e:4c:b6:69", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "vif_mac": "fa:16:3e:4c:b6:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4979eddc-54", "ovs_interfaceid": "4979eddc-54c6-46e4-987a-640c4ccade99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '877f8699-2084-427a-babd-cf4f98c3b417', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 03:55:14 user nova-compute[75014]: DEBUG nova.objects.instance [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lazy-loading 'resources' on Instance uuid 9f205fe5-576f-4ef0-874b-1544c0307a7e {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:55:14 user nova-compute[75014]: DEBUG nova.objects.base [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Object Instance<9f205fe5-576f-4ef0-874b-1544c0307a7e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 03:55:14 user nova-compute[75014]: DEBUG nova.objects.instance [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lazy-loading 'numa_topology' on Instance uuid 9f205fe5-576f-4ef0-874b-1544c0307a7e {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:55:14 user nova-compute[75014]: DEBUG nova.objects.base [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Object Instance<9f205fe5-576f-4ef0-874b-1544c0307a7e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 03:55:14 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:55:15 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:55:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG nova.objects.instance [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9f205fe5-576f-4ef0-874b-1544c0307a7e {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG nova.objects.base [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Object Instance<9f205fe5-576f-4ef0-874b-1544c0307a7e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-577890555',display_name='tempest-ServerRescueNegativeTestJSON-server-577890555',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-577890555',id=1,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:49:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b48713cc3a8e4082b76fc0408088c607',ramdisk_id='',reservation_id='r-wy8e0crs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1450625183',owner_user_name='tempest-ServerRescueNegativeTestJSON-1450625183-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:49:46Z,user_data=None,user_id='ffadb91b73464e559344658dd11bf60d',uuid=9f205fe5-576f-4ef0-874b-1544c0307a7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4979eddc-54c6-46e4-987a-640c4ccade99", "address": "fa:16:3e:4c:b6:69", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "vif_mac": "fa:16:3e:4c:b6:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4979eddc-54", "ovs_interfaceid": "4979eddc-54c6-46e4-987a-640c4ccade99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Converting VIF {"id": "4979eddc-54c6-46e4-987a-640c4ccade99", "address": "fa:16:3e:4c:b6:69", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "vif_mac": "fa:16:3e:4c:b6:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4979eddc-54", "ovs_interfaceid": "4979eddc-54c6-46e4-987a-640c4ccade99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:b6:69,bridge_name='br-int',has_traffic_filtering=True,id=4979eddc-54c6-46e4-987a-640c4ccade99,network=Network(982531ca-8a2f-41de-b62e-5b43b6a45a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4979eddc-54') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG nova.objects.instance [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f205fe5-576f-4ef0-874b-1544c0307a7e {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG nova.objects.base [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Object Instance<9f205fe5-576f-4ef0-874b-1544c0307a7e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] End _get_guest_xml xml=<domain type="kvm">
Nov 08 03:55:15 user nova-compute[75014]:   <uuid>9f205fe5-576f-4ef0-874b-1544c0307a7e</uuid>
Nov 08 03:55:15 user nova-compute[75014]:   <name>instance-00000001</name>
Nov 08 03:55:15 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 03:55:15 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 03:55:15 user nova-compute[75014]:   <metadata>
Nov 08 03:55:15 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 03:55:15 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 03:55:15 user nova-compute[75014]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-577890555</nova:name>
Nov 08 03:55:15 user nova-compute[75014]:       <nova:creationTime>2023-11-08 03:55:15</nova:creationTime>
Nov 08 03:55:15 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 03:55:15 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 03:55:15 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 03:55:15 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 03:55:15 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 03:55:15 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 03:55:15 user nova-compute[75014]:       </nova:flavor>
Nov 08 03:55:15 user nova-compute[75014]:       <nova:owner>
Nov 08 03:55:15 user nova-compute[75014]:         <nova:user uuid="ffadb91b73464e559344658dd11bf60d">tempest-ServerRescueNegativeTestJSON-1450625183-project-member</nova:user>
Nov 08 03:55:15 user nova-compute[75014]:         <nova:project uuid="b48713cc3a8e4082b76fc0408088c607">tempest-ServerRescueNegativeTestJSON-1450625183</nova:project>
Nov 08 03:55:15 user nova-compute[75014]:       </nova:owner>
Nov 08 03:55:15 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 03:55:15 user nova-compute[75014]:       <nova:ports>
Nov 08 03:55:15 user nova-compute[75014]:         <nova:port uuid="4979eddc-54c6-46e4-987a-640c4ccade99">
Nov 08 03:55:15 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 03:55:15 user nova-compute[75014]:         </nova:port>
Nov 08 03:55:15 user nova-compute[75014]:       </nova:ports>
Nov 08 03:55:15 user nova-compute[75014]:     </nova:instance>
Nov 08 03:55:15 user nova-compute[75014]:   </metadata>
Nov 08 03:55:15 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 03:55:15 user nova-compute[75014]:     <system>
Nov 08 03:55:15 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 03:55:15 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 03:55:15 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 03:55:15 user nova-compute[75014]:       <entry name="serial">9f205fe5-576f-4ef0-874b-1544c0307a7e</entry>
Nov 08 03:55:15 user nova-compute[75014]:       <entry name="uuid">9f205fe5-576f-4ef0-874b-1544c0307a7e</entry>
Nov 08 03:55:15 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 03:55:15 user nova-compute[75014]:     </system>
Nov 08 03:55:15 user nova-compute[75014]:   </sysinfo>
Nov 08 03:55:15 user nova-compute[75014]:   <os>
Nov 08 03:55:15 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 03:55:15 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 03:55:15 user nova-compute[75014]:   </os>
Nov 08 03:55:15 user nova-compute[75014]:   <features>
Nov 08 03:55:15 user nova-compute[75014]:     <acpi/>
Nov 08 03:55:15 user nova-compute[75014]:     <apic/>
Nov 08 03:55:15 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 03:55:15 user nova-compute[75014]:   </features>
Nov 08 03:55:15 user nova-compute[75014]:   <clock offset="utc">
Nov 08 03:55:15 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 03:55:15 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 03:55:15 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 03:55:15 user nova-compute[75014]:   </clock>
Nov 08 03:55:15 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 03:55:15 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 03:55:15 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 03:55:15 user nova-compute[75014]:   </cpu>
Nov 08 03:55:15 user nova-compute[75014]:   <devices>
Nov 08 03:55:15 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 03:55:15 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 03:55:15 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk.rescue"/>
Nov 08 03:55:15 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 03:55:15 user nova-compute[75014]:     </disk>
Nov 08 03:55:15 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 03:55:15 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 03:55:15 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk"/>
Nov 08 03:55:15 user nova-compute[75014]:       <target dev="vdb" bus="virtio"/>
Nov 08 03:55:15 user nova-compute[75014]:     </disk>
Nov 08 03:55:15 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:55:15 user nova-compute[75014]:       <mac address="fa:16:3e:4c:b6:69"/>
Nov 08 03:55:15 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:55:15 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:55:15 user nova-compute[75014]:       <target dev="tap4979eddc-54"/>
Nov 08 03:55:15 user nova-compute[75014]:     </interface>
Nov 08 03:55:15 user nova-compute[75014]:     <serial type="pty">
Nov 08 03:55:15 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/console.log" append="off"/>
Nov 08 03:55:15 user nova-compute[75014]:     </serial>
Nov 08 03:55:15 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 03:55:15 user nova-compute[75014]:     <video>
Nov 08 03:55:15 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:55:15 user nova-compute[75014]:     </video>
Nov 08 03:55:15 user nova-compute[75014]:     <rng model="virtio">
Nov 08 03:55:15 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 03:55:15 user nova-compute[75014]:     </rng>
Nov 08 03:55:15 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 03:55:15 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 03:55:15 user nova-compute[75014]:       <stats period="10"/>
Nov 08 03:55:15 user nova-compute[75014]:     </memballoon>
Nov 08 03:55:15 user nova-compute[75014]:   </devices>
Nov 08 03:55:15 user nova-compute[75014]: </domain>
Nov 08 03:55:15 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 03:55:15 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Instance destroyed successfully.
Nov 08 03:55:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] No VIF found with MAC fa:16:3e:4c:b6:69, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG nova.compute.manager [req-578831c7-3564-4c57-9bdf-8c16ca00a8cc req-9a997a63-ac78-4841-a34e-12a2dda5a705 service nova] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Received event network-vif-deleted-22b161cc-78f9-43ab-a91f-bdda3cb031fe {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG nova.compute.manager [req-578831c7-3564-4c57-9bdf-8c16ca00a8cc req-9a997a63-ac78-4841-a34e-12a2dda5a705 service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Received event network-vif-unplugged-4979eddc-54c6-46e4-987a-640c4ccade99 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-578831c7-3564-4c57-9bdf-8c16ca00a8cc req-9a997a63-ac78-4841-a34e-12a2dda5a705 service nova] Acquiring lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-578831c7-3564-4c57-9bdf-8c16ca00a8cc req-9a997a63-ac78-4841-a34e-12a2dda5a705 service nova] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-578831c7-3564-4c57-9bdf-8c16ca00a8cc req-9a997a63-ac78-4841-a34e-12a2dda5a705 service nova] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG nova.compute.manager [req-578831c7-3564-4c57-9bdf-8c16ca00a8cc req-9a997a63-ac78-4841-a34e-12a2dda5a705 service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] No waiting events found dispatching network-vif-unplugged-4979eddc-54c6-46e4-987a-640c4ccade99 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:55:15 user nova-compute[75014]: WARNING nova.compute.manager [req-578831c7-3564-4c57-9bdf-8c16ca00a8cc req-9a997a63-ac78-4841-a34e-12a2dda5a705 service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Received unexpected event network-vif-unplugged-4979eddc-54c6-46e4-987a-640c4ccade99 for instance with vm_state active and task_state rescuing.
Nov 08 03:55:15 user nova-compute[75014]: DEBUG nova.compute.manager [req-578831c7-3564-4c57-9bdf-8c16ca00a8cc req-9a997a63-ac78-4841-a34e-12a2dda5a705 service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Received event network-vif-plugged-4979eddc-54c6-46e4-987a-640c4ccade99 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-578831c7-3564-4c57-9bdf-8c16ca00a8cc req-9a997a63-ac78-4841-a34e-12a2dda5a705 service nova] Acquiring lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-578831c7-3564-4c57-9bdf-8c16ca00a8cc req-9a997a63-ac78-4841-a34e-12a2dda5a705 service nova] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-578831c7-3564-4c57-9bdf-8c16ca00a8cc req-9a997a63-ac78-4841-a34e-12a2dda5a705 service nova] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:15 user nova-compute[75014]: DEBUG nova.compute.manager [req-578831c7-3564-4c57-9bdf-8c16ca00a8cc req-9a997a63-ac78-4841-a34e-12a2dda5a705 service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] No waiting events found dispatching network-vif-plugged-4979eddc-54c6-46e4-987a-640c4ccade99 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:55:15 user nova-compute[75014]: WARNING nova.compute.manager [req-578831c7-3564-4c57-9bdf-8c16ca00a8cc req-9a997a63-ac78-4841-a34e-12a2dda5a705 service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Received unexpected event network-vif-plugged-4979eddc-54c6-46e4-987a-640c4ccade99 for instance with vm_state active and task_state rescuing.
Nov 08 03:55:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:17 user nova-compute[75014]: INFO nova.compute.manager [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] [instance: e8eb4171-aa3d-48bd-90e1-dc371da7a77b] Took 3.68 seconds to detach 3 volumes for instance.
Nov 08 03:55:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:17 user nova-compute[75014]: DEBUG nova.compute.manager [req-b7a7780c-6b81-4afe-9140-d1ae6b452d6d req-652ea960-ac39-4916-acd3-3089c9bdd33a service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Received event network-vif-plugged-4979eddc-54c6-46e4-987a-640c4ccade99 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b7a7780c-6b81-4afe-9140-d1ae6b452d6d req-652ea960-ac39-4916-acd3-3089c9bdd33a service nova] Acquiring lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b7a7780c-6b81-4afe-9140-d1ae6b452d6d req-652ea960-ac39-4916-acd3-3089c9bdd33a service nova] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b7a7780c-6b81-4afe-9140-d1ae6b452d6d req-652ea960-ac39-4916-acd3-3089c9bdd33a service nova] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:17 user nova-compute[75014]: DEBUG nova.compute.manager [req-b7a7780c-6b81-4afe-9140-d1ae6b452d6d req-652ea960-ac39-4916-acd3-3089c9bdd33a service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] No waiting events found dispatching network-vif-plugged-4979eddc-54c6-46e4-987a-640c4ccade99 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:55:17 user nova-compute[75014]: WARNING nova.compute.manager [req-b7a7780c-6b81-4afe-9140-d1ae6b452d6d req-652ea960-ac39-4916-acd3-3089c9bdd33a service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Received unexpected event network-vif-plugged-4979eddc-54c6-46e4-987a-640c4ccade99 for instance with vm_state active and task_state rescuing.
Nov 08 03:55:17 user nova-compute[75014]: DEBUG nova.compute.manager [req-b7a7780c-6b81-4afe-9140-d1ae6b452d6d req-652ea960-ac39-4916-acd3-3089c9bdd33a service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Received event network-vif-plugged-4979eddc-54c6-46e4-987a-640c4ccade99 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b7a7780c-6b81-4afe-9140-d1ae6b452d6d req-652ea960-ac39-4916-acd3-3089c9bdd33a service nova] Acquiring lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b7a7780c-6b81-4afe-9140-d1ae6b452d6d req-652ea960-ac39-4916-acd3-3089c9bdd33a service nova] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b7a7780c-6b81-4afe-9140-d1ae6b452d6d req-652ea960-ac39-4916-acd3-3089c9bdd33a service nova] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:17 user nova-compute[75014]: DEBUG nova.compute.manager [req-b7a7780c-6b81-4afe-9140-d1ae6b452d6d req-652ea960-ac39-4916-acd3-3089c9bdd33a service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] No waiting events found dispatching network-vif-plugged-4979eddc-54c6-46e4-987a-640c4ccade99 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:55:17 user nova-compute[75014]: WARNING nova.compute.manager [req-b7a7780c-6b81-4afe-9140-d1ae6b452d6d req-652ea960-ac39-4916-acd3-3089c9bdd33a service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Received unexpected event network-vif-plugged-4979eddc-54c6-46e4-987a-640c4ccade99 for instance with vm_state active and task_state rescuing.
Nov 08 03:55:17 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:55:17 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:55:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:17 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Deleted allocations for instance e8eb4171-aa3d-48bd-90e1-dc371da7a77b
Nov 08 03:55:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c73c5605-32b9-4982-b429-e39595ddda3f tempest-TaggedBootDevicesTest_v242-198201622 tempest-TaggedBootDevicesTest_v242-198201622-project-member] Lock "e8eb4171-aa3d-48bd-90e1-dc371da7a77b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.280s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:19 user nova-compute[75014]: DEBUG nova.compute.manager [None req-b6875756-654e-495a-bbed-9d493da1d77a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:55:21 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:27 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:55:27 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:55:27 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:55:27 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:55:27 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:55:27 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:55:27 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:55:27 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:55:27 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 03:55:27 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Skipping network cache update for instance because it is being deleted. {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 08 03:55:27 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Didn't find any instances for network info cache update. {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 03:55:28 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:55:28 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 03:55:28 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:55:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:28 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 03:55:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 03:55:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 03:55:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4848bd0b-c05f-4938-806b-a36bfdb043a7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4848bd0b-c05f-4938-806b-a36bfdb043a7/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4848bd0b-c05f-4938-806b-a36bfdb043a7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4848bd0b-c05f-4938-806b-a36bfdb043a7/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:32 user nova-compute[75014]: INFO nova.compute.manager [None req-6a7898b2-010f-434c-84ef-43fa8b6e3b33 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] [instance: 2ab81192-8890-499c-ad4b-b93664da45fb] Took 31.62 seconds to detach 1 volumes for instance.
Nov 08 03:55:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:32 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:55:32 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:55:32 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=8004MB free_disk=25.36191177368164GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 03:55:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6a7898b2-010f-434c-84ef-43fa8b6e3b33 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:32 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9f205fe5-576f-4ef0-874b-1544c0307a7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:55:32 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 5bfa6580-e0fe-46b0-b497-8db67806113a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:55:32 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 8527ee40-fb8a-469b-9696-d7bde8cc96f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:55:32 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 7dd0e158-473f-4785-a5cf-a75b2da85b29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:55:32 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 2ab81192-8890-499c-ad4b-b93664da45fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:55:32 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:55:32 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 655fe5eb-1271-4b9f-a5a6-6342bd012a69 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:55:32 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance f1d49f43-145b-4a9e-acbc-ca3759be49d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:55:32 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 4848bd0b-c05f-4938-806b-a36bfdb043a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:55:32 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 03:55:32 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 03:55:32 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Refreshing inventories for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 03:55:32 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Updating ProviderTree inventory for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 03:55:32 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Updating inventory in ProviderTree for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 03:55:33 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Refreshing aggregate associations for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0, aggregates: None {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 03:55:33 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Refreshing trait associations for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 03:55:33 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:55:33 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:55:33 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 03:55:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.031s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6a7898b2-010f-434c-84ef-43fa8b6e3b33 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.978s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:33 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:55:33 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Cleaning up deleted instances {{(pid=75014) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 03:55:33 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] There are 0 instances to clean {{(pid=75014) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 03:55:33 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:55:33 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=75014) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 03:55:33 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:55:33 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-6a7898b2-010f-434c-84ef-43fa8b6e3b33 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:55:33 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-6a7898b2-010f-434c-84ef-43fa8b6e3b33 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:55:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6a7898b2-010f-434c-84ef-43fa8b6e3b33 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:33 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-6a7898b2-010f-434c-84ef-43fa8b6e3b33 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Deleted allocations for instance 2ab81192-8890-499c-ad4b-b93664da45fb
Nov 08 03:55:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6a7898b2-010f-434c-84ef-43fa8b6e3b33 tempest-TestVolumeSwap-1359819208 tempest-TestVolumeSwap-1359819208-project-member] Lock "2ab81192-8890-499c-ad4b-b93664da45fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 35.787s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:46 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:50 user nova-compute[75014]: INFO nova.compute.manager [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Rescuing
Nov 08 03:55:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "refresh_cache-655fe5eb-1271-4b9f-a5a6-6342bd012a69" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:55:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquired lock "refresh_cache-655fe5eb-1271-4b9f-a5a6-6342bd012a69" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:55:50 user nova-compute[75014]: DEBUG nova.network.neutron [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 03:55:50 user nova-compute[75014]: DEBUG nova.network.neutron [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Updating instance_info_cache with network_info: [{"id": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "address": "fa:16:3e:65:33:45", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9034975-10", "ovs_interfaceid": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:55:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Releasing lock "refresh_cache-655fe5eb-1271-4b9f-a5a6-6342bd012a69" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:55:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Acquiring lock "4d07d94d-1122-46a5-99a7-7dcdca404035" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Lock "4d07d94d-1122-46a5-99a7-7dcdca404035" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:50 user nova-compute[75014]: DEBUG nova.compute.manager [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 03:55:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:50 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 03:55:50 user nova-compute[75014]: INFO nova.compute.claims [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Claim successful on node user
Nov 08 03:55:51 user nova-compute[75014]: DEBUG nova.compute.manager [req-e461ac77-4f4f-4237-97f5-85fe58d77141 req-885d163a-b6fb-4385-a26d-2d47bb062861 service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Received event network-vif-unplugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e461ac77-4f4f-4237-97f5-85fe58d77141 req-885d163a-b6fb-4385-a26d-2d47bb062861 service nova] Acquiring lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e461ac77-4f4f-4237-97f5-85fe58d77141 req-885d163a-b6fb-4385-a26d-2d47bb062861 service nova] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e461ac77-4f4f-4237-97f5-85fe58d77141 req-885d163a-b6fb-4385-a26d-2d47bb062861 service nova] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:51 user nova-compute[75014]: DEBUG nova.compute.manager [req-e461ac77-4f4f-4237-97f5-85fe58d77141 req-885d163a-b6fb-4385-a26d-2d47bb062861 service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] No waiting events found dispatching network-vif-unplugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:55:51 user nova-compute[75014]: WARNING nova.compute.manager [req-e461ac77-4f4f-4237-97f5-85fe58d77141 req-885d163a-b6fb-4385-a26d-2d47bb062861 service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Received unexpected event network-vif-unplugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 for instance with vm_state active and task_state rescuing.
Nov 08 03:55:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:51 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Instance destroyed successfully.
Nov 08 03:55:51 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Attempting a stable device rescue
Nov 08 03:55:51 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:55:51 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:55:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75014) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 03:55:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Instance directory exists: not creating {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 03:55:51 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Creating image(s)
Nov 08 03:55:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "/opt/stack/data/nova/instances/655fe5eb-1271-4b9f-a5a6-6342bd012a69/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "/opt/stack/data/nova/instances/655fe5eb-1271-4b9f-a5a6-6342bd012a69/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "/opt/stack/data/nova/instances/655fe5eb-1271-4b9f-a5a6-6342bd012a69/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:51 user nova-compute[75014]: DEBUG nova.objects.instance [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lazy-loading 'trusted_certs' on Instance uuid 655fe5eb-1271-4b9f-a5a6-6342bd012a69 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:55:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.890s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:51 user nova-compute[75014]: DEBUG nova.compute.manager [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 03:55:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "08b7bf9a6b50b0754ea0761e65ec879a4b29f627" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "08b7bf9a6b50b0754ea0761e65ec879a4b29f627" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:51 user nova-compute[75014]: DEBUG nova.compute.manager [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 03:55:51 user nova-compute[75014]: DEBUG nova.network.neutron [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 03:55:51 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 03:55:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08b7bf9a6b50b0754ea0761e65ec879a4b29f627.part --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:53 user nova-compute[75014]: DEBUG nova.policy [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8806652d61094a8892c8c4f9a2554b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551efacbbc1f403ea548a2b732ac2707', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 03:55:53 user nova-compute[75014]: DEBUG nova.compute.manager [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 03:55:53 user nova-compute[75014]: DEBUG nova.compute.manager [req-a66e7ff7-bcb5-4c10-820f-cadf501c7b7f req-1d8d8f51-d0f3-4dec-a111-e96ce1155e96 service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Received event network-vif-plugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a66e7ff7-bcb5-4c10-820f-cadf501c7b7f req-1d8d8f51-d0f3-4dec-a111-e96ce1155e96 service nova] Acquiring lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a66e7ff7-bcb5-4c10-820f-cadf501c7b7f req-1d8d8f51-d0f3-4dec-a111-e96ce1155e96 service nova] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a66e7ff7-bcb5-4c10-820f-cadf501c7b7f req-1d8d8f51-d0f3-4dec-a111-e96ce1155e96 service nova] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:53 user nova-compute[75014]: DEBUG nova.compute.manager [req-a66e7ff7-bcb5-4c10-820f-cadf501c7b7f req-1d8d8f51-d0f3-4dec-a111-e96ce1155e96 service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] No waiting events found dispatching network-vif-plugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:55:53 user nova-compute[75014]: WARNING nova.compute.manager [req-a66e7ff7-bcb5-4c10-820f-cadf501c7b7f req-1d8d8f51-d0f3-4dec-a111-e96ce1155e96 service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Received unexpected event network-vif-plugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 for instance with vm_state active and task_state rescuing.
Nov 08 03:55:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08b7bf9a6b50b0754ea0761e65ec879a4b29f627.part --force-share --output=json" returned: 0 in 0.205s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:53 user nova-compute[75014]: DEBUG nova.virt.images [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] 4da64bc4-1b20-4ae2-8aec-dac318e0fd70 was qcow2, converting to raw {{(pid=75014) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 03:55:53 user nova-compute[75014]: DEBUG nova.privsep.utils [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75014) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 03:55:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/08b7bf9a6b50b0754ea0761e65ec879a4b29f627.part /opt/stack/data/nova/instances/_base/08b7bf9a6b50b0754ea0761e65ec879a4b29f627.converted {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:53 user nova-compute[75014]: DEBUG nova.compute.manager [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 03:55:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 03:55:53 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Creating image(s)
Nov 08 03:55:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Acquiring lock "/opt/stack/data/nova/instances/4d07d94d-1122-46a5-99a7-7dcdca404035/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Lock "/opt/stack/data/nova/instances/4d07d94d-1122-46a5-99a7-7dcdca404035/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Lock "/opt/stack/data/nova/instances/4d07d94d-1122-46a5-99a7-7dcdca404035/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.222s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/08b7bf9a6b50b0754ea0761e65ec879a4b29f627.part /opt/stack/data/nova/instances/_base/08b7bf9a6b50b0754ea0761e65ec879a4b29f627.converted" returned: 0 in 0.437s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08b7bf9a6b50b0754ea0761e65ec879a4b29f627.converted --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.257s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/4d07d94d-1122-46a5-99a7-7dcdca404035/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/4d07d94d-1122-46a5-99a7-7dcdca404035/disk 1073741824" returned: 0 in 0.109s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.377s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08b7bf9a6b50b0754ea0761e65ec879a4b29f627.converted --force-share --output=json" returned: 0 in 0.282s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "08b7bf9a6b50b0754ea0761e65ec879a4b29f627" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.337s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "08b7bf9a6b50b0754ea0761e65ec879a4b29f627" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "08b7bf9a6b50b0754ea0761e65ec879a4b29f627" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08b7bf9a6b50b0754ea0761e65ec879a4b29f627 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.network.neutron [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Successfully created port: e554fec9-cfd0-4b76-bc87-90426a961bec {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.231s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4d07d94d-1122-46a5-99a7-7dcdca404035/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d07d94d-1122-46a5-99a7-7dcdca404035/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08b7bf9a6b50b0754ea0761e65ec879a4b29f627 --force-share --output=json" returned: 0 in 0.195s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/08b7bf9a6b50b0754ea0761e65ec879a4b29f627,backing_fmt=raw /opt/stack/data/nova/instances/655fe5eb-1271-4b9f-a5a6-6342bd012a69/disk.rescue {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/08b7bf9a6b50b0754ea0761e65ec879a4b29f627,backing_fmt=raw /opt/stack/data/nova/instances/655fe5eb-1271-4b9f-a5a6-6342bd012a69/disk.rescue" returned: 0 in 0.052s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "08b7bf9a6b50b0754ea0761e65ec879a4b29f627" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.objects.instance [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lazy-loading 'migration_context' on Instance uuid 655fe5eb-1271-4b9f-a5a6-6342bd012a69 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.objects.base [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Object Instance<655fe5eb-1271-4b9f-a5a6-6342bd012a69> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Start _get_guest_xml network_info=[{"id": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "address": "fa:16:3e:65:33:45", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "vif_mac": "fa:16:3e:65:33:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9034975-10", "ovs_interfaceid": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4da64bc4-1b20-4ae2-8aec-dac318e0fd70', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFNlLqJa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '655fe5eb-1271-4b9f-a5a6-6342bd012a69', 'attached_at': '', 'detached_at': '', 'volume_id': 'e5f9f2d2-e443-4943-85f4-0f697ab7f6ec', 'serial': 'e5f9f2d2-e443-4943-85f4-0f697ab7f6ec'}, 'device_type': 'disk', 'attachment_id': 'f2a49b5c-5e78-47fe-8ea1-eeb36e6fc73f', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.objects.instance [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lazy-loading 'resources' on Instance uuid 655fe5eb-1271-4b9f-a5a6-6342bd012a69 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.objects.base [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Object Instance<655fe5eb-1271-4b9f-a5a6-6342bd012a69> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.objects.instance [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lazy-loading 'numa_topology' on Instance uuid 655fe5eb-1271-4b9f-a5a6-6342bd012a69 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.objects.base [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Object Instance<655fe5eb-1271-4b9f-a5a6-6342bd012a69> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 03:55:54 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:55:54 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.objects.instance [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lazy-loading 'vcpu_model' on Instance uuid 655fe5eb-1271-4b9f-a5a6-6342bd012a69 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.objects.base [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Object Instance<655fe5eb-1271-4b9f-a5a6-6342bd012a69> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFNlLqJa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:55:54 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 03:55:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:55:54 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 03:55:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:55:54 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d07d94d-1122-46a5-99a7-7dcdca404035/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Cannot resize image /opt/stack/data/nova/instances/4d07d94d-1122-46a5-99a7-7dcdca404035/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Ensure instance console log exists: /opt/stack/data/nova/instances/4d07d94d-1122-46a5-99a7-7dcdca404035/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[664308d7-3f5e-40ad-b8a6-83e9e28977c5]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = fFNlLqJa\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 08 03:55:54 user nova-compute[75014]: node.name = iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec
Nov 08 03:55:54 user nova-compute[75014]: node.tpgt = -1
Nov 08 03:55:54 user nova-compute[75014]: node.startup = automatic
Nov 08 03:55:54 user nova-compute[75014]: node.leading_login = No
Nov 08 03:55:54 user nova-compute[75014]: iface.iscsi_ifacename = default
Nov 08 03:55:54 user nova-compute[75014]: iface.net_ifacename = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.ipaddress = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.prefix_len = 0
Nov 08 03:55:54 user nova-compute[75014]: iface.hwaddress = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.transport_name = tcp
Nov 08 03:55:54 user nova-compute[75014]: iface.initiatorname = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.state = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.vlan_id = 0
Nov 08 03:55:54 user nova-compute[75014]: iface.vlan_priority = 0
Nov 08 03:55:54 user nova-compute[75014]: iface.vlan_state = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.iface_num = 0
Nov 08 03:55:54 user nova-compute[75014]: iface.mtu = 0
Nov 08 03:55:54 user nova-compute[75014]: iface.port = 0
Nov 08 03:55:54 user nova-compute[75014]: iface.bootproto = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.subnet_mask = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.gateway = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.dhcp_alt_client_id_state = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.dhcp_alt_client_id = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.dhcp_dns = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.dhcp_learn_iqn = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.dhcp_req_vendor_id_state = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.dhcp_vendor_id_state = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.dhcp_vendor_id = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.dhcp_slp_da = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.fragmentation = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.gratuitous_arp = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.incoming_forwarding = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.tos_state = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.tos = 0
Nov 08 03:55:54 user nova-compute[75014]: iface.ttl = 0
Nov 08 03:55:54 user nova-compute[75014]: iface.delayed_ack = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.tcp_nagle = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.tcp_wsf_state = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.tcp_wsf = 0
Nov 08 03:55:54 user nova-compute[75014]: iface.tcp_timer_scale = 0
Nov 08 03:55:54 user nova-compute[75014]: iface.tcp_timestamp = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.redirect = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.def_task_mgmt_timeout = 0
Nov 08 03:55:54 user nova-compute[75014]: iface.header_digest = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.data_digest = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.immediate_data = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.initial_r2t = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.data_seq_inorder = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.data_pdu_inorder = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.erl = 0
Nov 08 03:55:54 user nova-compute[75014]: iface.max_receive_data_len = 0
Nov 08 03:55:54 user nova-compute[75014]: iface.first_burst_len = 0
Nov 08 03:55:54 user nova-compute[75014]: iface.max_outstanding_r2t = 0
Nov 08 03:55:54 user nova-compute[75014]: iface.max_burst_len = 0
Nov 08 03:55:54 user nova-compute[75014]: iface.chap_auth = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.bidi_chap = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.strict_login_compliance = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.discovery_auth = <empty>
Nov 08 03:55:54 user nova-compute[75014]: iface.discovery_logout = <empty>
Nov 08 03:55:54 user nova-compute[75014]: node.discovery_address = <empty>
Nov 08 03:55:54 user nova-compute[75014]: node.discovery_port = 0
Nov 08 03:55:54 user nova-compute[75014]: node.discovery_type = static
Nov 08 03:55:54 user nova-compute[75014]: node.session.initial_cmdsn = 0
Nov 08 03:55:54 user nova-compute[75014]: node.session.initial_login_retry_max = 8
Nov 08 03:55:54 user nova-compute[75014]: node.session.xmit_thread_priority = -20
Nov 08 03:55:54 user nova-compute[75014]: node.session.cmds_max = 128
Nov 08 03:55:54 user nova-compute[75014]: node.session.queue_depth = 32
Nov 08 03:55:54 user nova-compute[75014]: node.session.nr_sessions = 1
Nov 08 03:55:54 user nova-compute[75014]: node.session.auth.authmethod = CHAP
Nov 08 03:55:54 user nova-compute[75014]: node.session.auth.username = fFNlLqJa
Nov 08 03:55:54 user nova-compute[75014]: node.session.auth.password = ***
Nov 08 03:55:54 user nova-compute[75014]: node.session.auth.username_in = <empty>
Nov 08 03:55:54 user nova-compute[75014]: node.session.auth.password_in = <empty>
Nov 08 03:55:54 user nova-compute[75014]: node.session.auth.chap_algs = MD5
Nov 08 03:55:54 user nova-compute[75014]: node.session.timeo.replacement_timeout = 120
Nov 08 03:55:54 user nova-compute[75014]: node.session.err_timeo.abort_timeout = 15
Nov 08 03:55:54 user nova-compute[75014]: node.session.err_timeo.lu_reset_timeout = 30
Nov 08 03:55:54 user nova-compute[75014]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 08 03:55:54 user nova-compute[75014]: node.session.err_timeo.host_reset_timeout = 60
Nov 08 03:55:54 user nova-compute[75014]: node.session.iscsi.FastAbort = Yes
Nov 08 03:55:54 user nova-compute[75014]: node.session.iscsi.InitialR2T = No
Nov 08 03:55:54 user nova-compute[75014]: node.session.iscsi.ImmediateData = Yes
Nov 08 03:55:54 user nova-compute[75014]: node.session.iscsi.FirstBurstLength = 262144
Nov 08 03:55:54 user nova-compute[75014]: node.session.iscsi.MaxBurstLength = 16776192
Nov 08 03:55:54 user nova-compute[75014]: node.session.iscsi.DefaultTime2Retain = 0
Nov 08 03:55:54 user nova-compute[75014]: node.session.iscsi.DefaultTime2Wait = 2
Nov 08 03:55:54 user nova-compute[75014]: node.session.iscsi.MaxConnections = 1
Nov 08 03:55:54 user nova-compute[75014]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 08 03:55:54 user nova-compute[75014]: node.session.iscsi.ERL = 0
Nov 08 03:55:54 user nova-compute[75014]: node.session.scan = manual
Nov 08 03:55:54 user nova-compute[75014]: node.session.reopen_max = 0
Nov 08 03:55:54 user nova-compute[75014]: node.conn[0].address = 172.16.0.220
Nov 08 03:55:54 user nova-compute[75014]: node.conn[0].port = 3260
Nov 08 03:55:54 user nova-compute[75014]: node.conn[0].startup = manual
Nov 08 03:55:54 user nova-compute[75014]: node.conn[0].tcp.window_size = 524288
Nov 08 03:55:54 user nova-compute[75014]: node.conn[0].tcp.type_of_service = 0
Nov 08 03:55:54 user nova-compute[75014]: node.conn[0].timeo.logout_timeout = 15
Nov 08 03:55:54 user nova-compute[75014]: node.conn[0].timeo.login_timeout = 15
Nov 08 03:55:54 user nova-compute[75014]: node.conn[0].timeo.auth_timeout = 45
Nov 08 03:55:54 user nova-compute[75014]: node.conn[0].timeo.noop_out_interval = 5
Nov 08 03:55:54 user nova-compute[75014]: node.conn[0].timeo.noop_out_timeout = 5
Nov 08 03:55:54 user nova-compute[75014]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 08 03:55:54 user nova-compute[75014]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 08 03:55:54 user nova-compute[75014]: node.conn[0].iscsi.HeaderDigest = None
Nov 08 03:55:54 user nova-compute[75014]: node.conn[0].iscsi.DataDigest = None
Nov 08 03:55:54 user nova-compute[75014]: node.conn[0].iscsi.IFMarker = No
Nov 08 03:55:54 user nova-compute[75014]: node.conn[0].iscsi.OFMarker = No
Nov 08 03:55:54 user nova-compute[75014]: # END RECORD
Nov 08 03:55:54 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d4fa26-d1fd-492a-a4fd-5110f850172f]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e2f8cd-f21c-4e05-b526-798f01f3ed0d]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fFNlLqJa {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fFNlLqJa" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7a7541-1147-4468-a3c1-f0e6403893f8]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fFNlLqJa'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b571d549-ceba-4bf7-9590-8a1ca3a2f073]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[465d0b74-8385-4dde-856e-6247f6f692b4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 03:55:54 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:55:54 user nova-compute[75014]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 (non-flash)
Nov 08 03:55:54 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 03:55:54 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:55:54 user nova-compute[75014]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 (non-flash)
Nov 08 03:55:54 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.181s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] HCTL ('34', '0', '0', 0) found on session 8 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[051c82c0-2aed-43ae-92e3-1df23cbf0fec]: (4, ('0 0 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Searching for a device in session 8 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFNlLqJa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.213s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] <== connect_volume: return (214ms) {'type': 'block', 'scsi_wwn': '26461376539663935', 'path': '/dev/sdc'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461376539663935', 'path': '/dev/sdc'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:53:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-296870254',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-296870254',id=12,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:54:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92a182cdeb8543fea1ab24326734991e',ramdisk_id='',reservation_id='r-zhw8trfw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648299000',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:54:15Z,user_data=None,user_id='630b9ba8f1d9471f9cea51f74106381a',uuid=655fe5eb-1271-4b9f-a5a6-6342bd012a69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "address": "fa:16:3e:65:33:45", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "vif_mac": "fa:16:3e:65:33:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9034975-10", "ovs_interfaceid": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Converting VIF {"id": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "address": "fa:16:3e:65:33:45", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "vif_mac": "fa:16:3e:65:33:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9034975-10", "ovs_interfaceid": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:33:45,bridge_name='br-int',has_traffic_filtering=True,id=c9034975-100d-4ca6-b1dd-c39ea788e2d3,network=Network(d45dbf14-9570-46c1-91a3-cbe2f7972b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9034975-10') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.objects.instance [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lazy-loading 'pci_devices' on Instance uuid 655fe5eb-1271-4b9f-a5a6-6342bd012a69 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.objects.base [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Object Instance<655fe5eb-1271-4b9f-a5a6-6342bd012a69> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] End _get_guest_xml xml=<domain type="kvm">
Nov 08 03:55:54 user nova-compute[75014]:   <uuid>655fe5eb-1271-4b9f-a5a6-6342bd012a69</uuid>
Nov 08 03:55:54 user nova-compute[75014]:   <name>instance-0000000c</name>
Nov 08 03:55:54 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 03:55:54 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 03:55:54 user nova-compute[75014]:   <metadata>
Nov 08 03:55:54 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 03:55:54 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 03:55:54 user nova-compute[75014]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-296870254</nova:name>
Nov 08 03:55:54 user nova-compute[75014]:       <nova:creationTime>2023-11-08 03:55:54</nova:creationTime>
Nov 08 03:55:54 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 03:55:54 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 03:55:54 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 03:55:54 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 03:55:54 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 03:55:54 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 03:55:54 user nova-compute[75014]:       </nova:flavor>
Nov 08 03:55:54 user nova-compute[75014]:       <nova:owner>
Nov 08 03:55:54 user nova-compute[75014]:         <nova:user uuid="630b9ba8f1d9471f9cea51f74106381a">tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member</nova:user>
Nov 08 03:55:54 user nova-compute[75014]:         <nova:project uuid="92a182cdeb8543fea1ab24326734991e">tempest-ServerBootFromVolumeStableRescueTest-1648299000</nova:project>
Nov 08 03:55:54 user nova-compute[75014]:       </nova:owner>
Nov 08 03:55:54 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 03:55:54 user nova-compute[75014]:       <nova:ports>
Nov 08 03:55:54 user nova-compute[75014]:         <nova:port uuid="c9034975-100d-4ca6-b1dd-c39ea788e2d3">
Nov 08 03:55:54 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 03:55:54 user nova-compute[75014]:         </nova:port>
Nov 08 03:55:54 user nova-compute[75014]:       </nova:ports>
Nov 08 03:55:54 user nova-compute[75014]:     </nova:instance>
Nov 08 03:55:54 user nova-compute[75014]:   </metadata>
Nov 08 03:55:54 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 03:55:54 user nova-compute[75014]:     <system>
Nov 08 03:55:54 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 03:55:54 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 03:55:54 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 03:55:54 user nova-compute[75014]:       <entry name="serial">655fe5eb-1271-4b9f-a5a6-6342bd012a69</entry>
Nov 08 03:55:54 user nova-compute[75014]:       <entry name="uuid">655fe5eb-1271-4b9f-a5a6-6342bd012a69</entry>
Nov 08 03:55:54 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 03:55:54 user nova-compute[75014]:     </system>
Nov 08 03:55:54 user nova-compute[75014]:   </sysinfo>
Nov 08 03:55:54 user nova-compute[75014]:   <os>
Nov 08 03:55:54 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 03:55:54 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 03:55:54 user nova-compute[75014]:   </os>
Nov 08 03:55:54 user nova-compute[75014]:   <features>
Nov 08 03:55:54 user nova-compute[75014]:     <acpi/>
Nov 08 03:55:54 user nova-compute[75014]:     <apic/>
Nov 08 03:55:54 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 03:55:54 user nova-compute[75014]:   </features>
Nov 08 03:55:54 user nova-compute[75014]:   <clock offset="utc">
Nov 08 03:55:54 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 03:55:54 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 03:55:54 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 03:55:54 user nova-compute[75014]:   </clock>
Nov 08 03:55:54 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 03:55:54 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 03:55:54 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 03:55:54 user nova-compute[75014]:   </cpu>
Nov 08 03:55:54 user nova-compute[75014]:   <devices>
Nov 08 03:55:54 user nova-compute[75014]:     <disk type="block" device="disk">
Nov 08 03:55:54 user nova-compute[75014]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 03:55:54 user nova-compute[75014]:       <source dev="/dev/sdc"/>
Nov 08 03:55:54 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 03:55:54 user nova-compute[75014]:       <serial>e5f9f2d2-e443-4943-85f4-0f697ab7f6ec</serial>
Nov 08 03:55:54 user nova-compute[75014]:     </disk>
Nov 08 03:55:54 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 03:55:54 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 03:55:54 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/655fe5eb-1271-4b9f-a5a6-6342bd012a69/disk.rescue"/>
Nov 08 03:55:54 user nova-compute[75014]:       <target dev="vdb" bus="virtio"/>
Nov 08 03:55:54 user nova-compute[75014]:       <boot order="1"/>
Nov 08 03:55:54 user nova-compute[75014]:     </disk>
Nov 08 03:55:54 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:55:54 user nova-compute[75014]:       <mac address="fa:16:3e:65:33:45"/>
Nov 08 03:55:54 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:55:54 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:55:54 user nova-compute[75014]:       <target dev="tapc9034975-10"/>
Nov 08 03:55:54 user nova-compute[75014]:     </interface>
Nov 08 03:55:54 user nova-compute[75014]:     <serial type="pty">
Nov 08 03:55:54 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/655fe5eb-1271-4b9f-a5a6-6342bd012a69/console.log" append="off"/>
Nov 08 03:55:54 user nova-compute[75014]:     </serial>
Nov 08 03:55:54 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 03:55:54 user nova-compute[75014]:     <video>
Nov 08 03:55:54 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:55:54 user nova-compute[75014]:     </video>
Nov 08 03:55:54 user nova-compute[75014]:     <rng model="virtio">
Nov 08 03:55:54 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 03:55:54 user nova-compute[75014]:     </rng>
Nov 08 03:55:54 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 03:55:54 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 03:55:54 user nova-compute[75014]:       <stats period="10"/>
Nov 08 03:55:54 user nova-compute[75014]:     </memballoon>
Nov 08 03:55:54 user nova-compute[75014]:   </devices>
Nov 08 03:55:54 user nova-compute[75014]: </domain>
Nov 08 03:55:54 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 03:55:54 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Instance destroyed successfully.
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:55:54 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] No VIF found with MAC fa:16:3e:65:33:45, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:55:55 user nova-compute[75014]: DEBUG nova.network.neutron [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Successfully updated port: e554fec9-cfd0-4b76-bc87-90426a961bec {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 03:55:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Acquiring lock "refresh_cache-4d07d94d-1122-46a5-99a7-7dcdca404035" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:55:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Acquired lock "refresh_cache-4d07d94d-1122-46a5-99a7-7dcdca404035" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:55:55 user nova-compute[75014]: DEBUG nova.network.neutron [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 03:55:55 user nova-compute[75014]: DEBUG nova.compute.manager [req-7903b0dd-b962-4133-b53e-809b20a3f95f req-2a24233f-5e80-44da-895f-e6187a810371 service nova] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Received event network-changed-e554fec9-cfd0-4b76-bc87-90426a961bec {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:55 user nova-compute[75014]: DEBUG nova.compute.manager [req-7903b0dd-b962-4133-b53e-809b20a3f95f req-2a24233f-5e80-44da-895f-e6187a810371 service nova] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Refreshing instance network info cache due to event network-changed-e554fec9-cfd0-4b76-bc87-90426a961bec. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:55:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-7903b0dd-b962-4133-b53e-809b20a3f95f req-2a24233f-5e80-44da-895f-e6187a810371 service nova] Acquiring lock "refresh_cache-4d07d94d-1122-46a5-99a7-7dcdca404035" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:55:55 user nova-compute[75014]: DEBUG nova.network.neutron [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 03:55:55 user nova-compute[75014]: DEBUG nova.network.neutron [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Updating instance_info_cache with network_info: [{"id": "e554fec9-cfd0-4b76-bc87-90426a961bec", "address": "fa:16:3e:43:0d:75", "network": {"id": "bced25bb-5685-48c9-bd64-2625aff5a55e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c9ddfe8ede87470cacd18a271f68e9dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape554fec9-cf", "ovs_interfaceid": "e554fec9-cfd0-4b76-bc87-90426a961bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:55:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Releasing lock "refresh_cache-4d07d94d-1122-46a5-99a7-7dcdca404035" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:55:55 user nova-compute[75014]: DEBUG nova.compute.manager [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Instance network_info: |[{"id": "e554fec9-cfd0-4b76-bc87-90426a961bec", "address": "fa:16:3e:43:0d:75", "network": {"id": "bced25bb-5685-48c9-bd64-2625aff5a55e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c9ddfe8ede87470cacd18a271f68e9dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape554fec9-cf", "ovs_interfaceid": "e554fec9-cfd0-4b76-bc87-90426a961bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 03:55:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-7903b0dd-b962-4133-b53e-809b20a3f95f req-2a24233f-5e80-44da-895f-e6187a810371 service nova] Acquired lock "refresh_cache-4d07d94d-1122-46a5-99a7-7dcdca404035" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:55:55 user nova-compute[75014]: DEBUG nova.network.neutron [req-7903b0dd-b962-4133-b53e-809b20a3f95f req-2a24233f-5e80-44da-895f-e6187a810371 service nova] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Refreshing network info cache for port e554fec9-cfd0-4b76-bc87-90426a961bec {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:55:55 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Start _get_guest_xml network_info=[{"id": "e554fec9-cfd0-4b76-bc87-90426a961bec", "address": "fa:16:3e:43:0d:75", "network": {"id": "bced25bb-5685-48c9-bd64-2625aff5a55e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c9ddfe8ede87470cacd18a271f68e9dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape554fec9-cf", "ovs_interfaceid": "e554fec9-cfd0-4b76-bc87-90426a961bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 03:55:55 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:55:55 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:55:55 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 03:55:55 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 03:55:55 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 03:55:55 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 03:55:55 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 03:55:55 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 03:55:55 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 03:55:55 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 03:55:55 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 03:55:55 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 03:55:55 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 03:55:55 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 03:55:55 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 03:55:55 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 03:55:55 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 03:55:55 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:55:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1782544812',display_name='tempest-VolumesNegativeTest-instance-1782544812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1782544812',id=14,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='551efacbbc1f403ea548a2b732ac2707',ramdisk_id='',reservation_id='r-zkawza0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-442582276',owner_user_name='tempest-VolumesNegativeTest-442582276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:55:53Z,user_data=None,user_id='8806652d61094a8892c8c4f9a2554b9c',uuid=4d07d94d-1122-46a5-99a7-7dcdca404035,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e554fec9-cfd0-4b76-bc87-90426a961bec", "address": "fa:16:3e:43:0d:75", "network": {"id": "bced25bb-5685-48c9-bd64-2625aff5a55e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c9ddfe8ede87470cacd18a271f68e9dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape554fec9-cf", "ovs_interfaceid": "e554fec9-cfd0-4b76-bc87-90426a961bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Converting VIF {"id": "e554fec9-cfd0-4b76-bc87-90426a961bec", "address": "fa:16:3e:43:0d:75", "network": {"id": "bced25bb-5685-48c9-bd64-2625aff5a55e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c9ddfe8ede87470cacd18a271f68e9dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape554fec9-cf", "ovs_interfaceid": "e554fec9-cfd0-4b76-bc87-90426a961bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:0d:75,bridge_name='br-int',has_traffic_filtering=True,id=e554fec9-cfd0-4b76-bc87-90426a961bec,network=Network(bced25bb-5685-48c9-bd64-2625aff5a55e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape554fec9-cf') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG nova.objects.instance [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d07d94d-1122-46a5-99a7-7dcdca404035 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] End _get_guest_xml xml=<domain type="kvm">
Nov 08 03:55:56 user nova-compute[75014]:   <uuid>4d07d94d-1122-46a5-99a7-7dcdca404035</uuid>
Nov 08 03:55:56 user nova-compute[75014]:   <name>instance-0000000e</name>
Nov 08 03:55:56 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 03:55:56 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 03:55:56 user nova-compute[75014]:   <metadata>
Nov 08 03:55:56 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 03:55:56 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 03:55:56 user nova-compute[75014]:       <nova:name>tempest-VolumesNegativeTest-instance-1782544812</nova:name>
Nov 08 03:55:56 user nova-compute[75014]:       <nova:creationTime>2023-11-08 03:55:55</nova:creationTime>
Nov 08 03:55:56 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 03:55:56 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 03:55:56 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 03:55:56 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 03:55:56 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 03:55:56 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 03:55:56 user nova-compute[75014]:       </nova:flavor>
Nov 08 03:55:56 user nova-compute[75014]:       <nova:owner>
Nov 08 03:55:56 user nova-compute[75014]:         <nova:user uuid="8806652d61094a8892c8c4f9a2554b9c">tempest-VolumesNegativeTest-442582276-project-member</nova:user>
Nov 08 03:55:56 user nova-compute[75014]:         <nova:project uuid="551efacbbc1f403ea548a2b732ac2707">tempest-VolumesNegativeTest-442582276</nova:project>
Nov 08 03:55:56 user nova-compute[75014]:       </nova:owner>
Nov 08 03:55:56 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 03:55:56 user nova-compute[75014]:       <nova:ports>
Nov 08 03:55:56 user nova-compute[75014]:         <nova:port uuid="e554fec9-cfd0-4b76-bc87-90426a961bec">
Nov 08 03:55:56 user nova-compute[75014]:           <nova:ip type="fixed" address="192.168.233.46" ipVersion="4"/>
Nov 08 03:55:56 user nova-compute[75014]:         </nova:port>
Nov 08 03:55:56 user nova-compute[75014]:       </nova:ports>
Nov 08 03:55:56 user nova-compute[75014]:     </nova:instance>
Nov 08 03:55:56 user nova-compute[75014]:   </metadata>
Nov 08 03:55:56 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 03:55:56 user nova-compute[75014]:     <system>
Nov 08 03:55:56 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 03:55:56 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 03:55:56 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 03:55:56 user nova-compute[75014]:       <entry name="serial">4d07d94d-1122-46a5-99a7-7dcdca404035</entry>
Nov 08 03:55:56 user nova-compute[75014]:       <entry name="uuid">4d07d94d-1122-46a5-99a7-7dcdca404035</entry>
Nov 08 03:55:56 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 03:55:56 user nova-compute[75014]:     </system>
Nov 08 03:55:56 user nova-compute[75014]:   </sysinfo>
Nov 08 03:55:56 user nova-compute[75014]:   <os>
Nov 08 03:55:56 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 03:55:56 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 03:55:56 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 03:55:56 user nova-compute[75014]:   </os>
Nov 08 03:55:56 user nova-compute[75014]:   <features>
Nov 08 03:55:56 user nova-compute[75014]:     <acpi/>
Nov 08 03:55:56 user nova-compute[75014]:     <apic/>
Nov 08 03:55:56 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 03:55:56 user nova-compute[75014]:   </features>
Nov 08 03:55:56 user nova-compute[75014]:   <clock offset="utc">
Nov 08 03:55:56 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 03:55:56 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 03:55:56 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 03:55:56 user nova-compute[75014]:   </clock>
Nov 08 03:55:56 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 03:55:56 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 03:55:56 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 03:55:56 user nova-compute[75014]:   </cpu>
Nov 08 03:55:56 user nova-compute[75014]:   <devices>
Nov 08 03:55:56 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 03:55:56 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 03:55:56 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/4d07d94d-1122-46a5-99a7-7dcdca404035/disk"/>
Nov 08 03:55:56 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 03:55:56 user nova-compute[75014]:     </disk>
Nov 08 03:55:56 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:55:56 user nova-compute[75014]:       <mac address="fa:16:3e:43:0d:75"/>
Nov 08 03:55:56 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:55:56 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:55:56 user nova-compute[75014]:       <target dev="tape554fec9-cf"/>
Nov 08 03:55:56 user nova-compute[75014]:     </interface>
Nov 08 03:55:56 user nova-compute[75014]:     <serial type="pty">
Nov 08 03:55:56 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/4d07d94d-1122-46a5-99a7-7dcdca404035/console.log" append="off"/>
Nov 08 03:55:56 user nova-compute[75014]:     </serial>
Nov 08 03:55:56 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 03:55:56 user nova-compute[75014]:     <video>
Nov 08 03:55:56 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:55:56 user nova-compute[75014]:     </video>
Nov 08 03:55:56 user nova-compute[75014]:     <rng model="virtio">
Nov 08 03:55:56 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 03:55:56 user nova-compute[75014]:     </rng>
Nov 08 03:55:56 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 03:55:56 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 03:55:56 user nova-compute[75014]:       <stats period="10"/>
Nov 08 03:55:56 user nova-compute[75014]:     </memballoon>
Nov 08 03:55:56 user nova-compute[75014]:   </devices>
Nov 08 03:55:56 user nova-compute[75014]: </domain>
Nov 08 03:55:56 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:55:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1782544812',display_name='tempest-VolumesNegativeTest-instance-1782544812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1782544812',id=14,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='551efacbbc1f403ea548a2b732ac2707',ramdisk_id='',reservation_id='r-zkawza0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-442582276',owner_user_name='tempest-VolumesNegativeTest-442582276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:55:53Z,user_data=None,user_id='8806652d61094a8892c8c4f9a2554b9c',uuid=4d07d94d-1122-46a5-99a7-7dcdca404035,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e554fec9-cfd0-4b76-bc87-90426a961bec", "address": "fa:16:3e:43:0d:75", "network": {"id": "bced25bb-5685-48c9-bd64-2625aff5a55e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c9ddfe8ede87470cacd18a271f68e9dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape554fec9-cf", "ovs_interfaceid": "e554fec9-cfd0-4b76-bc87-90426a961bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Converting VIF {"id": "e554fec9-cfd0-4b76-bc87-90426a961bec", "address": "fa:16:3e:43:0d:75", "network": {"id": "bced25bb-5685-48c9-bd64-2625aff5a55e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c9ddfe8ede87470cacd18a271f68e9dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape554fec9-cf", "ovs_interfaceid": "e554fec9-cfd0-4b76-bc87-90426a961bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:0d:75,bridge_name='br-int',has_traffic_filtering=True,id=e554fec9-cfd0-4b76-bc87-90426a961bec,network=Network(bced25bb-5685-48c9-bd64-2625aff5a55e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape554fec9-cf') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG os_vif [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:0d:75,bridge_name='br-int',has_traffic_filtering=True,id=e554fec9-cfd0-4b76-bc87-90426a961bec,network=Network(bced25bb-5685-48c9-bd64-2625aff5a55e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape554fec9-cf') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f07984db-ed43-5e35-a73a-dcbbcb8cd370', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape554fec9-cf, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape554fec9-cf, col_values=(('qos', UUID('b088fb05-d25f-4da3-a3c4-3cb9744b9bbc')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape554fec9-cf, col_values=(('external_ids', {'iface-id': 'e554fec9-cfd0-4b76-bc87-90426a961bec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:0d:75', 'vm-uuid': '4d07d94d-1122-46a5-99a7-7dcdca404035'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:56 user nova-compute[75014]: INFO os_vif [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:0d:75,bridge_name='br-int',has_traffic_filtering=True,id=e554fec9-cfd0-4b76-bc87-90426a961bec,network=Network(bced25bb-5685-48c9-bd64-2625aff5a55e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape554fec9-cf')
Nov 08 03:55:56 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] No VIF found with MAC fa:16:3e:43:0d:75, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Acquiring lock "af246bb7-2e77-469b-bf98-cf05b467255c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lock "af246bb7-2e77-469b-bf98-cf05b467255c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 03:55:56 user nova-compute[75014]: INFO nova.compute.claims [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Claim successful on node user
Nov 08 03:55:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG nova.network.neutron [req-7903b0dd-b962-4133-b53e-809b20a3f95f req-2a24233f-5e80-44da-895f-e6187a810371 service nova] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Updated VIF entry in instance network info cache for port e554fec9-cfd0-4b76-bc87-90426a961bec. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG nova.network.neutron [req-7903b0dd-b962-4133-b53e-809b20a3f95f req-2a24233f-5e80-44da-895f-e6187a810371 service nova] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Updating instance_info_cache with network_info: [{"id": "e554fec9-cfd0-4b76-bc87-90426a961bec", "address": "fa:16:3e:43:0d:75", "network": {"id": "bced25bb-5685-48c9-bd64-2625aff5a55e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c9ddfe8ede87470cacd18a271f68e9dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape554fec9-cf", "ovs_interfaceid": "e554fec9-cfd0-4b76-bc87-90426a961bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-7903b0dd-b962-4133-b53e-809b20a3f95f req-2a24233f-5e80-44da-895f-e6187a810371 service nova] Releasing lock "refresh_cache-4d07d94d-1122-46a5-99a7-7dcdca404035" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:55:56 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.873s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG nova.network.neutron [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 03:55:57 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 03:55:57 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG nova.policy [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '64abc045db314ba0bfd6031a127932f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed74b4d275e441381458eea9bca5aea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 03:55:57 user nova-compute[75014]: INFO nova.virt.block_device [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Booting with volume d3fe5b4d-0559-4f95-b369-6d3cf54dc012 at /dev/vda
Nov 08 03:55:57 user nova-compute[75014]: DEBUG nova.compute.manager [req-3a5ec11d-b574-437d-a5af-19fc7b7f04ec req-f6c24be8-3d6b-4718-9745-0192727244fb service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Received event network-vif-plugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3a5ec11d-b574-437d-a5af-19fc7b7f04ec req-f6c24be8-3d6b-4718-9745-0192727244fb service nova] Acquiring lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3a5ec11d-b574-437d-a5af-19fc7b7f04ec req-f6c24be8-3d6b-4718-9745-0192727244fb service nova] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3a5ec11d-b574-437d-a5af-19fc7b7f04ec req-f6c24be8-3d6b-4718-9745-0192727244fb service nova] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG nova.compute.manager [req-3a5ec11d-b574-437d-a5af-19fc7b7f04ec req-f6c24be8-3d6b-4718-9745-0192727244fb service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] No waiting events found dispatching network-vif-plugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:55:57 user nova-compute[75014]: WARNING nova.compute.manager [req-3a5ec11d-b574-437d-a5af-19fc7b7f04ec req-f6c24be8-3d6b-4718-9745-0192727244fb service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Received unexpected event network-vif-plugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 for instance with vm_state active and task_state rescuing.
Nov 08 03:55:57 user nova-compute[75014]: DEBUG nova.compute.manager [req-3a5ec11d-b574-437d-a5af-19fc7b7f04ec req-f6c24be8-3d6b-4718-9745-0192727244fb service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Received event network-vif-plugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3a5ec11d-b574-437d-a5af-19fc7b7f04ec req-f6c24be8-3d6b-4718-9745-0192727244fb service nova] Acquiring lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3a5ec11d-b574-437d-a5af-19fc7b7f04ec req-f6c24be8-3d6b-4718-9745-0192727244fb service nova] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3a5ec11d-b574-437d-a5af-19fc7b7f04ec req-f6c24be8-3d6b-4718-9745-0192727244fb service nova] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG nova.compute.manager [req-3a5ec11d-b574-437d-a5af-19fc7b7f04ec req-f6c24be8-3d6b-4718-9745-0192727244fb service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] No waiting events found dispatching network-vif-plugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:55:57 user nova-compute[75014]: WARNING nova.compute.manager [req-3a5ec11d-b574-437d-a5af-19fc7b7f04ec req-f6c24be8-3d6b-4718-9745-0192727244fb service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Received unexpected event network-vif-plugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 for instance with vm_state active and task_state rescuing.
Nov 08 03:55:57 user nova-compute[75014]: DEBUG os_brick.utils [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.033s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a01e46-42cd-4c32-af0a-2239ea3eef3f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c9975f-8fd8-4aa0-b6f0-5c1e8d1293e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee9bc97-5673-42cc-b899-787b72b11a8a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[16309b9b-4f4c-47b6-ba4d-5cdfb3d4e98a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 03:55:57 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 03:55:57 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[714a793a-ea74-4157-8461-a6b97757de99]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG os_brick.utils [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:55:57 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Updating existing volume attachment record: 739e6d24-7587-4221-b21b-c81d8125ddb3 {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 03:55:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:58 user nova-compute[75014]: DEBUG nova.network.neutron [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Successfully created port: c45eca82-c80d-4ee4-87d6-dc301fd5f760 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 03:55:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:58 user nova-compute[75014]: DEBUG nova.compute.manager [req-2f601bfb-237b-4126-896a-e1793de97797 req-aa151d34-3a6a-42d0-8d88-7feb6b0fb60a service nova] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Received event network-vif-plugged-e554fec9-cfd0-4b76-bc87-90426a961bec {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2f601bfb-237b-4126-896a-e1793de97797 req-aa151d34-3a6a-42d0-8d88-7feb6b0fb60a service nova] Acquiring lock "4d07d94d-1122-46a5-99a7-7dcdca404035-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:55:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2f601bfb-237b-4126-896a-e1793de97797 req-aa151d34-3a6a-42d0-8d88-7feb6b0fb60a service nova] Lock "4d07d94d-1122-46a5-99a7-7dcdca404035-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:55:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2f601bfb-237b-4126-896a-e1793de97797 req-aa151d34-3a6a-42d0-8d88-7feb6b0fb60a service nova] Lock "4d07d94d-1122-46a5-99a7-7dcdca404035-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:55:58 user nova-compute[75014]: DEBUG nova.compute.manager [req-2f601bfb-237b-4126-896a-e1793de97797 req-aa151d34-3a6a-42d0-8d88-7feb6b0fb60a service nova] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] No waiting events found dispatching network-vif-plugged-e554fec9-cfd0-4b76-bc87-90426a961bec {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:55:58 user nova-compute[75014]: WARNING nova.compute.manager [req-2f601bfb-237b-4126-896a-e1793de97797 req-aa151d34-3a6a-42d0-8d88-7feb6b0fb60a service nova] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Received unexpected event network-vif-plugged-e554fec9-cfd0-4b76-bc87-90426a961bec for instance with vm_state building and task_state spawning.
Nov 08 03:55:59 user nova-compute[75014]: DEBUG nova.network.neutron [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Successfully updated port: c45eca82-c80d-4ee4-87d6-dc301fd5f760 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 03:55:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Acquiring lock "refresh_cache-af246bb7-2e77-469b-bf98-cf05b467255c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:55:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Acquired lock "refresh_cache-af246bb7-2e77-469b-bf98-cf05b467255c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:55:59 user nova-compute[75014]: DEBUG nova.network.neutron [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 03:55:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:59 user nova-compute[75014]: DEBUG nova.network.neutron [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 03:55:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:55:59 user nova-compute[75014]: DEBUG nova.compute.manager [req-65e56c29-b874-44f5-a698-130a589a276e req-e83f2745-77ec-496c-bff8-ce76a5248ea0 service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Received event network-changed-c45eca82-c80d-4ee4-87d6-dc301fd5f760 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:55:59 user nova-compute[75014]: DEBUG nova.compute.manager [req-65e56c29-b874-44f5-a698-130a589a276e req-e83f2745-77ec-496c-bff8-ce76a5248ea0 service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Refreshing instance network info cache due to event network-changed-c45eca82-c80d-4ee4-87d6-dc301fd5f760. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:55:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-65e56c29-b874-44f5-a698-130a589a276e req-e83f2745-77ec-496c-bff8-ce76a5248ea0 service nova] Acquiring lock "refresh_cache-af246bb7-2e77-469b-bf98-cf05b467255c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:55:59 user nova-compute[75014]: DEBUG nova.network.neutron [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Updating instance_info_cache with network_info: [{"id": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "address": "fa:16:3e:6b:fa:e7", "network": {"id": "0c33822d-76e5-44ba-9e89-86e6a2d3351f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-374514491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed74b4d275e441381458eea9bca5aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc45eca82-c8", "ovs_interfaceid": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:55:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Releasing lock "refresh_cache-af246bb7-2e77-469b-bf98-cf05b467255c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:55:59 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Instance network_info: |[{"id": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "address": "fa:16:3e:6b:fa:e7", "network": {"id": "0c33822d-76e5-44ba-9e89-86e6a2d3351f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-374514491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed74b4d275e441381458eea9bca5aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc45eca82-c8", "ovs_interfaceid": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 03:55:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-65e56c29-b874-44f5-a698-130a589a276e req-e83f2745-77ec-496c-bff8-ce76a5248ea0 service nova] Acquired lock "refresh_cache-af246bb7-2e77-469b-bf98-cf05b467255c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:55:59 user nova-compute[75014]: DEBUG nova.network.neutron [req-65e56c29-b874-44f5-a698-130a589a276e req-e83f2745-77ec-496c-bff8-ce76a5248ea0 service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Refreshing network info cache for port c45eca82-c80d-4ee4-87d6-dc301fd5f760 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:56:00 user nova-compute[75014]: DEBUG nova.network.neutron [req-65e56c29-b874-44f5-a698-130a589a276e req-e83f2745-77ec-496c-bff8-ce76a5248ea0 service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Updated VIF entry in instance network info cache for port c45eca82-c80d-4ee4-87d6-dc301fd5f760. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:56:00 user nova-compute[75014]: DEBUG nova.network.neutron [req-65e56c29-b874-44f5-a698-130a589a276e req-e83f2745-77ec-496c-bff8-ce76a5248ea0 service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Updating instance_info_cache with network_info: [{"id": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "address": "fa:16:3e:6b:fa:e7", "network": {"id": "0c33822d-76e5-44ba-9e89-86e6a2d3351f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-374514491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed74b4d275e441381458eea9bca5aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc45eca82-c8", "ovs_interfaceid": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:56:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-65e56c29-b874-44f5-a698-130a589a276e req-e83f2745-77ec-496c-bff8-ce76a5248ea0 service nova] Releasing lock "refresh_cache-af246bb7-2e77-469b-bf98-cf05b467255c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:56:00 user nova-compute[75014]: DEBUG nova.compute.manager [None req-dde998e7-be84-498c-9b6b-17224eada899 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:56:00 user nova-compute[75014]: DEBUG nova.compute.manager [req-eed0dd08-254c-4b15-8007-4636c96028b0 req-d57d1f1c-8042-4d08-9cb0-72d9f0e01941 service nova] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Received event network-vif-plugged-e554fec9-cfd0-4b76-bc87-90426a961bec {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:56:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-eed0dd08-254c-4b15-8007-4636c96028b0 req-d57d1f1c-8042-4d08-9cb0-72d9f0e01941 service nova] Acquiring lock "4d07d94d-1122-46a5-99a7-7dcdca404035-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-eed0dd08-254c-4b15-8007-4636c96028b0 req-d57d1f1c-8042-4d08-9cb0-72d9f0e01941 service nova] Lock "4d07d94d-1122-46a5-99a7-7dcdca404035-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-eed0dd08-254c-4b15-8007-4636c96028b0 req-d57d1f1c-8042-4d08-9cb0-72d9f0e01941 service nova] Lock "4d07d94d-1122-46a5-99a7-7dcdca404035-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:00 user nova-compute[75014]: DEBUG nova.compute.manager [req-eed0dd08-254c-4b15-8007-4636c96028b0 req-d57d1f1c-8042-4d08-9cb0-72d9f0e01941 service nova] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] No waiting events found dispatching network-vif-plugged-e554fec9-cfd0-4b76-bc87-90426a961bec {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:56:00 user nova-compute[75014]: WARNING nova.compute.manager [req-eed0dd08-254c-4b15-8007-4636c96028b0 req-d57d1f1c-8042-4d08-9cb0-72d9f0e01941 service nova] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Received unexpected event network-vif-plugged-e554fec9-cfd0-4b76-bc87-90426a961bec for instance with vm_state building and task_state spawning.
Nov 08 03:56:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:01 user nova-compute[75014]: DEBUG nova.compute.manager [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 03:56:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 03:56:01 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Instance spawned successfully.
Nov 08 03:56:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 03:56:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:56:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:56:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:56:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:56:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:56:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:56:01 user nova-compute[75014]: INFO nova.compute.manager [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Took 8.17 seconds to spawn the instance on the hypervisor.
Nov 08 03:56:01 user nova-compute[75014]: DEBUG nova.compute.manager [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:56:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:01 user nova-compute[75014]: INFO nova.compute.manager [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Took 10.90 seconds to build instance.
Nov 08 03:56:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e7311ef4-7ded-43f9-aa47-16a2d4b667bb tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Lock "4d07d94d-1122-46a5-99a7-7dcdca404035" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.044s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:02 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:02 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:02 user nova-compute[75014]: INFO nova.compute.manager [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Detaching volume 356aca91-a548-47f4-9a03-0dc73b9a24a9
Nov 08 03:56:02 user nova-compute[75014]: INFO nova.virt.block_device [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Attempting to driver detach volume 356aca91-a548-47f4-9a03-0dc73b9a24a9 from mountpoint /dev/vdc
Nov 08 03:56:02 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Attempting to detach device vdc from instance f1d49f43-145b-4a9e-acbc-ca3759be49d5 from the persistent domain config. {{(pid=75014) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 03:56:02 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 03:56:02 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 03:56:02 user nova-compute[75014]:   <source dev="/dev/sdd"/>
Nov 08 03:56:02 user nova-compute[75014]:   <target dev="vdc" bus="virtio"/>
Nov 08 03:56:02 user nova-compute[75014]:   <serial>356aca91-a548-47f4-9a03-0dc73b9a24a9</serial>
Nov 08 03:56:02 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 03:56:02 user nova-compute[75014]: </disk>
Nov 08 03:56:02 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 03:56:02 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Successfully detached device vdc from instance f1d49f43-145b-4a9e-acbc-ca3759be49d5 from the persistent domain config.
Nov 08 03:56:02 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f1d49f43-145b-4a9e-acbc-ca3759be49d5 from the live domain config. {{(pid=75014) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 03:56:02 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 03:56:02 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 03:56:02 user nova-compute[75014]:   <source dev="/dev/sdd"/>
Nov 08 03:56:02 user nova-compute[75014]:   <target dev="vdc" bus="virtio"/>
Nov 08 03:56:02 user nova-compute[75014]:   <serial>356aca91-a548-47f4-9a03-0dc73b9a24a9</serial>
Nov 08 03:56:02 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 03:56:02 user nova-compute[75014]: </disk>
Nov 08 03:56:02 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 03:56:03 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f1d49f43-145b-4a9e-acbc-ca3759be49d5 {{(pid=75014) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 03:56:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:06 user nova-compute[75014]: INFO nova.virt.block_device [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Booting with volume 04bbcba8-71bc-443e-a8b8-da75b1d92eb2 at /dev/vdc
Nov 08 03:56:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:06 user nova-compute[75014]: DEBUG os_brick.utils [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:56:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:06 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9399de84-615e-4da1-b12a-dec9648a2fe3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:56:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:06 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d1280c-a7e3-4f63-895c-1c75770efb86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:56:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:06 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef688cf9-2ee7-420d-b643-97dd2c637ded]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:56:06 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8399540d-0aa0-418a-ab4e-99594968623e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:56:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 03:56:06 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 03:56:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 03:56:06 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 03:56:06 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee73392-8d71-4266-8ec2-c593c536ec5c]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:56:06 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 03:56:06 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 03:56:06 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 03:56:06 user nova-compute[75014]: DEBUG os_brick.utils [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:56:06 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Updating existing volume attachment record: 668758be-030d-4d2c-8774-0dc7da5880b5 {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 03:56:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_power_states {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:56:21 user nova-compute[75014]: WARNING nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] While synchronizing instance power states, found 10 instances in the database and 8 instances on the hypervisor.
Nov 08 03:56:21 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid 9f205fe5-576f-4ef0-874b-1544c0307a7e {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid 5bfa6580-e0fe-46b0-b497-8db67806113a {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid 8527ee40-fb8a-469b-9696-d7bde8cc96f7 {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid f1d49f43-145b-4a9e-acbc-ca3759be49d5 {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid 7dd0e158-473f-4785-a5cf-a75b2da85b29 {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965 {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid 655fe5eb-1271-4b9f-a5a6-6342bd012a69 {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid 4848bd0b-c05f-4938-806b-a36bfdb043a7 {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid 4d07d94d-1122-46a5-99a7-7dcdca404035 {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid af246bb7-2e77-469b-bf98-cf05b467255c {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "9f205fe5-576f-4ef0-874b-1544c0307a7e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.006s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "5bfa6580-e0fe-46b0-b497-8db67806113a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "5bfa6580-e0fe-46b0-b497-8db67806113a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "7dd0e158-473f-4785-a5cf-a75b2da85b29" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "7dd0e158-473f-4785-a5cf-a75b2da85b29" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "4802a259-b7ae-4fc2-98ad-8fa3e2cc4965" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "4848bd0b-c05f-4938-806b-a36bfdb043a7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "4848bd0b-c05f-4938-806b-a36bfdb043a7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "4d07d94d-1122-46a5-99a7-7dcdca404035" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "4d07d94d-1122-46a5-99a7-7dcdca404035" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "af246bb7-2e77-469b-bf98-cf05b467255c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.123s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "5bfa6580-e0fe-46b0-b497-8db67806113a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.127s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "4848bd0b-c05f-4938-806b-a36bfdb043a7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.133s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.151s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "7dd0e158-473f-4785-a5cf-a75b2da85b29" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.177s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:21 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "4d07d94d-1122-46a5-99a7-7dcdca404035" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.190s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:22 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:56:22 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:56:23 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance f1d49f43-145b-4a9e-acbc-ca3759be49d5 is timed out.
Nov 08 03:56:23 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Successfully detached device vdc from instance f1d49f43-145b-4a9e-acbc-ca3759be49d5 from the live domain config.
Nov 08 03:56:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HPjOVxXw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:56:23 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 03:56:23 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab93592-3fea-4398-9d5d-176156291b67]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 03:56:23 user nova-compute[75014]: No targets found.
Nov 08 03:56:23 user nova-compute[75014]: iSNS:
Nov 08 03:56:23 user nova-compute[75014]: No targets found.
Nov 08 03:56:23 user nova-compute[75014]: STATIC:
Nov 08 03:56:23 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec
Nov 08 03:56:23 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:56:23 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:56:23 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 03:56:23 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:56:23 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:56:23 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9
Nov 08 03:56:23 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:56:23 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:56:23 user nova-compute[75014]: FIRMWARE:
Nov 08 03:56:23 user nova-compute[75014]: No targets found.
Nov 08 03:56:23 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 03:56:23 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 03:56:23 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a12f12-7be6-4bbb-9bac-b639854bb3a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef01844-b333-4757-9413-84893f02f184]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 03:56:23 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:56:23 user nova-compute[75014]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 (non-flash)
Nov 08 03:56:23 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 03:56:23 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:56:23 user nova-compute[75014]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 (non-flash)
Nov 08 03:56:23 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f042026d750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9'): ({'sdd'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Removing single pathed devices sdd {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.043s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0db5b0-2c0c-44d5-a4fc-83cb5c49a6e0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7d2755-1132-4717-95eb-4005d1c4a163]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Flushing IO for device /dev/sdd {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd23a6c-30a8-498d-add6-55c36f8d2160]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c4124f-0005-43c7-9ef5-a21dadbc9ceb]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] SCSI volumes sdd have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabed077-c557-408b-83f8-7b2a2df5ae4c]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[753a28b8-ed9a-48c0-97e5-072a45a2d202]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9, portal: 172.16.0.220,3260]
Nov 08 03:56:23 user nova-compute[75014]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9, portal: 172.16.0.220,3260] successful.
Nov 08 03:56:23 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356aca91-a548-47f4-9a03-0dc73b9a24a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e60895-46cd-46c9-aec8-dd57fc003e95]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] <== disconnect_volume: return (411ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 03:56:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:24 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:56:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:26 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:56:26 user nova-compute[75014]: DEBUG nova.objects.instance [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lazy-loading 'flavor' on Instance uuid f1d49f43-145b-4a9e-acbc-ca3759be49d5 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:56:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-10efd0c5-bfe5-4ed7-9e88-8f067a56f334 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.196s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.865s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 03:56:27 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Creating image(s)
Nov 08 03:56:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Did not create local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Ensure instance console log exists: /opt/stack/data/nova/instances/af246bb7-2e77-469b-bf98-cf05b467255c/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Start _get_guest_xml network_info=[{"id": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "address": "fa:16:3e:6b:fa:e7", "network": {"id": "0c33822d-76e5-44ba-9e89-86e6a2d3351f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-374514491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed74b4d275e441381458eea9bca5aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc45eca82-c8", "ovs_interfaceid": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbRyqWXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'af246bb7-2e77-469b-bf98-cf05b467255c', 'attached_at': '', 'detached_at': '', 'volume_id': 'd3fe5b4d-0559-4f95-b369-6d3cf54dc012', 'serial': 'd3fe5b4d-0559-4f95-b369-6d3cf54dc012'}, 'device_type': 'disk', 'attachment_id': '739e6d24-7587-4221-b21b-c81d8125ddb3', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 03:56:27 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:56:27 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:56:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbRyqWXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:56:27 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 03:56:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:56:27 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 03:56:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:56:27 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[860ad9ee-d200-4a35-90e9-e41074ec1d2a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 03:56:27 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe93881d-f943-4227-9be3-b326956ce933]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012] added
Nov 08 03:56:27 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[33154381-2ddd-46fa-91dd-060e09839701]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21d3d4c-31fd-4da8-a149-b0085908c873]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FbRyqWXU {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FbRyqWXU" returned: 0 in 0.031s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96c01d5-6502-4e0b-ba32-610dcd1ea19d]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FbRyqWXU'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff7ba14-40b6-4b7e-a988-4a21277bb1cd]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de3f426-9541-4315-b517-8b0db187f361]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 03:56:27 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:56:27 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 03:56:27 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:56:27 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3e3a06-72e4-4443-a155-1e363fb88f31]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012, portal: 172.16.0.220,3260]
Nov 08 03:56:27 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012, portal: 172.16.0.220,3260] successful.
Nov 08 03:56:27 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fdca4c-5fa7-4ac1-8c39-680edcd2fa9d]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[79098c70-2a06-4bfb-9d8b-c11b8ff06844]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 03:56:27 user nova-compute[75014]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 (non-flash)
Nov 08 03:56:27 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:56:27 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 03:56:27 user nova-compute[75014]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 (non-flash)
Nov 08 03:56:27 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:56:27 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e8c4c3-786e-46f1-84b7-3af20d97cc91]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 03:56:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbRyqWXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Rebuilding the list of instances to heal {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Skipping network cache update for instance because it is Building. {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Skipping network cache update for instance because it is Building. {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-9f205fe5-576f-4ef0-874b-1544c0307a7e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-9f205fe5-576f-4ef0-874b-1544c0307a7e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG nova.objects.instance [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lazy-loading 'info_cache' on Instance uuid 9f205fe5-576f-4ef0-874b-1544c0307a7e {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '26636356264616130', 'path': '/dev/sdb'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636356264616130', 'path': '/dev/sdb'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:55:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-941373465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-941373465',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrsfdqP450Mbe8oVvdxb3uthC9zeL79XB+4YPPNFemSr8TxtZzWeH1eQHKOVvjEq1C1cLLx7kTdx1hGypUPYqlTsW5kFewd1FNQnedwAOlojPwTmEoLNga9SonIAuwsxw==',key_name='tempest-keypair-1582548590',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ed74b4d275e441381458eea9bca5aea',ramdisk_id='',reservation_id='r-hv42b2u3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-344745944',owner_user_name='tempest-ServerActionsV293TestJSON-344745944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:55:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64abc045db314ba0bfd6031a127932f8',uuid=af246bb7-2e77-469b-bf98-cf05b467255c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "address": "fa:16:3e:6b:fa:e7", "network": {"id": "0c33822d-76e5-44ba-9e89-86e6a2d3351f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-374514491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed74b4d275e441381458eea9bca5aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc45eca82-c8", "ovs_interfaceid": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Converting VIF {"id": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "address": "fa:16:3e:6b:fa:e7", "network": {"id": "0c33822d-76e5-44ba-9e89-86e6a2d3351f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-374514491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed74b4d275e441381458eea9bca5aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc45eca82-c8", "ovs_interfaceid": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:fa:e7,bridge_name='br-int',has_traffic_filtering=True,id=c45eca82-c80d-4ee4-87d6-dc301fd5f760,network=Network(0c33822d-76e5-44ba-9e89-86e6a2d3351f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc45eca82-c8') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG nova.objects.instance [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lazy-loading 'pci_devices' on Instance uuid af246bb7-2e77-469b-bf98-cf05b467255c {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] End _get_guest_xml xml=<domain type="kvm">
Nov 08 03:56:28 user nova-compute[75014]:   <uuid>af246bb7-2e77-469b-bf98-cf05b467255c</uuid>
Nov 08 03:56:28 user nova-compute[75014]:   <name>instance-0000000f</name>
Nov 08 03:56:28 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 03:56:28 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 03:56:28 user nova-compute[75014]:   <metadata>
Nov 08 03:56:28 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 03:56:28 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 03:56:28 user nova-compute[75014]:       <nova:name>tempest-ServerActionsV293TestJSON-server-941373465</nova:name>
Nov 08 03:56:28 user nova-compute[75014]:       <nova:creationTime>2023-11-08 03:56:27</nova:creationTime>
Nov 08 03:56:28 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 03:56:28 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 03:56:28 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 03:56:28 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 03:56:28 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 03:56:28 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 03:56:28 user nova-compute[75014]:       </nova:flavor>
Nov 08 03:56:28 user nova-compute[75014]:       <nova:owner>
Nov 08 03:56:28 user nova-compute[75014]:         <nova:user uuid="64abc045db314ba0bfd6031a127932f8">tempest-ServerActionsV293TestJSON-344745944-project-member</nova:user>
Nov 08 03:56:28 user nova-compute[75014]:         <nova:project uuid="2ed74b4d275e441381458eea9bca5aea">tempest-ServerActionsV293TestJSON-344745944</nova:project>
Nov 08 03:56:28 user nova-compute[75014]:       </nova:owner>
Nov 08 03:56:28 user nova-compute[75014]:       <nova:ports>
Nov 08 03:56:28 user nova-compute[75014]:         <nova:port uuid="c45eca82-c80d-4ee4-87d6-dc301fd5f760">
Nov 08 03:56:28 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 03:56:28 user nova-compute[75014]:         </nova:port>
Nov 08 03:56:28 user nova-compute[75014]:       </nova:ports>
Nov 08 03:56:28 user nova-compute[75014]:     </nova:instance>
Nov 08 03:56:28 user nova-compute[75014]:   </metadata>
Nov 08 03:56:28 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 03:56:28 user nova-compute[75014]:     <system>
Nov 08 03:56:28 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 03:56:28 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 03:56:28 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 03:56:28 user nova-compute[75014]:       <entry name="serial">af246bb7-2e77-469b-bf98-cf05b467255c</entry>
Nov 08 03:56:28 user nova-compute[75014]:       <entry name="uuid">af246bb7-2e77-469b-bf98-cf05b467255c</entry>
Nov 08 03:56:28 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 03:56:28 user nova-compute[75014]:     </system>
Nov 08 03:56:28 user nova-compute[75014]:   </sysinfo>
Nov 08 03:56:28 user nova-compute[75014]:   <os>
Nov 08 03:56:28 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 03:56:28 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 03:56:28 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 03:56:28 user nova-compute[75014]:   </os>
Nov 08 03:56:28 user nova-compute[75014]:   <features>
Nov 08 03:56:28 user nova-compute[75014]:     <acpi/>
Nov 08 03:56:28 user nova-compute[75014]:     <apic/>
Nov 08 03:56:28 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 03:56:28 user nova-compute[75014]:   </features>
Nov 08 03:56:28 user nova-compute[75014]:   <clock offset="utc">
Nov 08 03:56:28 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 03:56:28 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 03:56:28 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 03:56:28 user nova-compute[75014]:   </clock>
Nov 08 03:56:28 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 03:56:28 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 03:56:28 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 03:56:28 user nova-compute[75014]:   </cpu>
Nov 08 03:56:28 user nova-compute[75014]:   <devices>
Nov 08 03:56:28 user nova-compute[75014]:     <disk type="block" device="disk">
Nov 08 03:56:28 user nova-compute[75014]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 03:56:28 user nova-compute[75014]:       <source dev="/dev/sdb"/>
Nov 08 03:56:28 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 03:56:28 user nova-compute[75014]:       <serial>d3fe5b4d-0559-4f95-b369-6d3cf54dc012</serial>
Nov 08 03:56:28 user nova-compute[75014]:     </disk>
Nov 08 03:56:28 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:56:28 user nova-compute[75014]:       <mac address="fa:16:3e:6b:fa:e7"/>
Nov 08 03:56:28 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:56:28 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:56:28 user nova-compute[75014]:       <target dev="tapc45eca82-c8"/>
Nov 08 03:56:28 user nova-compute[75014]:     </interface>
Nov 08 03:56:28 user nova-compute[75014]:     <serial type="pty">
Nov 08 03:56:28 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/af246bb7-2e77-469b-bf98-cf05b467255c/console.log" append="off"/>
Nov 08 03:56:28 user nova-compute[75014]:     </serial>
Nov 08 03:56:28 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 03:56:28 user nova-compute[75014]:     <video>
Nov 08 03:56:28 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:56:28 user nova-compute[75014]:     </video>
Nov 08 03:56:28 user nova-compute[75014]:     <rng model="virtio">
Nov 08 03:56:28 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 03:56:28 user nova-compute[75014]:     </rng>
Nov 08 03:56:28 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 03:56:28 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 03:56:28 user nova-compute[75014]:       <stats period="10"/>
Nov 08 03:56:28 user nova-compute[75014]:     </memballoon>
Nov 08 03:56:28 user nova-compute[75014]:   </devices>
Nov 08 03:56:28 user nova-compute[75014]: </domain>
Nov 08 03:56:28 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:55:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-941373465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-941373465',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrsfdqP450Mbe8oVvdxb3uthC9zeL79XB+4YPPNFemSr8TxtZzWeH1eQHKOVvjEq1C1cLLx7kTdx1hGypUPYqlTsW5kFewd1FNQnedwAOlojPwTmEoLNga9SonIAuwsxw==',key_name='tempest-keypair-1582548590',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ed74b4d275e441381458eea9bca5aea',ramdisk_id='',reservation_id='r-hv42b2u3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-344745944',owner_user_name='tempest-ServerActionsV293TestJSON-344745944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:55:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64abc045db314ba0bfd6031a127932f8',uuid=af246bb7-2e77-469b-bf98-cf05b467255c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "address": "fa:16:3e:6b:fa:e7", "network": {"id": "0c33822d-76e5-44ba-9e89-86e6a2d3351f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-374514491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed74b4d275e441381458eea9bca5aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc45eca82-c8", "ovs_interfaceid": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Converting VIF {"id": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "address": "fa:16:3e:6b:fa:e7", "network": {"id": "0c33822d-76e5-44ba-9e89-86e6a2d3351f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-374514491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed74b4d275e441381458eea9bca5aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc45eca82-c8", "ovs_interfaceid": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:fa:e7,bridge_name='br-int',has_traffic_filtering=True,id=c45eca82-c80d-4ee4-87d6-dc301fd5f760,network=Network(0c33822d-76e5-44ba-9e89-86e6a2d3351f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc45eca82-c8') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG os_vif [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:fa:e7,bridge_name='br-int',has_traffic_filtering=True,id=c45eca82-c80d-4ee4-87d6-dc301fd5f760,network=Network(0c33822d-76e5-44ba-9e89-86e6a2d3351f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc45eca82-c8') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0fe54600-3cc7-599b-bcad-b8491e602dfc', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc45eca82-c8, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc45eca82-c8, col_values=(('qos', UUID('34a80c06-e899-4f2b-a340-7bb8d1dd01c6')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc45eca82-c8, col_values=(('external_ids', {'iface-id': 'c45eca82-c80d-4ee4-87d6-dc301fd5f760', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:fa:e7', 'vm-uuid': 'af246bb7-2e77-469b-bf98-cf05b467255c'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:28 user nova-compute[75014]: INFO os_vif [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:fa:e7,bridge_name='br-int',has_traffic_filtering=True,id=c45eca82-c80d-4ee4-87d6-dc301fd5f760,network=Network(0c33822d-76e5-44ba-9e89-86e6a2d3351f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc45eca82-c8')
Nov 08 03:56:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:56:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] No VIF found with MAC fa:16:3e:6b:fa:e7, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:56:29 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Updating instance_info_cache with network_info: [{"id": "4979eddc-54c6-46e4-987a-640c4ccade99", "address": "fa:16:3e:4c:b6:69", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4979eddc-54", "ovs_interfaceid": "4979eddc-54c6-46e4-987a-640c4ccade99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:56:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-9f205fe5-576f-4ef0-874b-1544c0307a7e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:56:29 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 03:56:29 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:56:29 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:56:29 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 03:56:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Acquiring lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:30 user nova-compute[75014]: DEBUG nova.compute.manager [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 03:56:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:30 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:56:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:30 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 03:56:30 user nova-compute[75014]: INFO nova.compute.claims [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Claim successful on node user
Nov 08 03:56:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:30 user nova-compute[75014]: DEBUG nova.compute.manager [req-cc91a786-54b4-4f5b-a47a-f6c42d77b766 req-28c60486-4bf5-4ea1-b2db-fbc115d737ad service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Received event network-vif-plugged-c45eca82-c80d-4ee4-87d6-dc301fd5f760 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:56:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-cc91a786-54b4-4f5b-a47a-f6c42d77b766 req-28c60486-4bf5-4ea1-b2db-fbc115d737ad service nova] Acquiring lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-cc91a786-54b4-4f5b-a47a-f6c42d77b766 req-28c60486-4bf5-4ea1-b2db-fbc115d737ad service nova] Lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-cc91a786-54b4-4f5b-a47a-f6c42d77b766 req-28c60486-4bf5-4ea1-b2db-fbc115d737ad service nova] Lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:30 user nova-compute[75014]: DEBUG nova.compute.manager [req-cc91a786-54b4-4f5b-a47a-f6c42d77b766 req-28c60486-4bf5-4ea1-b2db-fbc115d737ad service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] No waiting events found dispatching network-vif-plugged-c45eca82-c80d-4ee4-87d6-dc301fd5f760 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:56:30 user nova-compute[75014]: WARNING nova.compute.manager [req-cc91a786-54b4-4f5b-a47a-f6c42d77b766 req-28c60486-4bf5-4ea1-b2db-fbc115d737ad service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Received unexpected event network-vif-plugged-c45eca82-c80d-4ee4-87d6-dc301fd5f760 for instance with vm_state building and task_state spawning.
Nov 08 03:56:31 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:56:31 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:56:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.812s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:31 user nova-compute[75014]: DEBUG nova.compute.manager [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 03:56:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.796s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:31 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 03:56:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:31 user nova-compute[75014]: DEBUG nova.compute.manager [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 03:56:31 user nova-compute[75014]: DEBUG nova.network.neutron [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 03:56:31 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 03:56:31 user nova-compute[75014]: DEBUG nova.compute.manager [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 03:56:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:31 user nova-compute[75014]: DEBUG nova.compute.manager [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 03:56:31 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 03:56:31 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Creating image(s)
Nov 08 03:56:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "/opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "/opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:31 user nova-compute[75014]: DEBUG nova.policy [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75fe8ccd73ce4d66938868007c49f4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05de04b5317b4257b434019a2db27f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 03:56:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.228s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:31 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 03:56:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655fe5eb-1271-4b9f-a5a6-6342bd012a69/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.190s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655fe5eb-1271-4b9f-a5a6-6342bd012a69/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655fe5eb-1271-4b9f-a5a6-6342bd012a69/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk 1073741824" returned: 0 in 0.070s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655fe5eb-1271-4b9f-a5a6-6342bd012a69/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.213s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:32 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 03:56:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:32 user nova-compute[75014]: DEBUG nova.network.neutron [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Successfully created port: 2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 03:56:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:32 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Cannot resize image /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 03:56:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 03:56:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Ensure instance console log exists: /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 03:56:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:32 user nova-compute[75014]: DEBUG nova.compute.manager [req-094d5322-96a4-406f-ae40-e37205c7e99e req-afa5ba04-c9bd-4b7c-8c58-bc8fb4d49f92 service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Received event network-vif-plugged-c45eca82-c80d-4ee4-87d6-dc301fd5f760 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:56:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-094d5322-96a4-406f-ae40-e37205c7e99e req-afa5ba04-c9bd-4b7c-8c58-bc8fb4d49f92 service nova] Acquiring lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-094d5322-96a4-406f-ae40-e37205c7e99e req-afa5ba04-c9bd-4b7c-8c58-bc8fb4d49f92 service nova] Lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-094d5322-96a4-406f-ae40-e37205c7e99e req-afa5ba04-c9bd-4b7c-8c58-bc8fb4d49f92 service nova] Lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:32 user nova-compute[75014]: DEBUG nova.compute.manager [req-094d5322-96a4-406f-ae40-e37205c7e99e req-afa5ba04-c9bd-4b7c-8c58-bc8fb4d49f92 service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] No waiting events found dispatching network-vif-plugged-c45eca82-c80d-4ee4-87d6-dc301fd5f760 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:56:32 user nova-compute[75014]: WARNING nova.compute.manager [req-094d5322-96a4-406f-ae40-e37205c7e99e req-afa5ba04-c9bd-4b7c-8c58-bc8fb4d49f92 service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Received unexpected event network-vif-plugged-c45eca82-c80d-4ee4-87d6-dc301fd5f760 for instance with vm_state building and task_state spawning.
Nov 08 03:56:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d07d94d-1122-46a5-99a7-7dcdca404035/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d07d94d-1122-46a5-99a7-7dcdca404035/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d07d94d-1122-46a5-99a7-7dcdca404035/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:33 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 03:56:33 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 03:56:33 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Instance spawned successfully.
Nov 08 03:56:33 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 03:56:33 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:56:33 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:56:33 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:56:33 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:56:33 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:56:33 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:56:33 user nova-compute[75014]: INFO nova.compute.manager [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Took 6.08 seconds to spawn the instance on the hypervisor.
Nov 08 03:56:33 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:56:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d07d94d-1122-46a5-99a7-7dcdca404035/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:33 user nova-compute[75014]: DEBUG nova.network.neutron [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Successfully updated port: 2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 03:56:33 user nova-compute[75014]: DEBUG nova.compute.manager [req-d56cbeb4-1678-4e4c-8b9a-c65a8856f86a req-d1a94796-f68a-45df-98b6-e67639fbc3ae service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Received event network-changed-2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:56:33 user nova-compute[75014]: DEBUG nova.compute.manager [req-d56cbeb4-1678-4e4c-8b9a-c65a8856f86a req-d1a94796-f68a-45df-98b6-e67639fbc3ae service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Refreshing instance network info cache due to event network-changed-2d19a877-95a3-4cc5-b98f-c5a097a01304. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:56:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d56cbeb4-1678-4e4c-8b9a-c65a8856f86a req-d1a94796-f68a-45df-98b6-e67639fbc3ae service nova] Acquiring lock "refresh_cache-bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:56:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d56cbeb4-1678-4e4c-8b9a-c65a8856f86a req-d1a94796-f68a-45df-98b6-e67639fbc3ae service nova] Acquired lock "refresh_cache-bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:56:33 user nova-compute[75014]: DEBUG nova.network.neutron [req-d56cbeb4-1678-4e4c-8b9a-c65a8856f86a req-d1a94796-f68a-45df-98b6-e67639fbc3ae service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Refreshing network info cache for port 2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:56:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Acquiring lock "refresh_cache-bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:56:33 user nova-compute[75014]: INFO nova.compute.manager [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Took 37.03 seconds to build instance.
Nov 08 03:56:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f2ef0207-6be1-425a-822c-7e123ae6c472 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lock "af246bb7-2e77-469b-bf98-cf05b467255c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.150s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "af246bb7-2e77-469b-bf98-cf05b467255c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 11.595s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:33 user nova-compute[75014]: INFO nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 08 03:56:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "af246bb7-2e77-469b-bf98-cf05b467255c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:33 user nova-compute[75014]: DEBUG nova.network.neutron [req-d56cbeb4-1678-4e4c-8b9a-c65a8856f86a req-d1a94796-f68a-45df-98b6-e67639fbc3ae service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 03:56:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:33 user nova-compute[75014]: DEBUG nova.network.neutron [req-d56cbeb4-1678-4e4c-8b9a-c65a8856f86a req-d1a94796-f68a-45df-98b6-e67639fbc3ae service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:56:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d56cbeb4-1678-4e4c-8b9a-c65a8856f86a req-d1a94796-f68a-45df-98b6-e67639fbc3ae service nova] Releasing lock "refresh_cache-bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:56:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Acquired lock "refresh_cache-bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:56:33 user nova-compute[75014]: DEBUG nova.network.neutron [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 03:56:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk.rescue --force-share --output=json" returned: 0 in 0.269s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:33 user nova-compute[75014]: DEBUG nova.network.neutron [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG nova.network.neutron [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Updating instance_info_cache with network_info: [{"id": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "address": "fa:16:3e:d8:7a:3e", "network": {"id": "64afeb98-3d7d-4d85-a8ac-2deff17e7463", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-737690621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05de04b5317b4257b434019a2db27f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d19a877-95", "ovs_interfaceid": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Releasing lock "refresh_cache-bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG nova.compute.manager [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Instance network_info: |[{"id": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "address": "fa:16:3e:d8:7a:3e", "network": {"id": "64afeb98-3d7d-4d85-a8ac-2deff17e7463", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-737690621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05de04b5317b4257b434019a2db27f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d19a877-95", "ovs_interfaceid": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Start _get_guest_xml network_info=[{"id": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "address": "fa:16:3e:d8:7a:3e", "network": {"id": "64afeb98-3d7d-4d85-a8ac-2deff17e7463", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-737690621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05de04b5317b4257b434019a2db27f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d19a877-95", "ovs_interfaceid": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 03:56:34 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:56:34 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:56:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-514356008',display_name='tempest-ServerStableDeviceRescueTest-server-514356008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-514356008',id=16,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdDQJUVzJSfwf8EGORwnY5XfvHz/nPlQSVwKWVNMxL13SpO76KX4Hqf7Y0N0SVtjIZCj3Tmkh993LwJ0b5WvZMVqXeJWMWUVI/ttUuEC5MJ6286g6JwsMIVJtb/liLMRQ==',key_name='tempest-keypair-466253599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05de04b5317b4257b434019a2db27f18',ramdisk_id='',reservation_id='r-h300xedb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-981631959',owner_user_name='tempest-ServerStableDeviceRescueTest-981631959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:56:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fe8ccd73ce4d66938868007c49f4a1',uuid=bd153f84-98cd-4c6d-a7ab-5759b0b5bf55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "address": "fa:16:3e:d8:7a:3e", "network": {"id": "64afeb98-3d7d-4d85-a8ac-2deff17e7463", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-737690621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05de04b5317b4257b434019a2db27f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d19a877-95", "ovs_interfaceid": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Converting VIF {"id": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "address": "fa:16:3e:d8:7a:3e", "network": {"id": "64afeb98-3d7d-4d85-a8ac-2deff17e7463", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-737690621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05de04b5317b4257b434019a2db27f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d19a877-95", "ovs_interfaceid": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:7a:3e,bridge_name='br-int',has_traffic_filtering=True,id=2d19a877-95a3-4cc5-b98f-c5a097a01304,network=Network(64afeb98-3d7d-4d85-a8ac-2deff17e7463),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d19a877-95') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG nova.objects.instance [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lazy-loading 'pci_devices' on Instance uuid bd153f84-98cd-4c6d-a7ab-5759b0b5bf55 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] End _get_guest_xml xml=<domain type="kvm">
Nov 08 03:56:34 user nova-compute[75014]:   <uuid>bd153f84-98cd-4c6d-a7ab-5759b0b5bf55</uuid>
Nov 08 03:56:34 user nova-compute[75014]:   <name>instance-00000010</name>
Nov 08 03:56:34 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 03:56:34 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 03:56:34 user nova-compute[75014]:   <metadata>
Nov 08 03:56:34 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 03:56:34 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 03:56:34 user nova-compute[75014]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-514356008</nova:name>
Nov 08 03:56:34 user nova-compute[75014]:       <nova:creationTime>2023-11-08 03:56:34</nova:creationTime>
Nov 08 03:56:34 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 03:56:34 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 03:56:34 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 03:56:34 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 03:56:34 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 03:56:34 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 03:56:34 user nova-compute[75014]:       </nova:flavor>
Nov 08 03:56:34 user nova-compute[75014]:       <nova:owner>
Nov 08 03:56:34 user nova-compute[75014]:         <nova:user uuid="75fe8ccd73ce4d66938868007c49f4a1">tempest-ServerStableDeviceRescueTest-981631959-project-member</nova:user>
Nov 08 03:56:34 user nova-compute[75014]:         <nova:project uuid="05de04b5317b4257b434019a2db27f18">tempest-ServerStableDeviceRescueTest-981631959</nova:project>
Nov 08 03:56:34 user nova-compute[75014]:       </nova:owner>
Nov 08 03:56:34 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 03:56:34 user nova-compute[75014]:       <nova:ports>
Nov 08 03:56:34 user nova-compute[75014]:         <nova:port uuid="2d19a877-95a3-4cc5-b98f-c5a097a01304">
Nov 08 03:56:34 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 03:56:34 user nova-compute[75014]:         </nova:port>
Nov 08 03:56:34 user nova-compute[75014]:       </nova:ports>
Nov 08 03:56:34 user nova-compute[75014]:     </nova:instance>
Nov 08 03:56:34 user nova-compute[75014]:   </metadata>
Nov 08 03:56:34 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 03:56:34 user nova-compute[75014]:     <system>
Nov 08 03:56:34 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 03:56:34 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 03:56:34 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 03:56:34 user nova-compute[75014]:       <entry name="serial">bd153f84-98cd-4c6d-a7ab-5759b0b5bf55</entry>
Nov 08 03:56:34 user nova-compute[75014]:       <entry name="uuid">bd153f84-98cd-4c6d-a7ab-5759b0b5bf55</entry>
Nov 08 03:56:34 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 03:56:34 user nova-compute[75014]:     </system>
Nov 08 03:56:34 user nova-compute[75014]:   </sysinfo>
Nov 08 03:56:34 user nova-compute[75014]:   <os>
Nov 08 03:56:34 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 03:56:34 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 03:56:34 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 03:56:34 user nova-compute[75014]:   </os>
Nov 08 03:56:34 user nova-compute[75014]:   <features>
Nov 08 03:56:34 user nova-compute[75014]:     <acpi/>
Nov 08 03:56:34 user nova-compute[75014]:     <apic/>
Nov 08 03:56:34 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 03:56:34 user nova-compute[75014]:   </features>
Nov 08 03:56:34 user nova-compute[75014]:   <clock offset="utc">
Nov 08 03:56:34 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 03:56:34 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 03:56:34 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 03:56:34 user nova-compute[75014]:   </clock>
Nov 08 03:56:34 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 03:56:34 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 03:56:34 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 03:56:34 user nova-compute[75014]:   </cpu>
Nov 08 03:56:34 user nova-compute[75014]:   <devices>
Nov 08 03:56:34 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 03:56:34 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 03:56:34 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk"/>
Nov 08 03:56:34 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 03:56:34 user nova-compute[75014]:     </disk>
Nov 08 03:56:34 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:56:34 user nova-compute[75014]:       <mac address="fa:16:3e:d8:7a:3e"/>
Nov 08 03:56:34 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:56:34 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:56:34 user nova-compute[75014]:       <target dev="tap2d19a877-95"/>
Nov 08 03:56:34 user nova-compute[75014]:     </interface>
Nov 08 03:56:34 user nova-compute[75014]:     <serial type="pty">
Nov 08 03:56:34 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/console.log" append="off"/>
Nov 08 03:56:34 user nova-compute[75014]:     </serial>
Nov 08 03:56:34 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 03:56:34 user nova-compute[75014]:     <video>
Nov 08 03:56:34 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:56:34 user nova-compute[75014]:     </video>
Nov 08 03:56:34 user nova-compute[75014]:     <rng model="virtio">
Nov 08 03:56:34 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 03:56:34 user nova-compute[75014]:     </rng>
Nov 08 03:56:34 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 03:56:34 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 03:56:34 user nova-compute[75014]:       <stats period="10"/>
Nov 08 03:56:34 user nova-compute[75014]:     </memballoon>
Nov 08 03:56:34 user nova-compute[75014]:   </devices>
Nov 08 03:56:34 user nova-compute[75014]: </domain>
Nov 08 03:56:34 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-514356008',display_name='tempest-ServerStableDeviceRescueTest-server-514356008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-514356008',id=16,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdDQJUVzJSfwf8EGORwnY5XfvHz/nPlQSVwKWVNMxL13SpO76KX4Hqf7Y0N0SVtjIZCj3Tmkh993LwJ0b5WvZMVqXeJWMWUVI/ttUuEC5MJ6286g6JwsMIVJtb/liLMRQ==',key_name='tempest-keypair-466253599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05de04b5317b4257b434019a2db27f18',ramdisk_id='',reservation_id='r-h300xedb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-981631959',owner_user_name='tempest-ServerStableDeviceRescueTest-981631959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:56:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fe8ccd73ce4d66938868007c49f4a1',uuid=bd153f84-98cd-4c6d-a7ab-5759b0b5bf55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "address": "fa:16:3e:d8:7a:3e", "network": {"id": "64afeb98-3d7d-4d85-a8ac-2deff17e7463", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-737690621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05de04b5317b4257b434019a2db27f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d19a877-95", "ovs_interfaceid": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Converting VIF {"id": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "address": "fa:16:3e:d8:7a:3e", "network": {"id": "64afeb98-3d7d-4d85-a8ac-2deff17e7463", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-737690621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05de04b5317b4257b434019a2db27f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d19a877-95", "ovs_interfaceid": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:7a:3e,bridge_name='br-int',has_traffic_filtering=True,id=2d19a877-95a3-4cc5-b98f-c5a097a01304,network=Network(64afeb98-3d7d-4d85-a8ac-2deff17e7463),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d19a877-95') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG os_vif [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:7a:3e,bridge_name='br-int',has_traffic_filtering=True,id=2d19a877-95a3-4cc5-b98f-c5a097a01304,network=Network(64afeb98-3d7d-4d85-a8ac-2deff17e7463),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d19a877-95') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb042804-555d-53cd-ba80-e73993b7d70e', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d19a877-95, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d19a877-95, col_values=(('qos', UUID('f53c7a81-3e4a-432a-bcdc-139db4824ef9')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d19a877-95, col_values=(('external_ids', {'iface-id': '2d19a877-95a3-4cc5-b98f-c5a097a01304', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:7a:3e', 'vm-uuid': 'bd153f84-98cd-4c6d-a7ab-5759b0b5bf55'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:34 user nova-compute[75014]: INFO os_vif [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:7a:3e,bridge_name='br-int',has_traffic_filtering=True,id=2d19a877-95a3-4cc5-b98f-c5a097a01304,network=Network(64afeb98-3d7d-4d85-a8ac-2deff17e7463),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d19a877-95')
Nov 08 03:56:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] No VIF found with MAC fa:16:3e:d8:7a:3e, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json" returned: 0 in 0.273s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4848bd0b-c05f-4938-806b-a36bfdb043a7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4848bd0b-c05f-4938-806b-a36bfdb043a7/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4848bd0b-c05f-4938-806b-a36bfdb043a7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:56:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4848bd0b-c05f-4938-806b-a36bfdb043a7/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:56:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:39 user nova-compute[75014]: DEBUG nova.compute.manager [req-0cc3aff5-4113-4a33-969b-942cb13a7bc0 req-c732556c-e520-4d15-9ca0-834df26122d4 service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Received event network-vif-plugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:56:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0cc3aff5-4113-4a33-969b-942cb13a7bc0 req-c732556c-e520-4d15-9ca0-834df26122d4 service nova] Acquiring lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0cc3aff5-4113-4a33-969b-942cb13a7bc0 req-c732556c-e520-4d15-9ca0-834df26122d4 service nova] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0cc3aff5-4113-4a33-969b-942cb13a7bc0 req-c732556c-e520-4d15-9ca0-834df26122d4 service nova] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:39 user nova-compute[75014]: DEBUG nova.compute.manager [req-0cc3aff5-4113-4a33-969b-942cb13a7bc0 req-c732556c-e520-4d15-9ca0-834df26122d4 service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] No waiting events found dispatching network-vif-plugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:56:39 user nova-compute[75014]: WARNING nova.compute.manager [req-0cc3aff5-4113-4a33-969b-942cb13a7bc0 req-c732556c-e520-4d15-9ca0-834df26122d4 service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Received unexpected event network-vif-plugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 for instance with vm_state building and task_state spawning.
Nov 08 03:56:39 user nova-compute[75014]: DEBUG nova.compute.manager [req-2cee7704-ff74-4319-997c-ff89c6626d5d req-3ba02175-7d6d-4ec9-abf8-2ecab2a6c14b service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Received event network-vif-plugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:56:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2cee7704-ff74-4319-997c-ff89c6626d5d req-3ba02175-7d6d-4ec9-abf8-2ecab2a6c14b service nova] Acquiring lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2cee7704-ff74-4319-997c-ff89c6626d5d req-3ba02175-7d6d-4ec9-abf8-2ecab2a6c14b service nova] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2cee7704-ff74-4319-997c-ff89c6626d5d req-3ba02175-7d6d-4ec9-abf8-2ecab2a6c14b service nova] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:39 user nova-compute[75014]: DEBUG nova.compute.manager [req-2cee7704-ff74-4319-997c-ff89c6626d5d req-3ba02175-7d6d-4ec9-abf8-2ecab2a6c14b service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] No waiting events found dispatching network-vif-plugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:56:39 user nova-compute[75014]: WARNING nova.compute.manager [req-2cee7704-ff74-4319-997c-ff89c6626d5d req-3ba02175-7d6d-4ec9-abf8-2ecab2a6c14b service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Received unexpected event network-vif-plugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 for instance with vm_state building and task_state spawning.
Nov 08 03:56:39 user nova-compute[75014]: DEBUG nova.compute.manager [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 03:56:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 03:56:39 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:56:39 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:56:39 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=7760MB free_disk=25.21407699584961GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 03:56:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:39 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Instance spawned successfully.
Nov 08 03:56:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 03:56:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:56:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:56:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:56:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:56:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:56:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:56:39 user nova-compute[75014]: INFO nova.compute.manager [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Took 8.30 seconds to spawn the instance on the hypervisor.
Nov 08 03:56:39 user nova-compute[75014]: DEBUG nova.compute.manager [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:56:40 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9f205fe5-576f-4ef0-874b-1544c0307a7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:56:40 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 5bfa6580-e0fe-46b0-b497-8db67806113a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:56:40 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 8527ee40-fb8a-469b-9696-d7bde8cc96f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:56:40 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 7dd0e158-473f-4785-a5cf-a75b2da85b29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:56:40 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:56:40 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 655fe5eb-1271-4b9f-a5a6-6342bd012a69 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:56:40 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance f1d49f43-145b-4a9e-acbc-ca3759be49d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:56:40 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 4848bd0b-c05f-4938-806b-a36bfdb043a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:56:40 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 4d07d94d-1122-46a5-99a7-7dcdca404035 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:56:40 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance af246bb7-2e77-469b-bf98-cf05b467255c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:56:40 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance bd153f84-98cd-4c6d-a7ab-5759b0b5bf55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:56:40 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 03:56:40 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 03:56:40 user nova-compute[75014]: INFO nova.compute.manager [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Took 9.77 seconds to build instance.
Nov 08 03:56:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d35af10a-fa8a-40bf-ac02-3c2b4212e688 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.950s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:40 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:56:40 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:56:40 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 03:56:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.837s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:46 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-68f05cda-09aa-44f7-82f5-779dd1fd2e5e tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Acquiring lock "4848bd0b-c05f-4938-806b-a36bfdb043a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-68f05cda-09aa-44f7-82f5-779dd1fd2e5e tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "4848bd0b-c05f-4938-806b-a36bfdb043a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-68f05cda-09aa-44f7-82f5-779dd1fd2e5e tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Acquiring lock "4848bd0b-c05f-4938-806b-a36bfdb043a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-68f05cda-09aa-44f7-82f5-779dd1fd2e5e tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "4848bd0b-c05f-4938-806b-a36bfdb043a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-68f05cda-09aa-44f7-82f5-779dd1fd2e5e tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "4848bd0b-c05f-4938-806b-a36bfdb043a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:50 user nova-compute[75014]: INFO nova.compute.manager [None req-68f05cda-09aa-44f7-82f5-779dd1fd2e5e tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Terminating instance
Nov 08 03:56:50 user nova-compute[75014]: DEBUG nova.compute.manager [None req-68f05cda-09aa-44f7-82f5-779dd1fd2e5e tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 03:56:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:50 user nova-compute[75014]: DEBUG nova.compute.manager [req-3cd0bf8c-d678-4e56-9fa6-57c8db607b00 req-0d686fca-c335-49be-9401-db667258dd6d service nova] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Received event network-vif-unplugged-e60ebc78-297c-4479-a778-c4aee9d207ae {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:56:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3cd0bf8c-d678-4e56-9fa6-57c8db607b00 req-0d686fca-c335-49be-9401-db667258dd6d service nova] Acquiring lock "4848bd0b-c05f-4938-806b-a36bfdb043a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3cd0bf8c-d678-4e56-9fa6-57c8db607b00 req-0d686fca-c335-49be-9401-db667258dd6d service nova] Lock "4848bd0b-c05f-4938-806b-a36bfdb043a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3cd0bf8c-d678-4e56-9fa6-57c8db607b00 req-0d686fca-c335-49be-9401-db667258dd6d service nova] Lock "4848bd0b-c05f-4938-806b-a36bfdb043a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:50 user nova-compute[75014]: DEBUG nova.compute.manager [req-3cd0bf8c-d678-4e56-9fa6-57c8db607b00 req-0d686fca-c335-49be-9401-db667258dd6d service nova] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] No waiting events found dispatching network-vif-unplugged-e60ebc78-297c-4479-a778-c4aee9d207ae {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:56:50 user nova-compute[75014]: DEBUG nova.compute.manager [req-3cd0bf8c-d678-4e56-9fa6-57c8db607b00 req-0d686fca-c335-49be-9401-db667258dd6d service nova] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Received event network-vif-unplugged-e60ebc78-297c-4479-a778-c4aee9d207ae for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 03:56:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:51 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Instance destroyed successfully.
Nov 08 03:56:51 user nova-compute[75014]: DEBUG nova.objects.instance [None req-68f05cda-09aa-44f7-82f5-779dd1fd2e5e tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lazy-loading 'resources' on Instance uuid 4848bd0b-c05f-4938-806b-a36bfdb043a7 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:56:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-68f05cda-09aa-44f7-82f5-779dd1fd2e5e tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1635663112',display_name='tempest-VolumesAdminNegativeTest-server-1635663112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1635663112',id=13,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:54:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca4e7f2292f74b0a88221144ad5220f5',ramdisk_id='',reservation_id='r-d52villi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-730381045',owner_user_name='tempest-VolumesAdminNegativeTest-730381045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T03:54:49Z,user_data=None,user_id='e82b4bdb6a464a06ac0afb07401a0ff1',uuid=4848bd0b-c05f-4938-806b-a36bfdb043a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e60ebc78-297c-4479-a778-c4aee9d207ae", "address": "fa:16:3e:46:33:f4", "network": {"id": "24ff600e-3d1c-49d0-90cf-84e1aa25d978", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1636920770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4e7f2292f74b0a88221144ad5220f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60ebc78-29", "ovs_interfaceid": "e60ebc78-297c-4479-a778-c4aee9d207ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 03:56:51 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-68f05cda-09aa-44f7-82f5-779dd1fd2e5e tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Converting VIF {"id": "e60ebc78-297c-4479-a778-c4aee9d207ae", "address": "fa:16:3e:46:33:f4", "network": {"id": "24ff600e-3d1c-49d0-90cf-84e1aa25d978", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1636920770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4e7f2292f74b0a88221144ad5220f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60ebc78-29", "ovs_interfaceid": "e60ebc78-297c-4479-a778-c4aee9d207ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:56:51 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-68f05cda-09aa-44f7-82f5-779dd1fd2e5e tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:33:f4,bridge_name='br-int',has_traffic_filtering=True,id=e60ebc78-297c-4479-a778-c4aee9d207ae,network=Network(24ff600e-3d1c-49d0-90cf-84e1aa25d978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape60ebc78-29') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:56:51 user nova-compute[75014]: DEBUG os_vif [None req-68f05cda-09aa-44f7-82f5-779dd1fd2e5e tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:33:f4,bridge_name='br-int',has_traffic_filtering=True,id=e60ebc78-297c-4479-a778-c4aee9d207ae,network=Network(24ff600e-3d1c-49d0-90cf-84e1aa25d978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape60ebc78-29') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 03:56:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape60ebc78-29, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:56:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e9cfb1e-5de5-41df-8d68-77559c205f67) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:56:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:51 user nova-compute[75014]: INFO os_vif [None req-68f05cda-09aa-44f7-82f5-779dd1fd2e5e tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:33:f4,bridge_name='br-int',has_traffic_filtering=True,id=e60ebc78-297c-4479-a778-c4aee9d207ae,network=Network(24ff600e-3d1c-49d0-90cf-84e1aa25d978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape60ebc78-29')
Nov 08 03:56:51 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-68f05cda-09aa-44f7-82f5-779dd1fd2e5e tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Deleting instance files /opt/stack/data/nova/instances/4848bd0b-c05f-4938-806b-a36bfdb043a7_del
Nov 08 03:56:51 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-68f05cda-09aa-44f7-82f5-779dd1fd2e5e tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Deletion of /opt/stack/data/nova/instances/4848bd0b-c05f-4938-806b-a36bfdb043a7_del complete
Nov 08 03:56:51 user nova-compute[75014]: INFO nova.compute.manager [None req-68f05cda-09aa-44f7-82f5-779dd1fd2e5e tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 08 03:56:51 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-68f05cda-09aa-44f7-82f5-779dd1fd2e5e tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 03:56:51 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 03:56:51 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 03:56:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:51 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:56:51 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Took 0.84 seconds to deallocate network for instance.
Nov 08 03:56:52 user nova-compute[75014]: DEBUG nova.compute.manager [req-2f328259-55a2-4fce-9773-9edb51cce54d req-685b1502-5743-4250-904a-71a85b83a96f service nova] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Received event network-vif-deleted-e60ebc78-297c-4479-a778-c4aee9d207ae {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:56:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-68f05cda-09aa-44f7-82f5-779dd1fd2e5e tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-68f05cda-09aa-44f7-82f5-779dd1fd2e5e tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:52 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-68f05cda-09aa-44f7-82f5-779dd1fd2e5e tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:56:52 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-68f05cda-09aa-44f7-82f5-779dd1fd2e5e tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:56:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-68f05cda-09aa-44f7-82f5-779dd1fd2e5e tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.526s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:52 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-68f05cda-09aa-44f7-82f5-779dd1fd2e5e tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Deleted allocations for instance 4848bd0b-c05f-4938-806b-a36bfdb043a7
Nov 08 03:56:52 user nova-compute[75014]: DEBUG nova.compute.manager [req-773bca31-af2e-4e24-8d03-9ac83bb36051 req-5f4f770a-c26b-45b6-b3cc-b70e9015bf12 service nova] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Received event network-vif-plugged-e60ebc78-297c-4479-a778-c4aee9d207ae {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:56:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-773bca31-af2e-4e24-8d03-9ac83bb36051 req-5f4f770a-c26b-45b6-b3cc-b70e9015bf12 service nova] Acquiring lock "4848bd0b-c05f-4938-806b-a36bfdb043a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-773bca31-af2e-4e24-8d03-9ac83bb36051 req-5f4f770a-c26b-45b6-b3cc-b70e9015bf12 service nova] Lock "4848bd0b-c05f-4938-806b-a36bfdb043a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-773bca31-af2e-4e24-8d03-9ac83bb36051 req-5f4f770a-c26b-45b6-b3cc-b70e9015bf12 service nova] Lock "4848bd0b-c05f-4938-806b-a36bfdb043a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:52 user nova-compute[75014]: DEBUG nova.compute.manager [req-773bca31-af2e-4e24-8d03-9ac83bb36051 req-5f4f770a-c26b-45b6-b3cc-b70e9015bf12 service nova] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] No waiting events found dispatching network-vif-plugged-e60ebc78-297c-4479-a778-c4aee9d207ae {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:56:52 user nova-compute[75014]: WARNING nova.compute.manager [req-773bca31-af2e-4e24-8d03-9ac83bb36051 req-5f4f770a-c26b-45b6-b3cc-b70e9015bf12 service nova] [instance: 4848bd0b-c05f-4938-806b-a36bfdb043a7] Received unexpected event network-vif-plugged-e60ebc78-297c-4479-a778-c4aee9d207ae for instance with vm_state deleted and task_state None.
Nov 08 03:56:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-68f05cda-09aa-44f7-82f5-779dd1fd2e5e tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "4848bd0b-c05f-4938-806b-a36bfdb043a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.618s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f1e2c20-4c9e-4ffe-adc7-3d4bda508c0e tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f1e2c20-4c9e-4ffe-adc7-3d4bda508c0e tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f1e2c20-4c9e-4ffe-adc7-3d4bda508c0e tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f1e2c20-4c9e-4ffe-adc7-3d4bda508c0e tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f1e2c20-4c9e-4ffe-adc7-3d4bda508c0e tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:52 user nova-compute[75014]: INFO nova.compute.manager [None req-4f1e2c20-4c9e-4ffe-adc7-3d4bda508c0e tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Terminating instance
Nov 08 03:56:52 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f1e2c20-4c9e-4ffe-adc7-3d4bda508c0e tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 03:56:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:53 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Instance destroyed successfully.
Nov 08 03:56:53 user nova-compute[75014]: DEBUG nova.objects.instance [None req-4f1e2c20-4c9e-4ffe-adc7-3d4bda508c0e tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lazy-loading 'resources' on Instance uuid f1d49f43-145b-4a9e-acbc-ca3759be49d5 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:56:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-4f1e2c20-4c9e-4ffe-adc7-3d4bda508c0e tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T03:49:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-937810668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-937810668',id=5,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDl11M5avo9bT73kKWpL6ROj4Uc6XogM4W8W1Z+wRJrUz7HXPDFtCISzN1nICvOyAaJUURT7jmmDoJ68zd4dmaLkYUzlRePt20TD2aaKSvy0qPri0GSokXbun02g+I7Vg==',key_name='tempest-keypair-1162981834',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:54:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1d70b55f2bb42e5b7123acfcd621b2f',ramdisk_id='',reservation_id='r-0ts9n0ef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-650261566',owner_user_name='tempest-AttachVolumeShelveTestJSON-650261566-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T03:54:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74a49a9155064771bd4e8a179f9111ac',uuid=f1d49f43-145b-4a9e-acbc-ca3759be49d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "address": "fa:16:3e:32:e2:a4", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd443c9-89", "ovs_interfaceid": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 03:56:53 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-4f1e2c20-4c9e-4ffe-adc7-3d4bda508c0e tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Converting VIF {"id": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "address": "fa:16:3e:32:e2:a4", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd443c9-89", "ovs_interfaceid": "2dd443c9-89d2-4a7c-b2fe-e842507e24d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:56:53 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-4f1e2c20-4c9e-4ffe-adc7-3d4bda508c0e tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:e2:a4,bridge_name='br-int',has_traffic_filtering=True,id=2dd443c9-89d2-4a7c-b2fe-e842507e24d7,network=Network(6ebf42ac-ab65-4622-8529-4c508f9d563c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd443c9-89') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:56:53 user nova-compute[75014]: DEBUG os_vif [None req-4f1e2c20-4c9e-4ffe-adc7-3d4bda508c0e tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:e2:a4,bridge_name='br-int',has_traffic_filtering=True,id=2dd443c9-89d2-4a7c-b2fe-e842507e24d7,network=Network(6ebf42ac-ab65-4622-8529-4c508f9d563c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd443c9-89') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 03:56:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dd443c9-89, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:56:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a20a75e1-31fa-42f6-9e7c-50bdbaf888e2) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:56:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:56:53 user nova-compute[75014]: INFO os_vif [None req-4f1e2c20-4c9e-4ffe-adc7-3d4bda508c0e tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:e2:a4,bridge_name='br-int',has_traffic_filtering=True,id=2dd443c9-89d2-4a7c-b2fe-e842507e24d7,network=Network(6ebf42ac-ab65-4622-8529-4c508f9d563c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd443c9-89')
Nov 08 03:56:53 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-4f1e2c20-4c9e-4ffe-adc7-3d4bda508c0e tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Deleting instance files /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5_del
Nov 08 03:56:53 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-4f1e2c20-4c9e-4ffe-adc7-3d4bda508c0e tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Deletion of /opt/stack/data/nova/instances/f1d49f43-145b-4a9e-acbc-ca3759be49d5_del complete
Nov 08 03:56:53 user nova-compute[75014]: INFO nova.compute.manager [None req-4f1e2c20-4c9e-4ffe-adc7-3d4bda508c0e tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 08 03:56:53 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-4f1e2c20-4c9e-4ffe-adc7-3d4bda508c0e tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 03:56:53 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 03:56:53 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 03:56:54 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:56:54 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Took 0.82 seconds to deallocate network for instance.
Nov 08 03:56:54 user nova-compute[75014]: DEBUG nova.compute.manager [req-c7b43f7c-f33b-4ba3-a056-bb47630f01ab req-a1391c79-0189-4fd8-9280-6256ca373d31 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Received event network-vif-deleted-2dd443c9-89d2-4a7c-b2fe-e842507e24d7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:56:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f1e2c20-4c9e-4ffe-adc7-3d4bda508c0e tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f1e2c20-4c9e-4ffe-adc7-3d4bda508c0e tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:54 user nova-compute[75014]: DEBUG nova.compute.manager [req-3a6b6c27-f25d-4d2e-9513-994bba674090 req-fc464d5d-1dcb-4432-b2cf-a4a81ff18dd5 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Received event network-vif-unplugged-2dd443c9-89d2-4a7c-b2fe-e842507e24d7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:56:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3a6b6c27-f25d-4d2e-9513-994bba674090 req-fc464d5d-1dcb-4432-b2cf-a4a81ff18dd5 service nova] Acquiring lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3a6b6c27-f25d-4d2e-9513-994bba674090 req-fc464d5d-1dcb-4432-b2cf-a4a81ff18dd5 service nova] Lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3a6b6c27-f25d-4d2e-9513-994bba674090 req-fc464d5d-1dcb-4432-b2cf-a4a81ff18dd5 service nova] Lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:54 user nova-compute[75014]: DEBUG nova.compute.manager [req-3a6b6c27-f25d-4d2e-9513-994bba674090 req-fc464d5d-1dcb-4432-b2cf-a4a81ff18dd5 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] No waiting events found dispatching network-vif-unplugged-2dd443c9-89d2-4a7c-b2fe-e842507e24d7 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:56:54 user nova-compute[75014]: WARNING nova.compute.manager [req-3a6b6c27-f25d-4d2e-9513-994bba674090 req-fc464d5d-1dcb-4432-b2cf-a4a81ff18dd5 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Received unexpected event network-vif-unplugged-2dd443c9-89d2-4a7c-b2fe-e842507e24d7 for instance with vm_state deleted and task_state None.
Nov 08 03:56:54 user nova-compute[75014]: DEBUG nova.compute.manager [req-3a6b6c27-f25d-4d2e-9513-994bba674090 req-fc464d5d-1dcb-4432-b2cf-a4a81ff18dd5 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Received event network-vif-plugged-2dd443c9-89d2-4a7c-b2fe-e842507e24d7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:56:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3a6b6c27-f25d-4d2e-9513-994bba674090 req-fc464d5d-1dcb-4432-b2cf-a4a81ff18dd5 service nova] Acquiring lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:56:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3a6b6c27-f25d-4d2e-9513-994bba674090 req-fc464d5d-1dcb-4432-b2cf-a4a81ff18dd5 service nova] Lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:56:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3a6b6c27-f25d-4d2e-9513-994bba674090 req-fc464d5d-1dcb-4432-b2cf-a4a81ff18dd5 service nova] Lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:54 user nova-compute[75014]: DEBUG nova.compute.manager [req-3a6b6c27-f25d-4d2e-9513-994bba674090 req-fc464d5d-1dcb-4432-b2cf-a4a81ff18dd5 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] No waiting events found dispatching network-vif-plugged-2dd443c9-89d2-4a7c-b2fe-e842507e24d7 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:56:54 user nova-compute[75014]: WARNING nova.compute.manager [req-3a6b6c27-f25d-4d2e-9513-994bba674090 req-fc464d5d-1dcb-4432-b2cf-a4a81ff18dd5 service nova] [instance: f1d49f43-145b-4a9e-acbc-ca3759be49d5] Received unexpected event network-vif-plugged-2dd443c9-89d2-4a7c-b2fe-e842507e24d7 for instance with vm_state deleted and task_state None.
Nov 08 03:56:55 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f1e2c20-4c9e-4ffe-adc7-3d4bda508c0e tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:56:55 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f1e2c20-4c9e-4ffe-adc7-3d4bda508c0e tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:56:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f1e2c20-4c9e-4ffe-adc7-3d4bda508c0e tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.603s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:55 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-4f1e2c20-4c9e-4ffe-adc7-3d4bda508c0e tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Deleted allocations for instance f1d49f43-145b-4a9e-acbc-ca3759be49d5
Nov 08 03:56:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f1e2c20-4c9e-4ffe-adc7-3d4bda508c0e tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "f1d49f43-145b-4a9e-acbc-ca3759be49d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.611s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:56:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:56:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:04 user nova-compute[75014]: INFO nova.compute.manager [None req-8ee8bcab-7a4e-484d-9eb2-e33f21e9f4b2 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Unrescuing
Nov 08 03:57:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8ee8bcab-7a4e-484d-9eb2-e33f21e9f4b2 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "refresh_cache-9f205fe5-576f-4ef0-874b-1544c0307a7e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:57:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8ee8bcab-7a4e-484d-9eb2-e33f21e9f4b2 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquired lock "refresh_cache-9f205fe5-576f-4ef0-874b-1544c0307a7e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:57:04 user nova-compute[75014]: DEBUG nova.network.neutron [None req-8ee8bcab-7a4e-484d-9eb2-e33f21e9f4b2 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 03:57:04 user nova-compute[75014]: DEBUG nova.network.neutron [None req-8ee8bcab-7a4e-484d-9eb2-e33f21e9f4b2 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Updating instance_info_cache with network_info: [{"id": "4979eddc-54c6-46e4-987a-640c4ccade99", "address": "fa:16:3e:4c:b6:69", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4979eddc-54", "ovs_interfaceid": "4979eddc-54c6-46e4-987a-640c4ccade99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:57:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8ee8bcab-7a4e-484d-9eb2-e33f21e9f4b2 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Releasing lock "refresh_cache-9f205fe5-576f-4ef0-874b-1544c0307a7e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:57:04 user nova-compute[75014]: DEBUG nova.objects.instance [None req-8ee8bcab-7a4e-484d-9eb2-e33f21e9f4b2 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lazy-loading 'flavor' on Instance uuid 9f205fe5-576f-4ef0-874b-1544c0307a7e {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:57:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:04 user nova-compute[75014]: DEBUG nova.compute.manager [req-61184d35-bd89-4e6b-8852-f03f17a2a296 req-7b380543-bc93-45b3-a1ac-b7677abbef53 service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Received event network-vif-unplugged-4979eddc-54c6-46e4-987a-640c4ccade99 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:57:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-61184d35-bd89-4e6b-8852-f03f17a2a296 req-7b380543-bc93-45b3-a1ac-b7677abbef53 service nova] Acquiring lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-61184d35-bd89-4e6b-8852-f03f17a2a296 req-7b380543-bc93-45b3-a1ac-b7677abbef53 service nova] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-61184d35-bd89-4e6b-8852-f03f17a2a296 req-7b380543-bc93-45b3-a1ac-b7677abbef53 service nova] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:05 user nova-compute[75014]: DEBUG nova.compute.manager [req-61184d35-bd89-4e6b-8852-f03f17a2a296 req-7b380543-bc93-45b3-a1ac-b7677abbef53 service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] No waiting events found dispatching network-vif-unplugged-4979eddc-54c6-46e4-987a-640c4ccade99 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:57:05 user nova-compute[75014]: WARNING nova.compute.manager [req-61184d35-bd89-4e6b-8852-f03f17a2a296 req-7b380543-bc93-45b3-a1ac-b7677abbef53 service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Received unexpected event network-vif-unplugged-4979eddc-54c6-46e4-987a-640c4ccade99 for instance with vm_state rescued and task_state unrescuing.
Nov 08 03:57:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:05 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Instance destroyed successfully.
Nov 08 03:57:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:07 user nova-compute[75014]: DEBUG nova.compute.manager [req-8d9fef2b-ebfa-4525-8a25-55cb8fa26830 req-a7b30902-71f4-4834-93f5-9c5759cba89f service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Received event network-vif-plugged-4979eddc-54c6-46e4-987a-640c4ccade99 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:57:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8d9fef2b-ebfa-4525-8a25-55cb8fa26830 req-a7b30902-71f4-4834-93f5-9c5759cba89f service nova] Acquiring lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8d9fef2b-ebfa-4525-8a25-55cb8fa26830 req-a7b30902-71f4-4834-93f5-9c5759cba89f service nova] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8d9fef2b-ebfa-4525-8a25-55cb8fa26830 req-a7b30902-71f4-4834-93f5-9c5759cba89f service nova] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:07 user nova-compute[75014]: DEBUG nova.compute.manager [req-8d9fef2b-ebfa-4525-8a25-55cb8fa26830 req-a7b30902-71f4-4834-93f5-9c5759cba89f service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] No waiting events found dispatching network-vif-plugged-4979eddc-54c6-46e4-987a-640c4ccade99 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:57:07 user nova-compute[75014]: WARNING nova.compute.manager [req-8d9fef2b-ebfa-4525-8a25-55cb8fa26830 req-a7b30902-71f4-4834-93f5-9c5759cba89f service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Received unexpected event network-vif-plugged-4979eddc-54c6-46e4-987a-640c4ccade99 for instance with vm_state rescued and task_state unrescuing.
Nov 08 03:57:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:09 user nova-compute[75014]: DEBUG nova.compute.manager [req-5fa599a1-0e63-4aa2-b3e2-e2e6174b4fc0 req-594d3fc5-11f7-46fb-9b40-7f6fb5666af8 service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Received event network-vif-plugged-4979eddc-54c6-46e4-987a-640c4ccade99 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:57:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5fa599a1-0e63-4aa2-b3e2-e2e6174b4fc0 req-594d3fc5-11f7-46fb-9b40-7f6fb5666af8 service nova] Acquiring lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5fa599a1-0e63-4aa2-b3e2-e2e6174b4fc0 req-594d3fc5-11f7-46fb-9b40-7f6fb5666af8 service nova] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5fa599a1-0e63-4aa2-b3e2-e2e6174b4fc0 req-594d3fc5-11f7-46fb-9b40-7f6fb5666af8 service nova] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:09 user nova-compute[75014]: DEBUG nova.compute.manager [req-5fa599a1-0e63-4aa2-b3e2-e2e6174b4fc0 req-594d3fc5-11f7-46fb-9b40-7f6fb5666af8 service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] No waiting events found dispatching network-vif-plugged-4979eddc-54c6-46e4-987a-640c4ccade99 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:57:09 user nova-compute[75014]: WARNING nova.compute.manager [req-5fa599a1-0e63-4aa2-b3e2-e2e6174b4fc0 req-594d3fc5-11f7-46fb-9b40-7f6fb5666af8 service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Received unexpected event network-vif-plugged-4979eddc-54c6-46e4-987a-640c4ccade99 for instance with vm_state rescued and task_state unrescuing.
Nov 08 03:57:09 user nova-compute[75014]: DEBUG nova.compute.manager [req-5fa599a1-0e63-4aa2-b3e2-e2e6174b4fc0 req-594d3fc5-11f7-46fb-9b40-7f6fb5666af8 service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Received event network-vif-plugged-4979eddc-54c6-46e4-987a-640c4ccade99 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:57:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5fa599a1-0e63-4aa2-b3e2-e2e6174b4fc0 req-594d3fc5-11f7-46fb-9b40-7f6fb5666af8 service nova] Acquiring lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5fa599a1-0e63-4aa2-b3e2-e2e6174b4fc0 req-594d3fc5-11f7-46fb-9b40-7f6fb5666af8 service nova] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5fa599a1-0e63-4aa2-b3e2-e2e6174b4fc0 req-594d3fc5-11f7-46fb-9b40-7f6fb5666af8 service nova] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:09 user nova-compute[75014]: DEBUG nova.compute.manager [req-5fa599a1-0e63-4aa2-b3e2-e2e6174b4fc0 req-594d3fc5-11f7-46fb-9b40-7f6fb5666af8 service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] No waiting events found dispatching network-vif-plugged-4979eddc-54c6-46e4-987a-640c4ccade99 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:57:09 user nova-compute[75014]: WARNING nova.compute.manager [req-5fa599a1-0e63-4aa2-b3e2-e2e6174b4fc0 req-594d3fc5-11f7-46fb-9b40-7f6fb5666af8 service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Received unexpected event network-vif-plugged-4979eddc-54c6-46e4-987a-640c4ccade99 for instance with vm_state rescued and task_state unrescuing.
Nov 08 03:57:09 user nova-compute[75014]: DEBUG nova.compute.manager [None req-8ee8bcab-7a4e-484d-9eb2-e33f21e9f4b2 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:57:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:57:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:32 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:57:32 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:57:32 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:57:32 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 03:57:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-5bfa6580-e0fe-46b0-b497-8db67806113a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:57:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-5bfa6580-e0fe-46b0-b497-8db67806113a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:57:32 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 03:57:33 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Updating instance_info_cache with network_info: [{"id": "3f08242a-d68d-4744-8b4c-49bdc29ea557", "address": "fa:16:3e:65:f5:c2", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f08242a-d6", "ovs_interfaceid": "3f08242a-d68d-4744-8b4c-49bdc29ea557", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:57:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-5bfa6580-e0fe-46b0-b497-8db67806113a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:57:33 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 03:57:33 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:57:33 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:57:33 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:57:33 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:57:33 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:57:33 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:57:33 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 03:57:33 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:57:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:33 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 03:57:33 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 03:57:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655fe5eb-1271-4b9f-a5a6-6342bd012a69/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655fe5eb-1271-4b9f-a5a6-6342bd012a69/disk.rescue --force-share --output=json" returned: 0 in 0.271s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655fe5eb-1271-4b9f-a5a6-6342bd012a69/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655fe5eb-1271-4b9f-a5a6-6342bd012a69/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d07d94d-1122-46a5-99a7-7dcdca404035/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d07d94d-1122-46a5-99a7-7dcdca404035/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d07d94d-1122-46a5-99a7-7dcdca404035/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d07d94d-1122-46a5-99a7-7dcdca404035/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:35 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 03:57:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 03:57:36 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Creating image(s)
Nov 08 03:57:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Did not create local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Ensure instance console log exists: /opt/stack/data/nova/instances/4802a259-b7ae-4fc2-98ad-8fa3e2cc4965/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Instance failed to spawn: nova.exception.PortNotFound: Port id 2385bd9b-063b-4ba7-b80a-4910985bf841 could not be found.
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Traceback (most recent call last):
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/network/neutron.py", line 1975, in _show_port
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     result = neutron_client.show_port(port_id)
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     ret = obj(*args, **kwargs)
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/data/venv/lib/python3.10/site-packages/neutronclient/v2_0/client.py", line 820, in show_port
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     return self.get(self.port_path % (port), params=_params)
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     ret = obj(*args, **kwargs)
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/data/venv/lib/python3.10/site-packages/neutronclient/v2_0/client.py", line 356, in get
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     return self.retry_request("GET", action, body=body,
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     ret = obj(*args, **kwargs)
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/data/venv/lib/python3.10/site-packages/neutronclient/v2_0/client.py", line 333, in retry_request
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     return self.do_request(method, action, body=body,
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     ret = obj(*args, **kwargs)
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/data/venv/lib/python3.10/site-packages/neutronclient/v2_0/client.py", line 297, in do_request
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     self._handle_fault_response(status_code, replybody, resp)
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     ret = obj(*args, **kwargs)
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/data/venv/lib/python3.10/site-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     exception_handler_v20(status_code, error_body)
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/data/venv/lib/python3.10/site-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     raise client_exc(message=error_message,
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] neutronclient.common.exceptions.PortNotFoundClient: Port 2385bd9b-063b-4ba7-b80a-4910985bf841 could not be found.
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Neutron server returns request_ids: ['req-fb5288c8-ece1-4b8b-b792-969118b3ad4e']
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] 
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] During handling of the above exception, another exception occurred:
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] 
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Traceback (most recent call last):
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/compute/manager.py", line 2884, in _build_resources
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     yield resources
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/compute/manager.py", line 2631, in _build_and_run_instance
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     self.driver.spawn(context, instance, image_meta,
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4411, in spawn
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     xml = self._get_guest_xml(context, instance, network_info,
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 7551, in _get_guest_xml
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     network_info_str = str(network_info)
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/network/model.py", line 620, in __str__
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     return self._sync_wrapper(fn, *args, **kwargs)
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/network/model.py", line 603, in _sync_wrapper
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     self.wait()
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/network/model.py", line 635, in wait
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     self[:] = self._gt.wait()
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 181, in wait
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     return self._exit_event.wait()
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/event.py", line 132, in wait
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     current.throw(*self._exc)
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 221, in main
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     result = function(*args, **kwargs)
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/utils.py", line 664, in context_wrapper
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     return func(*args, **kwargs)
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/compute/manager.py", line 2002, in _allocate_network_async
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     raise e
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/compute/manager.py", line 1980, in _allocate_network_async
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     nwinfo = self.network_api.allocate_for_instance(
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/network/neutron.py", line 1182, in allocate_for_instance
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     self._validate_requested_port_ids(
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/network/neutron.py", line 770, in _validate_requested_port_ids
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     port = self._show_port(context, request.port_id,
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/network/neutron.py", line 1978, in _show_port
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     raise exception.PortNotFound(port_id=port_id)
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] nova.exception.PortNotFound: Port id 2385bd9b-063b-4ba7-b80a-4910985bf841 could not be found.
Nov 08 03:57:36 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] 
Nov 08 03:57:36 user nova-compute[75014]: INFO nova.compute.manager [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Terminating instance
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Acquiring lock "refresh_cache-4802a259-b7ae-4fc2-98ad-8fa3e2cc4965" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Acquired lock "refresh_cache-4802a259-b7ae-4fc2-98ad-8fa3e2cc4965" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG nova.network.neutron [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG nova.network.neutron [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG nova.network.neutron [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Releasing lock "refresh_cache-4802a259-b7ae-4fc2-98ad-8fa3e2cc4965" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [-] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] During wait destroy, instance disappeared. {{(pid=75014) _wait_for_destroy /opt/stack/nova/nova/virt/libvirt/driver.py:1527}}
Nov 08 03:57:36 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Instance destroyed successfully.
Nov 08 03:57:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:50adc3d1-c482-4040-8bd2-e107a25dae7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ymcEBQiq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, None), 'kwargs': True}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:57:36 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: nova.exception.PortNotFound: Port id 2385bd9b-063b-4ba7-b80a-4910985bf841 could not be found.
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad106b56-996d-4da8-9492-2c0947642b93]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 03:57:36 user nova-compute[75014]: No targets found.
Nov 08 03:57:36 user nova-compute[75014]: iSNS:
Nov 08 03:57:36 user nova-compute[75014]: No targets found.
Nov 08 03:57:36 user nova-compute[75014]: STATIC:
Nov 08 03:57:36 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec
Nov 08 03:57:36 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:57:36 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:57:36 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 03:57:36 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:57:36 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:57:36 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012
Nov 08 03:57:36 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:57:36 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:57:36 user nova-compute[75014]: FIRMWARE:
Nov 08 03:57:36 user nova-compute[75014]: No targets found.
Nov 08 03:57:36 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 03:57:36 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 03:57:36 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50adc3d1-c482-4040-8bd2-e107a25dae7a', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efbf082-f468-42c1-a208-bc7ef5289e11]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1af4b22-99fd-40b1-8463-91a0835d76d6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 03:57:36 user nova-compute[75014]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 (non-flash)
Nov 08 03:57:36 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:57:36 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 03:57:36 user nova-compute[75014]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 (non-flash)
Nov 08 03:57:36 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:57:36 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0400614940>, {}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Disconnecting from: [] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] <== disconnect_volume: return (74ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:1faffa6f-e6c1-4c89-9be7-3cb9e0769e54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WCrcjJBK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, None), 'kwargs': True}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:57:36 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: nova.exception.PortNotFound: Port id 2385bd9b-063b-4ba7-b80a-4910985bf841 could not be found.
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3507222f-0554-4665-bae0-ae1136d519c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 03:57:36 user nova-compute[75014]: No targets found.
Nov 08 03:57:36 user nova-compute[75014]: iSNS:
Nov 08 03:57:36 user nova-compute[75014]: No targets found.
Nov 08 03:57:36 user nova-compute[75014]: STATIC:
Nov 08 03:57:36 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec
Nov 08 03:57:36 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:57:36 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:57:36 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 03:57:36 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:57:36 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:57:36 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012
Nov 08 03:57:36 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:57:36 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:57:36 user nova-compute[75014]: FIRMWARE:
Nov 08 03:57:36 user nova-compute[75014]: No targets found.
Nov 08 03:57:36 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 03:57:36 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 03:57:36 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1faffa6f-e6c1-4c89-9be7-3cb9e0769e54', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c58b17-eb67-4783-a6db-ebc9ced5280e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fee29a-9062-4fc7-b529-e11dc504d851]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 03:57:36 user nova-compute[75014]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 (non-flash)
Nov 08 03:57:36 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:57:36 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 03:57:36 user nova-compute[75014]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 (non-flash)
Nov 08 03:57:36 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:57:36 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f04180ff0a0>, {}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Disconnecting from: [] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.103s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] <== disconnect_volume: return (105ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:04bbcba8-71bc-443e-a8b8-da75b1d92eb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXUmtkhT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, None), 'kwargs': True}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:57:36 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: nova.exception.PortNotFound: Port id 2385bd9b-063b-4ba7-b80a-4910985bf841 could not be found.
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc4dbe8-152a-440c-afd1-c46c9c64d2ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 03:57:36 user nova-compute[75014]: No targets found.
Nov 08 03:57:36 user nova-compute[75014]: iSNS:
Nov 08 03:57:36 user nova-compute[75014]: No targets found.
Nov 08 03:57:36 user nova-compute[75014]: STATIC:
Nov 08 03:57:36 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec
Nov 08 03:57:36 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:57:36 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:57:36 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 03:57:36 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:57:36 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:57:36 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012
Nov 08 03:57:36 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:57:36 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:57:36 user nova-compute[75014]: FIRMWARE:
Nov 08 03:57:36 user nova-compute[75014]: No targets found.
Nov 08 03:57:36 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 03:57:36 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 03:57:36 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04bbcba8-71bc-443e-a8b8-da75b1d92eb2', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e436aac0-97e3-4703-81ce-7ec754f2801c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fde68d-1e58-4d4f-935b-9910ef200a9e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 03:57:36 user nova-compute[75014]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 (non-flash)
Nov 08 03:57:36 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:57:36 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 03:57:36 user nova-compute[75014]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 (non-flash)
Nov 08 03:57:36 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:57:36 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f04180fd1b0>, {}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Disconnecting from: [] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.077s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] <== disconnect_volume: return (80ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 03:57:36 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Deleting instance files /opt/stack/data/nova/instances/4802a259-b7ae-4fc2-98ad-8fa3e2cc4965_del
Nov 08 03:57:36 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Deletion of /opt/stack/data/nova/instances/4802a259-b7ae-4fc2-98ad-8fa3e2cc4965_del complete
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:36 user nova-compute[75014]: INFO nova.compute.manager [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Took 0.37 seconds to destroy the instance on the hypervisor.
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "PortNotFound", "message": "Port 2385bd9b-063b-4ba7-b80a-4910985bf841 could not be found.", "detail": ""}} {{(pid=75014) _handle_fault_response /opt/stack/data/venv/lib/python3.10/site-packages/neutronclient/v2_0/client.py:262}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG nova.network.neutron [-] Unable to show port 2385bd9b-063b-4ba7-b80a-4910985bf841 as it no longer exists. {{(pid=75014) _unbind_ports /opt/stack/nova/nova/network/neutron.py:666}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "PortNotFound", "message": "Port ae454f7d-21d3-4332-92d6-33f431a3b659 could not be found.", "detail": ""}} {{(pid=75014) _handle_fault_response /opt/stack/data/venv/lib/python3.10/site-packages/neutronclient/v2_0/client.py:262}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG nova.network.neutron [-] Unable to show port ae454f7d-21d3-4332-92d6-33f431a3b659 as it no longer exists. {{(pid=75014) _unbind_ports /opt/stack/nova/nova/network/neutron.py:666}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:57:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:37 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Took 0.16 seconds to deallocate network for instance.
Nov 08 03:57:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "691bf2a3-13b2-466c-90a3-8dd01dfc18cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "691bf2a3-13b2-466c-90a3-8dd01dfc18cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:37 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:57:37 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:57:37 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=7667MB free_disk=25.227954864501953GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 03:57:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:37 user nova-compute[75014]: DEBUG nova.compute.manager [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 03:57:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:37 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9f205fe5-576f-4ef0-874b-1544c0307a7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:57:37 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 5bfa6580-e0fe-46b0-b497-8db67806113a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:57:37 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 8527ee40-fb8a-469b-9696-d7bde8cc96f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:57:37 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 7dd0e158-473f-4785-a5cf-a75b2da85b29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:57:37 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:57:37 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 655fe5eb-1271-4b9f-a5a6-6342bd012a69 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:57:37 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 4d07d94d-1122-46a5-99a7-7dcdca404035 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:57:37 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance af246bb7-2e77-469b-bf98-cf05b467255c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:57:37 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance bd153f84-98cd-4c6d-a7ab-5759b0b5bf55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:57:37 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 691bf2a3-13b2-466c-90a3-8dd01dfc18cb has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 08 03:57:37 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 03:57:37 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 03:57:38 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:57:38 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:57:38 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 03:57:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.613s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.484s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 03:57:38 user nova-compute[75014]: INFO nova.compute.claims [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Claim successful on node user
Nov 08 03:57:38 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:57:38 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:57:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:38 user nova-compute[75014]: DEBUG nova.compute.manager [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 03:57:38 user nova-compute[75014]: DEBUG nova.compute.manager [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 03:57:38 user nova-compute[75014]: DEBUG nova.network.neutron [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 03:57:38 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 03:57:38 user nova-compute[75014]: DEBUG nova.compute.manager [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 03:57:38 user nova-compute[75014]: DEBUG nova.policy [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c8c674d8b2cf49c08cf254a8095ef8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c9753cb588478a8a93182be3256674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 03:57:38 user nova-compute[75014]: DEBUG nova.compute.manager [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 03:57:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 03:57:38 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Creating image(s)
Nov 08 03:57:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "/opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "/opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "/opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.233s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.186s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk 1073741824" returned: 0 in 0.063s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:39 user nova-compute[75014]: DEBUG nova.network.neutron [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Successfully created port: fddcd530-d245-4d58-a0ca-59ddc2ac0121 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 03:57:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.183s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:39 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Checking if we can resize image /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 03:57:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:39 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Cannot resize image /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 03:57:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 03:57:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Ensure instance console log exists: /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 03:57:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:40 user nova-compute[75014]: INFO nova.compute.manager [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Took 3.25 seconds to detach 3 volumes for instance.
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.compute.claims [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Aborting claim: <nova.compute.claims.Claim object at 0x7f04181f5e10> {{(pid=75014) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.network.neutron [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Successfully updated port: fddcd530-d245-4d58-a0ca-59ddc2ac0121 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "refresh_cache-691bf2a3-13b2-466c-90a3-8dd01dfc18cb" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquired lock "refresh_cache-691bf2a3-13b2-466c-90a3-8dd01dfc18cb" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.network.neutron [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.compute.manager [req-dd7ff9c9-9ef3-433d-a079-4671aadd56f8 req-34f36e92-405c-4090-b497-76b53aa6747f service nova] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Received event network-changed-fddcd530-d245-4d58-a0ca-59ddc2ac0121 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.compute.manager [req-dd7ff9c9-9ef3-433d-a079-4671aadd56f8 req-34f36e92-405c-4090-b497-76b53aa6747f service nova] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Refreshing instance network info cache due to event network-changed-fddcd530-d245-4d58-a0ca-59ddc2ac0121. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dd7ff9c9-9ef3-433d-a079-4671aadd56f8 req-34f36e92-405c-4090-b497-76b53aa6747f service nova] Acquiring lock "refresh_cache-691bf2a3-13b2-466c-90a3-8dd01dfc18cb" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.network.neutron [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.network.neutron [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Updating instance_info_cache with network_info: [{"id": "fddcd530-d245-4d58-a0ca-59ddc2ac0121", "address": "fa:16:3e:27:87:8b", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfddcd530-d2", "ovs_interfaceid": "fddcd530-d245-4d58-a0ca-59ddc2ac0121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Releasing lock "refresh_cache-691bf2a3-13b2-466c-90a3-8dd01dfc18cb" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.compute.manager [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Instance network_info: |[{"id": "fddcd530-d245-4d58-a0ca-59ddc2ac0121", "address": "fa:16:3e:27:87:8b", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfddcd530-d2", "ovs_interfaceid": "fddcd530-d245-4d58-a0ca-59ddc2ac0121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dd7ff9c9-9ef3-433d-a079-4671aadd56f8 req-34f36e92-405c-4090-b497-76b53aa6747f service nova] Acquired lock "refresh_cache-691bf2a3-13b2-466c-90a3-8dd01dfc18cb" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.network.neutron [req-dd7ff9c9-9ef3-433d-a079-4671aadd56f8 req-34f36e92-405c-4090-b497-76b53aa6747f service nova] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Refreshing network info cache for port fddcd530-d245-4d58-a0ca-59ddc2ac0121 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Start _get_guest_xml network_info=[{"id": "fddcd530-d245-4d58-a0ca-59ddc2ac0121", "address": "fa:16:3e:27:87:8b", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfddcd530-d2", "ovs_interfaceid": "fddcd530-d245-4d58-a0ca-59ddc2ac0121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 03:57:40 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:57:40 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:57:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-549866031',display_name='tempest-AttachVolumeNegativeTest-server-549866031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-549866031',id=17,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZpZAmuH3ZrhrFPf9kWKXV4/Wfw2G0IqwJ5Adj4Y9yFy3YQzeKd5ElckWK+avKvBYhXo8LTI8JfqrFynPydTDRFnfGFyF9C+9cjsEO8opg/CHeCgFFjkHo84XwbkemGqA==',key_name='tempest-keypair-1998429471',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1c9753cb588478a8a93182be3256674',ramdisk_id='',reservation_id='r-0bb23suk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1215701914',owner_user_name='tempest-AttachVolumeNegativeTest-1215701914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:57:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8c674d8b2cf49c08cf254a8095ef8ea',uuid=691bf2a3-13b2-466c-90a3-8dd01dfc18cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fddcd530-d245-4d58-a0ca-59ddc2ac0121", "address": "fa:16:3e:27:87:8b", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfddcd530-d2", "ovs_interfaceid": "fddcd530-d245-4d58-a0ca-59ddc2ac0121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Converting VIF {"id": "fddcd530-d245-4d58-a0ca-59ddc2ac0121", "address": "fa:16:3e:27:87:8b", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfddcd530-d2", "ovs_interfaceid": "fddcd530-d245-4d58-a0ca-59ddc2ac0121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:87:8b,bridge_name='br-int',has_traffic_filtering=True,id=fddcd530-d245-4d58-a0ca-59ddc2ac0121,network=Network(f3d67270-d525-45d9-958c-a901d121d510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfddcd530-d2') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.objects.instance [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lazy-loading 'pci_devices' on Instance uuid 691bf2a3-13b2-466c-90a3-8dd01dfc18cb {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] End _get_guest_xml xml=<domain type="kvm">
Nov 08 03:57:40 user nova-compute[75014]:   <uuid>691bf2a3-13b2-466c-90a3-8dd01dfc18cb</uuid>
Nov 08 03:57:40 user nova-compute[75014]:   <name>instance-00000011</name>
Nov 08 03:57:40 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 03:57:40 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 03:57:40 user nova-compute[75014]:   <metadata>
Nov 08 03:57:40 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 03:57:40 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 03:57:40 user nova-compute[75014]:       <nova:name>tempest-AttachVolumeNegativeTest-server-549866031</nova:name>
Nov 08 03:57:40 user nova-compute[75014]:       <nova:creationTime>2023-11-08 03:57:40</nova:creationTime>
Nov 08 03:57:40 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 03:57:40 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 03:57:40 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 03:57:40 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 03:57:40 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 03:57:40 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 03:57:40 user nova-compute[75014]:       </nova:flavor>
Nov 08 03:57:40 user nova-compute[75014]:       <nova:owner>
Nov 08 03:57:40 user nova-compute[75014]:         <nova:user uuid="c8c674d8b2cf49c08cf254a8095ef8ea">tempest-AttachVolumeNegativeTest-1215701914-project-member</nova:user>
Nov 08 03:57:40 user nova-compute[75014]:         <nova:project uuid="f1c9753cb588478a8a93182be3256674">tempest-AttachVolumeNegativeTest-1215701914</nova:project>
Nov 08 03:57:40 user nova-compute[75014]:       </nova:owner>
Nov 08 03:57:40 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 03:57:40 user nova-compute[75014]:       <nova:ports>
Nov 08 03:57:40 user nova-compute[75014]:         <nova:port uuid="fddcd530-d245-4d58-a0ca-59ddc2ac0121">
Nov 08 03:57:40 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 03:57:40 user nova-compute[75014]:         </nova:port>
Nov 08 03:57:40 user nova-compute[75014]:       </nova:ports>
Nov 08 03:57:40 user nova-compute[75014]:     </nova:instance>
Nov 08 03:57:40 user nova-compute[75014]:   </metadata>
Nov 08 03:57:40 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 03:57:40 user nova-compute[75014]:     <system>
Nov 08 03:57:40 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 03:57:40 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 03:57:40 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 03:57:40 user nova-compute[75014]:       <entry name="serial">691bf2a3-13b2-466c-90a3-8dd01dfc18cb</entry>
Nov 08 03:57:40 user nova-compute[75014]:       <entry name="uuid">691bf2a3-13b2-466c-90a3-8dd01dfc18cb</entry>
Nov 08 03:57:40 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 03:57:40 user nova-compute[75014]:     </system>
Nov 08 03:57:40 user nova-compute[75014]:   </sysinfo>
Nov 08 03:57:40 user nova-compute[75014]:   <os>
Nov 08 03:57:40 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 03:57:40 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 03:57:40 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 03:57:40 user nova-compute[75014]:   </os>
Nov 08 03:57:40 user nova-compute[75014]:   <features>
Nov 08 03:57:40 user nova-compute[75014]:     <acpi/>
Nov 08 03:57:40 user nova-compute[75014]:     <apic/>
Nov 08 03:57:40 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 03:57:40 user nova-compute[75014]:   </features>
Nov 08 03:57:40 user nova-compute[75014]:   <clock offset="utc">
Nov 08 03:57:40 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 03:57:40 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 03:57:40 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 03:57:40 user nova-compute[75014]:   </clock>
Nov 08 03:57:40 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 03:57:40 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 03:57:40 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 03:57:40 user nova-compute[75014]:   </cpu>
Nov 08 03:57:40 user nova-compute[75014]:   <devices>
Nov 08 03:57:40 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 03:57:40 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 03:57:40 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk"/>
Nov 08 03:57:40 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 03:57:40 user nova-compute[75014]:     </disk>
Nov 08 03:57:40 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:57:40 user nova-compute[75014]:       <mac address="fa:16:3e:27:87:8b"/>
Nov 08 03:57:40 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:57:40 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:57:40 user nova-compute[75014]:       <target dev="tapfddcd530-d2"/>
Nov 08 03:57:40 user nova-compute[75014]:     </interface>
Nov 08 03:57:40 user nova-compute[75014]:     <serial type="pty">
Nov 08 03:57:40 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/console.log" append="off"/>
Nov 08 03:57:40 user nova-compute[75014]:     </serial>
Nov 08 03:57:40 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 03:57:40 user nova-compute[75014]:     <video>
Nov 08 03:57:40 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:57:40 user nova-compute[75014]:     </video>
Nov 08 03:57:40 user nova-compute[75014]:     <rng model="virtio">
Nov 08 03:57:40 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 03:57:40 user nova-compute[75014]:     </rng>
Nov 08 03:57:40 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 03:57:40 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 03:57:40 user nova-compute[75014]:       <stats period="10"/>
Nov 08 03:57:40 user nova-compute[75014]:     </memballoon>
Nov 08 03:57:40 user nova-compute[75014]:   </devices>
Nov 08 03:57:40 user nova-compute[75014]: </domain>
Nov 08 03:57:40 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:57:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-549866031',display_name='tempest-AttachVolumeNegativeTest-server-549866031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-549866031',id=17,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZpZAmuH3ZrhrFPf9kWKXV4/Wfw2G0IqwJ5Adj4Y9yFy3YQzeKd5ElckWK+avKvBYhXo8LTI8JfqrFynPydTDRFnfGFyF9C+9cjsEO8opg/CHeCgFFjkHo84XwbkemGqA==',key_name='tempest-keypair-1998429471',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1c9753cb588478a8a93182be3256674',ramdisk_id='',reservation_id='r-0bb23suk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1215701914',owner_user_name='tempest-AttachVolumeNegativeTest-1215701914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:57:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8c674d8b2cf49c08cf254a8095ef8ea',uuid=691bf2a3-13b2-466c-90a3-8dd01dfc18cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fddcd530-d245-4d58-a0ca-59ddc2ac0121", "address": "fa:16:3e:27:87:8b", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfddcd530-d2", "ovs_interfaceid": "fddcd530-d245-4d58-a0ca-59ddc2ac0121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Converting VIF {"id": "fddcd530-d245-4d58-a0ca-59ddc2ac0121", "address": "fa:16:3e:27:87:8b", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfddcd530-d2", "ovs_interfaceid": "fddcd530-d245-4d58-a0ca-59ddc2ac0121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:87:8b,bridge_name='br-int',has_traffic_filtering=True,id=fddcd530-d245-4d58-a0ca-59ddc2ac0121,network=Network(f3d67270-d525-45d9-958c-a901d121d510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfddcd530-d2') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG os_vif [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:87:8b,bridge_name='br-int',has_traffic_filtering=True,id=fddcd530-d245-4d58-a0ca-59ddc2ac0121,network=Network(f3d67270-d525-45d9-958c-a901d121d510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfddcd530-d2') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '828808ec-ba0c-51d6-87b7-b065243a6590', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfddcd530-d2, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfddcd530-d2, col_values=(('qos', UUID('039825a4-bede-40c2-9f17-9aa2277991de')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfddcd530-d2, col_values=(('external_ids', {'iface-id': 'fddcd530-d245-4d58-a0ca-59ddc2ac0121', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:87:8b', 'vm-uuid': '691bf2a3-13b2-466c-90a3-8dd01dfc18cb'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.640s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Failed to build and run instance: nova.exception.PortNotFound: Port id 2385bd9b-063b-4ba7-b80a-4910985bf841 could not be found.
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Traceback (most recent call last):
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/network/neutron.py", line 1975, in _show_port
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     result = neutron_client.show_port(port_id)
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     ret = obj(*args, **kwargs)
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/data/venv/lib/python3.10/site-packages/neutronclient/v2_0/client.py", line 820, in show_port
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     return self.get(self.port_path % (port), params=_params)
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     ret = obj(*args, **kwargs)
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/data/venv/lib/python3.10/site-packages/neutronclient/v2_0/client.py", line 356, in get
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     return self.retry_request("GET", action, body=body,
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     ret = obj(*args, **kwargs)
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/data/venv/lib/python3.10/site-packages/neutronclient/v2_0/client.py", line 333, in retry_request
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     return self.do_request(method, action, body=body,
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     ret = obj(*args, **kwargs)
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/data/venv/lib/python3.10/site-packages/neutronclient/v2_0/client.py", line 297, in do_request
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     self._handle_fault_response(status_code, replybody, resp)
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     ret = obj(*args, **kwargs)
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/data/venv/lib/python3.10/site-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     exception_handler_v20(status_code, error_body)
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/data/venv/lib/python3.10/site-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     raise client_exc(message=error_message,
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] neutronclient.common.exceptions.PortNotFoundClient: Port 2385bd9b-063b-4ba7-b80a-4910985bf841 could not be found.
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Neutron server returns request_ids: ['req-fb5288c8-ece1-4b8b-b792-969118b3ad4e']
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] 
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] During handling of the above exception, another exception occurred:
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] 
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Traceback (most recent call last):
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/compute/manager.py", line 2631, in _build_and_run_instance
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     self.driver.spawn(context, instance, image_meta,
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4411, in spawn
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     xml = self._get_guest_xml(context, instance, network_info,
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 7551, in _get_guest_xml
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     network_info_str = str(network_info)
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/network/model.py", line 620, in __str__
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     return self._sync_wrapper(fn, *args, **kwargs)
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/network/model.py", line 603, in _sync_wrapper
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     self.wait()
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/network/model.py", line 635, in wait
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     self[:] = self._gt.wait()
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 181, in wait
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     return self._exit_event.wait()
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/event.py", line 132, in wait
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     current.throw(*self._exc)
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 221, in main
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     result = function(*args, **kwargs)
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/utils.py", line 664, in context_wrapper
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     return func(*args, **kwargs)
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/compute/manager.py", line 2002, in _allocate_network_async
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     raise e
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/compute/manager.py", line 1980, in _allocate_network_async
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     nwinfo = self.network_api.allocate_for_instance(
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/network/neutron.py", line 1182, in allocate_for_instance
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     self._validate_requested_port_ids(
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/network/neutron.py", line 770, in _validate_requested_port_ids
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     port = self._show_port(context, request.port_id,
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]   File "/opt/stack/nova/nova/network/neutron.py", line 1978, in _show_port
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965]     raise exception.PortNotFound(port_id=port_id)
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] nova.exception.PortNotFound: Port id 2385bd9b-063b-4ba7-b80a-4910985bf841 could not be found.
Nov 08 03:57:40 user nova-compute[75014]: ERROR nova.compute.manager [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] 
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.compute.utils [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Port id 2385bd9b-063b-4ba7-b80a-4910985bf841 could not be found. {{(pid=75014) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:40 user nova-compute[75014]: INFO os_vif [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:87:8b,bridge_name='br-int',has_traffic_filtering=True,id=fddcd530-d245-4d58-a0ca-59ddc2ac0121,network=Network(f3d67270-d525-45d9-958c-a901d121d510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfddcd530-d2')
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Build of instance 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965 was re-scheduled: Port id 2385bd9b-063b-4ba7-b80a-4910985bf841 could not be found. {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2470}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Unplugging VIFs for instance {{(pid=75014) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Acquiring lock "refresh_cache-4802a259-b7ae-4fc2-98ad-8fa3e2cc4965" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Acquired lock "refresh_cache-4802a259-b7ae-4fc2-98ad-8fa3e2cc4965" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.network.neutron [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:57:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] No VIF found with MAC fa:16:3e:27:87:8b, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:57:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dbbc468a-1d5f-4815-aa27-00c00281918e tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Acquiring lock "4d07d94d-1122-46a5-99a7-7dcdca404035" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dbbc468a-1d5f-4815-aa27-00c00281918e tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Lock "4d07d94d-1122-46a5-99a7-7dcdca404035" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dbbc468a-1d5f-4815-aa27-00c00281918e tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Acquiring lock "4d07d94d-1122-46a5-99a7-7dcdca404035-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dbbc468a-1d5f-4815-aa27-00c00281918e tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Lock "4d07d94d-1122-46a5-99a7-7dcdca404035-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dbbc468a-1d5f-4815-aa27-00c00281918e tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Lock "4d07d94d-1122-46a5-99a7-7dcdca404035-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:41 user nova-compute[75014]: INFO nova.compute.manager [None req-dbbc468a-1d5f-4815-aa27-00c00281918e tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Terminating instance
Nov 08 03:57:41 user nova-compute[75014]: DEBUG nova.compute.manager [None req-dbbc468a-1d5f-4815-aa27-00c00281918e tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 03:57:41 user nova-compute[75014]: DEBUG nova.network.neutron [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 03:57:41 user nova-compute[75014]: INFO nova.compute.manager [None req-9774ac26-23bd-4a97-8c08-40965170df89 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Unrescuing
Nov 08 03:57:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9774ac26-23bd-4a97-8c08-40965170df89 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "refresh_cache-655fe5eb-1271-4b9f-a5a6-6342bd012a69" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:57:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9774ac26-23bd-4a97-8c08-40965170df89 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquired lock "refresh_cache-655fe5eb-1271-4b9f-a5a6-6342bd012a69" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:57:41 user nova-compute[75014]: DEBUG nova.network.neutron [None req-9774ac26-23bd-4a97-8c08-40965170df89 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 03:57:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:41 user nova-compute[75014]: DEBUG nova.network.neutron [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:57:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Releasing lock "refresh_cache-4802a259-b7ae-4fc2-98ad-8fa3e2cc4965" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:57:41 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Unplugged VIFs for instance {{(pid=75014) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 08 03:57:41 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 03:57:41 user nova-compute[75014]: DEBUG nova.network.neutron [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 03:57:41 user nova-compute[75014]: DEBUG nova.network.neutron [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 03:57:41 user nova-compute[75014]: DEBUG neutronclient.v2_0.client [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Error message: {"NeutronError": {"type": "PortNotFound", "message": "Port 2385bd9b-063b-4ba7-b80a-4910985bf841 could not be found.", "detail": ""}} {{(pid=75014) _handle_fault_response /opt/stack/data/venv/lib/python3.10/site-packages/neutronclient/v2_0/client.py:262}}
Nov 08 03:57:41 user nova-compute[75014]: DEBUG nova.network.neutron [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Unable to show port 2385bd9b-063b-4ba7-b80a-4910985bf841 as it no longer exists. {{(pid=75014) _unbind_ports /opt/stack/nova/nova/network/neutron.py:666}}
Nov 08 03:57:41 user nova-compute[75014]: DEBUG neutronclient.v2_0.client [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Error message: {"NeutronError": {"type": "PortNotFound", "message": "Port ae454f7d-21d3-4332-92d6-33f431a3b659 could not be found.", "detail": ""}} {{(pid=75014) _handle_fault_response /opt/stack/data/venv/lib/python3.10/site-packages/neutronclient/v2_0/client.py:262}}
Nov 08 03:57:41 user nova-compute[75014]: DEBUG nova.network.neutron [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Unable to show port ae454f7d-21d3-4332-92d6-33f431a3b659 as it no longer exists. {{(pid=75014) _unbind_ports /opt/stack/nova/nova/network/neutron.py:666}}
Nov 08 03:57:41 user nova-compute[75014]: DEBUG nova.network.neutron [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:57:41 user nova-compute[75014]: INFO nova.compute.manager [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] Took 0.19 seconds to deallocate network for instance.
Nov 08 03:57:41 user nova-compute[75014]: DEBUG nova.network.neutron [req-dd7ff9c9-9ef3-433d-a079-4671aadd56f8 req-34f36e92-405c-4090-b497-76b53aa6747f service nova] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Updated VIF entry in instance network info cache for port fddcd530-d245-4d58-a0ca-59ddc2ac0121. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:57:41 user nova-compute[75014]: DEBUG nova.network.neutron [req-dd7ff9c9-9ef3-433d-a079-4671aadd56f8 req-34f36e92-405c-4090-b497-76b53aa6747f service nova] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Updating instance_info_cache with network_info: [{"id": "fddcd530-d245-4d58-a0ca-59ddc2ac0121", "address": "fa:16:3e:27:87:8b", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfddcd530-d2", "ovs_interfaceid": "fddcd530-d245-4d58-a0ca-59ddc2ac0121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:57:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dd7ff9c9-9ef3-433d-a079-4671aadd56f8 req-34f36e92-405c-4090-b497-76b53aa6747f service nova] Releasing lock "refresh_cache-691bf2a3-13b2-466c-90a3-8dd01dfc18cb" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:57:41 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Deleted allocations for instance 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965
Nov 08 03:57:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7d592e32-0617-4718-95a6-bbc4520de377 tempest-TaggedBootDevicesTest-1093005057 tempest-TaggedBootDevicesTest-1093005057-project-member] Lock "4802a259-b7ae-4fc2-98ad-8fa3e2cc4965" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 274.133s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "4802a259-b7ae-4fc2-98ad-8fa3e2cc4965" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 79.835s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:41 user nova-compute[75014]: INFO nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 4802a259-b7ae-4fc2-98ad-8fa3e2cc4965] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 08 03:57:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "4802a259-b7ae-4fc2-98ad-8fa3e2cc4965" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:41 user nova-compute[75014]: DEBUG nova.network.neutron [None req-9774ac26-23bd-4a97-8c08-40965170df89 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Updating instance_info_cache with network_info: [{"id": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "address": "fa:16:3e:65:33:45", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9034975-10", "ovs_interfaceid": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:57:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9774ac26-23bd-4a97-8c08-40965170df89 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Releasing lock "refresh_cache-655fe5eb-1271-4b9f-a5a6-6342bd012a69" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:57:41 user nova-compute[75014]: DEBUG nova.objects.instance [None req-9774ac26-23bd-4a97-8c08-40965170df89 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lazy-loading 'flavor' on Instance uuid 655fe5eb-1271-4b9f-a5a6-6342bd012a69 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:57:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:42 user nova-compute[75014]: DEBUG nova.compute.manager [req-9ebf1929-d3e3-418c-ac87-991bfd49d34e req-5370949e-31aa-4d60-b1c9-9484d1914ca8 service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Received event network-vif-unplugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:57:42 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-9ebf1929-d3e3-418c-ac87-991bfd49d34e req-5370949e-31aa-4d60-b1c9-9484d1914ca8 service nova] Acquiring lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:42 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-9ebf1929-d3e3-418c-ac87-991bfd49d34e req-5370949e-31aa-4d60-b1c9-9484d1914ca8 service nova] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:42 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-9ebf1929-d3e3-418c-ac87-991bfd49d34e req-5370949e-31aa-4d60-b1c9-9484d1914ca8 service nova] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:42 user nova-compute[75014]: DEBUG nova.compute.manager [req-9ebf1929-d3e3-418c-ac87-991bfd49d34e req-5370949e-31aa-4d60-b1c9-9484d1914ca8 service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] No waiting events found dispatching network-vif-unplugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:57:42 user nova-compute[75014]: WARNING nova.compute.manager [req-9ebf1929-d3e3-418c-ac87-991bfd49d34e req-5370949e-31aa-4d60-b1c9-9484d1914ca8 service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Received unexpected event network-vif-unplugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 for instance with vm_state rescued and task_state unrescuing.
Nov 08 03:57:42 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Instance destroyed successfully.
Nov 08 03:57:42 user nova-compute[75014]: DEBUG nova.objects.instance [None req-dbbc468a-1d5f-4815-aa27-00c00281918e tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Lazy-loading 'resources' on Instance uuid 4d07d94d-1122-46a5-99a7-7dcdca404035 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:57:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-dbbc468a-1d5f-4815-aa27-00c00281918e tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:55:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1782544812',display_name='tempest-VolumesNegativeTest-instance-1782544812',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1782544812',id=14,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:56:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='551efacbbc1f403ea548a2b732ac2707',ramdisk_id='',reservation_id='r-zkawza0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-442582276',owner_user_name='tempest-VolumesNegativeTest-442582276-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T03:56:02Z,user_data=None,user_id='8806652d61094a8892c8c4f9a2554b9c',uuid=4d07d94d-1122-46a5-99a7-7dcdca404035,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e554fec9-cfd0-4b76-bc87-90426a961bec", "address": "fa:16:3e:43:0d:75", "network": {"id": "bced25bb-5685-48c9-bd64-2625aff5a55e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c9ddfe8ede87470cacd18a271f68e9dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape554fec9-cf", "ovs_interfaceid": "e554fec9-cfd0-4b76-bc87-90426a961bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 03:57:42 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-dbbc468a-1d5f-4815-aa27-00c00281918e tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Converting VIF {"id": "e554fec9-cfd0-4b76-bc87-90426a961bec", "address": "fa:16:3e:43:0d:75", "network": {"id": "bced25bb-5685-48c9-bd64-2625aff5a55e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c9ddfe8ede87470cacd18a271f68e9dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape554fec9-cf", "ovs_interfaceid": "e554fec9-cfd0-4b76-bc87-90426a961bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:57:42 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-dbbc468a-1d5f-4815-aa27-00c00281918e tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:0d:75,bridge_name='br-int',has_traffic_filtering=True,id=e554fec9-cfd0-4b76-bc87-90426a961bec,network=Network(bced25bb-5685-48c9-bd64-2625aff5a55e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape554fec9-cf') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:57:42 user nova-compute[75014]: DEBUG os_vif [None req-dbbc468a-1d5f-4815-aa27-00c00281918e tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:0d:75,bridge_name='br-int',has_traffic_filtering=True,id=e554fec9-cfd0-4b76-bc87-90426a961bec,network=Network(bced25bb-5685-48c9-bd64-2625aff5a55e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape554fec9-cf') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 03:57:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape554fec9-cf, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:57:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:57:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b088fb05-d25f-4da3-a3c4-3cb9744b9bbc) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:57:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:57:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:42 user nova-compute[75014]: INFO os_vif [None req-dbbc468a-1d5f-4815-aa27-00c00281918e tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:0d:75,bridge_name='br-int',has_traffic_filtering=True,id=e554fec9-cfd0-4b76-bc87-90426a961bec,network=Network(bced25bb-5685-48c9-bd64-2625aff5a55e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape554fec9-cf')
Nov 08 03:57:42 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-dbbc468a-1d5f-4815-aa27-00c00281918e tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Deleting instance files /opt/stack/data/nova/instances/4d07d94d-1122-46a5-99a7-7dcdca404035_del
Nov 08 03:57:42 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-dbbc468a-1d5f-4815-aa27-00c00281918e tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Deletion of /opt/stack/data/nova/instances/4d07d94d-1122-46a5-99a7-7dcdca404035_del complete
Nov 08 03:57:43 user nova-compute[75014]: INFO nova.compute.manager [None req-dbbc468a-1d5f-4815-aa27-00c00281918e tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Took 1.99 seconds to destroy the instance on the hypervisor.
Nov 08 03:57:43 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-dbbc468a-1d5f-4815-aa27-00c00281918e tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 03:57:43 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 03:57:43 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 03:57:43 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Instance destroyed successfully.
Nov 08 03:57:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:43 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:57:43 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Took 0.51 seconds to deallocate network for instance.
Nov 08 03:57:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dbbc468a-1d5f-4815-aa27-00c00281918e tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dbbc468a-1d5f-4815-aa27-00c00281918e tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Acquiring lock "e9b9615d-29bf-4a71-adac-180eb1bb8727" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lock "e9b9615d-29bf-4a71-adac-180eb1bb8727" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:43 user nova-compute[75014]: DEBUG nova.compute.manager [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 03:57:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:43 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-dbbc468a-1d5f-4815-aa27-00c00281918e tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:57:44 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-dbbc468a-1d5f-4815-aa27-00c00281918e tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:57:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dbbc468a-1d5f-4815-aa27-00c00281918e tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.458s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:44 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 03:57:44 user nova-compute[75014]: INFO nova.compute.claims [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Claim successful on node user
Nov 08 03:57:44 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-dbbc468a-1d5f-4815-aa27-00c00281918e tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Deleted allocations for instance 4d07d94d-1122-46a5-99a7-7dcdca404035
Nov 08 03:57:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dbbc468a-1d5f-4815-aa27-00c00281918e tempest-VolumesNegativeTest-442582276 tempest-VolumesNegativeTest-442582276-project-member] Lock "4d07d94d-1122-46a5-99a7-7dcdca404035" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.194s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:44 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:57:44 user nova-compute[75014]: DEBUG nova.compute.manager [req-b32e4ad3-00ec-4687-9db7-d327949703ab req-ebefc017-6571-4644-a0e8-935807278b4a service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Received event network-vif-plugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:57:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b32e4ad3-00ec-4687-9db7-d327949703ab req-ebefc017-6571-4644-a0e8-935807278b4a service nova] Acquiring lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b32e4ad3-00ec-4687-9db7-d327949703ab req-ebefc017-6571-4644-a0e8-935807278b4a service nova] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b32e4ad3-00ec-4687-9db7-d327949703ab req-ebefc017-6571-4644-a0e8-935807278b4a service nova] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:44 user nova-compute[75014]: DEBUG nova.compute.manager [req-b32e4ad3-00ec-4687-9db7-d327949703ab req-ebefc017-6571-4644-a0e8-935807278b4a service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] No waiting events found dispatching network-vif-plugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:57:44 user nova-compute[75014]: WARNING nova.compute.manager [req-b32e4ad3-00ec-4687-9db7-d327949703ab req-ebefc017-6571-4644-a0e8-935807278b4a service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Received unexpected event network-vif-plugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 for instance with vm_state rescued and task_state unrescuing.
Nov 08 03:57:44 user nova-compute[75014]: DEBUG nova.compute.manager [req-b32e4ad3-00ec-4687-9db7-d327949703ab req-ebefc017-6571-4644-a0e8-935807278b4a service nova] [instance: 4d07d94d-1122-46a5-99a7-7dcdca404035] Received event network-vif-deleted-e554fec9-cfd0-4b76-bc87-90426a961bec {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:57:44 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:57:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:44 user nova-compute[75014]: DEBUG nova.compute.manager [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 03:57:44 user nova-compute[75014]: DEBUG nova.compute.manager [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 03:57:44 user nova-compute[75014]: DEBUG nova.network.neutron [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 03:57:44 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 03:57:44 user nova-compute[75014]: DEBUG nova.compute.manager [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 03:57:44 user nova-compute[75014]: DEBUG nova.policy [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2952d351dfab46f2bd6caa61d6d59540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77d1e7a3adc430ab1a17b1c954db9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 03:57:44 user nova-compute[75014]: DEBUG nova.compute.manager [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 03:57:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 03:57:44 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Creating image(s)
Nov 08 03:57:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Acquiring lock "/opt/stack/data/nova/instances/e9b9615d-29bf-4a71-adac-180eb1bb8727/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lock "/opt/stack/data/nova/instances/e9b9615d-29bf-4a71-adac-180eb1bb8727/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lock "/opt/stack/data/nova/instances/e9b9615d-29bf-4a71-adac-180eb1bb8727/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.172s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.258s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/e9b9615d-29bf-4a71-adac-180eb1bb8727/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/e9b9615d-29bf-4a71-adac-180eb1bb8727/disk 1073741824" returned: 0 in 0.066s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.331s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.251s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:45 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e9b9615d-29bf-4a71-adac-180eb1bb8727/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 03:57:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b9615d-29bf-4a71-adac-180eb1bb8727/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:45 user nova-compute[75014]: DEBUG nova.network.neutron [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Successfully created port: 51fdb271-ca03-4148-9d9c-a05c8412aaaa {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 03:57:45 user nova-compute[75014]: DEBUG nova.compute.manager [req-37728eca-831a-484f-8ad8-61e49a3767e3 req-69aaea69-e2cd-4d23-824a-587164b1cb07 service nova] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Received event network-vif-plugged-fddcd530-d245-4d58-a0ca-59ddc2ac0121 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:57:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-37728eca-831a-484f-8ad8-61e49a3767e3 req-69aaea69-e2cd-4d23-824a-587164b1cb07 service nova] Acquiring lock "691bf2a3-13b2-466c-90a3-8dd01dfc18cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-37728eca-831a-484f-8ad8-61e49a3767e3 req-69aaea69-e2cd-4d23-824a-587164b1cb07 service nova] Lock "691bf2a3-13b2-466c-90a3-8dd01dfc18cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-37728eca-831a-484f-8ad8-61e49a3767e3 req-69aaea69-e2cd-4d23-824a-587164b1cb07 service nova] Lock "691bf2a3-13b2-466c-90a3-8dd01dfc18cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:45 user nova-compute[75014]: DEBUG nova.compute.manager [req-37728eca-831a-484f-8ad8-61e49a3767e3 req-69aaea69-e2cd-4d23-824a-587164b1cb07 service nova] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] No waiting events found dispatching network-vif-plugged-fddcd530-d245-4d58-a0ca-59ddc2ac0121 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:57:45 user nova-compute[75014]: WARNING nova.compute.manager [req-37728eca-831a-484f-8ad8-61e49a3767e3 req-69aaea69-e2cd-4d23-824a-587164b1cb07 service nova] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Received unexpected event network-vif-plugged-fddcd530-d245-4d58-a0ca-59ddc2ac0121 for instance with vm_state building and task_state spawning.
Nov 08 03:57:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b9615d-29bf-4a71-adac-180eb1bb8727/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:45 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Cannot resize image /opt/stack/data/nova/instances/e9b9615d-29bf-4a71-adac-180eb1bb8727/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 03:57:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 03:57:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Ensure instance console log exists: /opt/stack/data/nova/instances/e9b9615d-29bf-4a71-adac-180eb1bb8727/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 03:57:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:46 user nova-compute[75014]: DEBUG nova.network.neutron [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Successfully updated port: 51fdb271-ca03-4148-9d9c-a05c8412aaaa {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 03:57:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Acquiring lock "refresh_cache-e9b9615d-29bf-4a71-adac-180eb1bb8727" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:57:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Acquired lock "refresh_cache-e9b9615d-29bf-4a71-adac-180eb1bb8727" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:57:46 user nova-compute[75014]: DEBUG nova.network.neutron [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 03:57:46 user nova-compute[75014]: DEBUG nova.network.neutron [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 03:57:46 user nova-compute[75014]: DEBUG nova.compute.manager [req-f05ec010-0133-409f-ba2b-bc93d90e529a req-38c63535-f97b-427e-97fb-43ebe302e2e7 service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Received event network-vif-plugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:57:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f05ec010-0133-409f-ba2b-bc93d90e529a req-38c63535-f97b-427e-97fb-43ebe302e2e7 service nova] Acquiring lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f05ec010-0133-409f-ba2b-bc93d90e529a req-38c63535-f97b-427e-97fb-43ebe302e2e7 service nova] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f05ec010-0133-409f-ba2b-bc93d90e529a req-38c63535-f97b-427e-97fb-43ebe302e2e7 service nova] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:46 user nova-compute[75014]: DEBUG nova.compute.manager [req-f05ec010-0133-409f-ba2b-bc93d90e529a req-38c63535-f97b-427e-97fb-43ebe302e2e7 service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] No waiting events found dispatching network-vif-plugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:57:46 user nova-compute[75014]: WARNING nova.compute.manager [req-f05ec010-0133-409f-ba2b-bc93d90e529a req-38c63535-f97b-427e-97fb-43ebe302e2e7 service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Received unexpected event network-vif-plugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 for instance with vm_state rescued and task_state unrescuing.
Nov 08 03:57:46 user nova-compute[75014]: DEBUG nova.compute.manager [req-f05ec010-0133-409f-ba2b-bc93d90e529a req-38c63535-f97b-427e-97fb-43ebe302e2e7 service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Received event network-vif-plugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:57:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f05ec010-0133-409f-ba2b-bc93d90e529a req-38c63535-f97b-427e-97fb-43ebe302e2e7 service nova] Acquiring lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f05ec010-0133-409f-ba2b-bc93d90e529a req-38c63535-f97b-427e-97fb-43ebe302e2e7 service nova] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f05ec010-0133-409f-ba2b-bc93d90e529a req-38c63535-f97b-427e-97fb-43ebe302e2e7 service nova] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:46 user nova-compute[75014]: DEBUG nova.compute.manager [req-f05ec010-0133-409f-ba2b-bc93d90e529a req-38c63535-f97b-427e-97fb-43ebe302e2e7 service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] No waiting events found dispatching network-vif-plugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:57:46 user nova-compute[75014]: WARNING nova.compute.manager [req-f05ec010-0133-409f-ba2b-bc93d90e529a req-38c63535-f97b-427e-97fb-43ebe302e2e7 service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Received unexpected event network-vif-plugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 for instance with vm_state rescued and task_state unrescuing.
Nov 08 03:57:46 user nova-compute[75014]: DEBUG nova.compute.manager [req-f05ec010-0133-409f-ba2b-bc93d90e529a req-38c63535-f97b-427e-97fb-43ebe302e2e7 service nova] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Received event network-changed-51fdb271-ca03-4148-9d9c-a05c8412aaaa {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:57:46 user nova-compute[75014]: DEBUG nova.compute.manager [req-f05ec010-0133-409f-ba2b-bc93d90e529a req-38c63535-f97b-427e-97fb-43ebe302e2e7 service nova] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Refreshing instance network info cache due to event network-changed-51fdb271-ca03-4148-9d9c-a05c8412aaaa. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:57:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f05ec010-0133-409f-ba2b-bc93d90e529a req-38c63535-f97b-427e-97fb-43ebe302e2e7 service nova] Acquiring lock "refresh_cache-e9b9615d-29bf-4a71-adac-180eb1bb8727" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:57:46 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:46 user nova-compute[75014]: DEBUG nova.compute.manager [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 03:57:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 03:57:46 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Instance spawned successfully.
Nov 08 03:57:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 03:57:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:57:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:57:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:57:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:57:47 user nova-compute[75014]: INFO nova.compute.manager [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Took 8.29 seconds to spawn the instance on the hypervisor.
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.compute.manager [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:57:47 user nova-compute[75014]: INFO nova.compute.manager [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Took 9.65 seconds to build instance.
Nov 08 03:57:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b25ec2cd-93df-4bd6-80b3-ac17dc406ff7 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "691bf2a3-13b2-466c-90a3-8dd01dfc18cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.774s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.compute.manager [None req-9774ac26-23bd-4a97-8c08-40965170df89 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.network.neutron [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Updating instance_info_cache with network_info: [{"id": "51fdb271-ca03-4148-9d9c-a05c8412aaaa", "address": "fa:16:3e:9c:a3:b7", "network": {"id": "8ee4c37f-4f4b-4886-9824-d394b2d3d49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-754640303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77d1e7a3adc430ab1a17b1c954db9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fdb271-ca", "ovs_interfaceid": "51fdb271-ca03-4148-9d9c-a05c8412aaaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Releasing lock "refresh_cache-e9b9615d-29bf-4a71-adac-180eb1bb8727" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.compute.manager [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Instance network_info: |[{"id": "51fdb271-ca03-4148-9d9c-a05c8412aaaa", "address": "fa:16:3e:9c:a3:b7", "network": {"id": "8ee4c37f-4f4b-4886-9824-d394b2d3d49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-754640303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77d1e7a3adc430ab1a17b1c954db9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fdb271-ca", "ovs_interfaceid": "51fdb271-ca03-4148-9d9c-a05c8412aaaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f05ec010-0133-409f-ba2b-bc93d90e529a req-38c63535-f97b-427e-97fb-43ebe302e2e7 service nova] Acquired lock "refresh_cache-e9b9615d-29bf-4a71-adac-180eb1bb8727" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.network.neutron [req-f05ec010-0133-409f-ba2b-bc93d90e529a req-38c63535-f97b-427e-97fb-43ebe302e2e7 service nova] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Refreshing network info cache for port 51fdb271-ca03-4148-9d9c-a05c8412aaaa {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Start _get_guest_xml network_info=[{"id": "51fdb271-ca03-4148-9d9c-a05c8412aaaa", "address": "fa:16:3e:9c:a3:b7", "network": {"id": "8ee4c37f-4f4b-4886-9824-d394b2d3d49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-754640303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77d1e7a3adc430ab1a17b1c954db9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fdb271-ca", "ovs_interfaceid": "51fdb271-ca03-4148-9d9c-a05c8412aaaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.compute.manager [req-b1201136-7ce1-495b-9bf7-fc5041d15ba1 req-a5d8da35-ebd5-4410-b94c-17e3c8dfcf68 service nova] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Received event network-vif-plugged-fddcd530-d245-4d58-a0ca-59ddc2ac0121 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b1201136-7ce1-495b-9bf7-fc5041d15ba1 req-a5d8da35-ebd5-4410-b94c-17e3c8dfcf68 service nova] Acquiring lock "691bf2a3-13b2-466c-90a3-8dd01dfc18cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b1201136-7ce1-495b-9bf7-fc5041d15ba1 req-a5d8da35-ebd5-4410-b94c-17e3c8dfcf68 service nova] Lock "691bf2a3-13b2-466c-90a3-8dd01dfc18cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b1201136-7ce1-495b-9bf7-fc5041d15ba1 req-a5d8da35-ebd5-4410-b94c-17e3c8dfcf68 service nova] Lock "691bf2a3-13b2-466c-90a3-8dd01dfc18cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.compute.manager [req-b1201136-7ce1-495b-9bf7-fc5041d15ba1 req-a5d8da35-ebd5-4410-b94c-17e3c8dfcf68 service nova] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] No waiting events found dispatching network-vif-plugged-fddcd530-d245-4d58-a0ca-59ddc2ac0121 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:57:47 user nova-compute[75014]: WARNING nova.compute.manager [req-b1201136-7ce1-495b-9bf7-fc5041d15ba1 req-a5d8da35-ebd5-4410-b94c-17e3c8dfcf68 service nova] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Received unexpected event network-vif-plugged-fddcd530-d245-4d58-a0ca-59ddc2ac0121 for instance with vm_state active and task_state None.
Nov 08 03:57:47 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:57:47 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:57:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-729698497',display_name='tempest-VolumesActionsTest-instance-729698497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-729698497',id=18,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a77d1e7a3adc430ab1a17b1c954db9a4',ramdisk_id='',reservation_id='r-atxy6hph',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-158235265',owner_user_name='tempest-VolumesActionsTest-158235265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:57:45Z,user_data=None,user_id='2952d351dfab46f2bd6caa61d6d59540',uuid=e9b9615d-29bf-4a71-adac-180eb1bb8727,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51fdb271-ca03-4148-9d9c-a05c8412aaaa", "address": "fa:16:3e:9c:a3:b7", "network": {"id": "8ee4c37f-4f4b-4886-9824-d394b2d3d49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-754640303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77d1e7a3adc430ab1a17b1c954db9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fdb271-ca", "ovs_interfaceid": "51fdb271-ca03-4148-9d9c-a05c8412aaaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Converting VIF {"id": "51fdb271-ca03-4148-9d9c-a05c8412aaaa", "address": "fa:16:3e:9c:a3:b7", "network": {"id": "8ee4c37f-4f4b-4886-9824-d394b2d3d49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-754640303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77d1e7a3adc430ab1a17b1c954db9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fdb271-ca", "ovs_interfaceid": "51fdb271-ca03-4148-9d9c-a05c8412aaaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:a3:b7,bridge_name='br-int',has_traffic_filtering=True,id=51fdb271-ca03-4148-9d9c-a05c8412aaaa,network=Network(8ee4c37f-4f4b-4886-9824-d394b2d3d49d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51fdb271-ca') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.objects.instance [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lazy-loading 'pci_devices' on Instance uuid e9b9615d-29bf-4a71-adac-180eb1bb8727 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] End _get_guest_xml xml=<domain type="kvm">
Nov 08 03:57:47 user nova-compute[75014]:   <uuid>e9b9615d-29bf-4a71-adac-180eb1bb8727</uuid>
Nov 08 03:57:47 user nova-compute[75014]:   <name>instance-00000012</name>
Nov 08 03:57:47 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 03:57:47 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 03:57:47 user nova-compute[75014]:   <metadata>
Nov 08 03:57:47 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 03:57:47 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 03:57:47 user nova-compute[75014]:       <nova:name>tempest-VolumesActionsTest-instance-729698497</nova:name>
Nov 08 03:57:47 user nova-compute[75014]:       <nova:creationTime>2023-11-08 03:57:47</nova:creationTime>
Nov 08 03:57:47 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 03:57:47 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 03:57:47 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 03:57:47 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 03:57:47 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 03:57:47 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 03:57:47 user nova-compute[75014]:       </nova:flavor>
Nov 08 03:57:47 user nova-compute[75014]:       <nova:owner>
Nov 08 03:57:47 user nova-compute[75014]:         <nova:user uuid="2952d351dfab46f2bd6caa61d6d59540">tempest-VolumesActionsTest-158235265-project-member</nova:user>
Nov 08 03:57:47 user nova-compute[75014]:         <nova:project uuid="a77d1e7a3adc430ab1a17b1c954db9a4">tempest-VolumesActionsTest-158235265</nova:project>
Nov 08 03:57:47 user nova-compute[75014]:       </nova:owner>
Nov 08 03:57:47 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 03:57:47 user nova-compute[75014]:       <nova:ports>
Nov 08 03:57:47 user nova-compute[75014]:         <nova:port uuid="51fdb271-ca03-4148-9d9c-a05c8412aaaa">
Nov 08 03:57:47 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 03:57:47 user nova-compute[75014]:         </nova:port>
Nov 08 03:57:47 user nova-compute[75014]:       </nova:ports>
Nov 08 03:57:47 user nova-compute[75014]:     </nova:instance>
Nov 08 03:57:47 user nova-compute[75014]:   </metadata>
Nov 08 03:57:47 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 03:57:47 user nova-compute[75014]:     <system>
Nov 08 03:57:47 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 03:57:47 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 03:57:47 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 03:57:47 user nova-compute[75014]:       <entry name="serial">e9b9615d-29bf-4a71-adac-180eb1bb8727</entry>
Nov 08 03:57:47 user nova-compute[75014]:       <entry name="uuid">e9b9615d-29bf-4a71-adac-180eb1bb8727</entry>
Nov 08 03:57:47 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 03:57:47 user nova-compute[75014]:     </system>
Nov 08 03:57:47 user nova-compute[75014]:   </sysinfo>
Nov 08 03:57:47 user nova-compute[75014]:   <os>
Nov 08 03:57:47 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 03:57:47 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 03:57:47 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 03:57:47 user nova-compute[75014]:   </os>
Nov 08 03:57:47 user nova-compute[75014]:   <features>
Nov 08 03:57:47 user nova-compute[75014]:     <acpi/>
Nov 08 03:57:47 user nova-compute[75014]:     <apic/>
Nov 08 03:57:47 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 03:57:47 user nova-compute[75014]:   </features>
Nov 08 03:57:47 user nova-compute[75014]:   <clock offset="utc">
Nov 08 03:57:47 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 03:57:47 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 03:57:47 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 03:57:47 user nova-compute[75014]:   </clock>
Nov 08 03:57:47 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 03:57:47 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 03:57:47 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 03:57:47 user nova-compute[75014]:   </cpu>
Nov 08 03:57:47 user nova-compute[75014]:   <devices>
Nov 08 03:57:47 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 03:57:47 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 03:57:47 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/e9b9615d-29bf-4a71-adac-180eb1bb8727/disk"/>
Nov 08 03:57:47 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 03:57:47 user nova-compute[75014]:     </disk>
Nov 08 03:57:47 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:57:47 user nova-compute[75014]:       <mac address="fa:16:3e:9c:a3:b7"/>
Nov 08 03:57:47 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:57:47 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:57:47 user nova-compute[75014]:       <target dev="tap51fdb271-ca"/>
Nov 08 03:57:47 user nova-compute[75014]:     </interface>
Nov 08 03:57:47 user nova-compute[75014]:     <serial type="pty">
Nov 08 03:57:47 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/e9b9615d-29bf-4a71-adac-180eb1bb8727/console.log" append="off"/>
Nov 08 03:57:47 user nova-compute[75014]:     </serial>
Nov 08 03:57:47 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 03:57:47 user nova-compute[75014]:     <video>
Nov 08 03:57:47 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:57:47 user nova-compute[75014]:     </video>
Nov 08 03:57:47 user nova-compute[75014]:     <rng model="virtio">
Nov 08 03:57:47 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 03:57:47 user nova-compute[75014]:     </rng>
Nov 08 03:57:47 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 03:57:47 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 03:57:47 user nova-compute[75014]:       <stats period="10"/>
Nov 08 03:57:47 user nova-compute[75014]:     </memballoon>
Nov 08 03:57:47 user nova-compute[75014]:   </devices>
Nov 08 03:57:47 user nova-compute[75014]: </domain>
Nov 08 03:57:47 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:57:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-729698497',display_name='tempest-VolumesActionsTest-instance-729698497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-729698497',id=18,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a77d1e7a3adc430ab1a17b1c954db9a4',ramdisk_id='',reservation_id='r-atxy6hph',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-158235265',owner_user_name='tempest-VolumesActionsTest-158235265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:57:45Z,user_data=None,user_id='2952d351dfab46f2bd6caa61d6d59540',uuid=e9b9615d-29bf-4a71-adac-180eb1bb8727,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51fdb271-ca03-4148-9d9c-a05c8412aaaa", "address": "fa:16:3e:9c:a3:b7", "network": {"id": "8ee4c37f-4f4b-4886-9824-d394b2d3d49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-754640303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77d1e7a3adc430ab1a17b1c954db9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fdb271-ca", "ovs_interfaceid": "51fdb271-ca03-4148-9d9c-a05c8412aaaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Converting VIF {"id": "51fdb271-ca03-4148-9d9c-a05c8412aaaa", "address": "fa:16:3e:9c:a3:b7", "network": {"id": "8ee4c37f-4f4b-4886-9824-d394b2d3d49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-754640303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77d1e7a3adc430ab1a17b1c954db9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fdb271-ca", "ovs_interfaceid": "51fdb271-ca03-4148-9d9c-a05c8412aaaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:a3:b7,bridge_name='br-int',has_traffic_filtering=True,id=51fdb271-ca03-4148-9d9c-a05c8412aaaa,network=Network(8ee4c37f-4f4b-4886-9824-d394b2d3d49d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51fdb271-ca') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG os_vif [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:a3:b7,bridge_name='br-int',has_traffic_filtering=True,id=51fdb271-ca03-4148-9d9c-a05c8412aaaa,network=Network(8ee4c37f-4f4b-4886-9824-d394b2d3d49d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51fdb271-ca') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55e781b8-2b08-55d5-bf76-d7fd806d1012', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51fdb271-ca, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51fdb271-ca, col_values=(('qos', UUID('f0c68415-2d5e-4a14-80aa-9fd4d0ebd0b1')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51fdb271-ca, col_values=(('external_ids', {'iface-id': '51fdb271-ca03-4148-9d9c-a05c8412aaaa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:a3:b7', 'vm-uuid': 'e9b9615d-29bf-4a71-adac-180eb1bb8727'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:57:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:47 user nova-compute[75014]: INFO os_vif [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:a3:b7,bridge_name='br-int',has_traffic_filtering=True,id=51fdb271-ca03-4148-9d9c-a05c8412aaaa,network=Network(8ee4c37f-4f4b-4886-9824-d394b2d3d49d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51fdb271-ca')
Nov 08 03:57:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:57:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] No VIF found with MAC fa:16:3e:9c:a3:b7, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:57:48 user nova-compute[75014]: DEBUG nova.network.neutron [req-f05ec010-0133-409f-ba2b-bc93d90e529a req-38c63535-f97b-427e-97fb-43ebe302e2e7 service nova] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Updated VIF entry in instance network info cache for port 51fdb271-ca03-4148-9d9c-a05c8412aaaa. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:57:48 user nova-compute[75014]: DEBUG nova.network.neutron [req-f05ec010-0133-409f-ba2b-bc93d90e529a req-38c63535-f97b-427e-97fb-43ebe302e2e7 service nova] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Updating instance_info_cache with network_info: [{"id": "51fdb271-ca03-4148-9d9c-a05c8412aaaa", "address": "fa:16:3e:9c:a3:b7", "network": {"id": "8ee4c37f-4f4b-4886-9824-d394b2d3d49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-754640303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77d1e7a3adc430ab1a17b1c954db9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fdb271-ca", "ovs_interfaceid": "51fdb271-ca03-4148-9d9c-a05c8412aaaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:57:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f05ec010-0133-409f-ba2b-bc93d90e529a req-38c63535-f97b-427e-97fb-43ebe302e2e7 service nova] Releasing lock "refresh_cache-e9b9615d-29bf-4a71-adac-180eb1bb8727" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:57:48 user nova-compute[75014]: DEBUG nova.compute.manager [req-df23816f-02e7-46cd-8b99-48d28e6ed15a req-e0b727a1-e16d-4fd5-bb5f-ac4926cb48a6 service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Received event network-changed-c45eca82-c80d-4ee4-87d6-dc301fd5f760 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:57:48 user nova-compute[75014]: DEBUG nova.compute.manager [req-df23816f-02e7-46cd-8b99-48d28e6ed15a req-e0b727a1-e16d-4fd5-bb5f-ac4926cb48a6 service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Refreshing instance network info cache due to event network-changed-c45eca82-c80d-4ee4-87d6-dc301fd5f760. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:57:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-df23816f-02e7-46cd-8b99-48d28e6ed15a req-e0b727a1-e16d-4fd5-bb5f-ac4926cb48a6 service nova] Acquiring lock "refresh_cache-af246bb7-2e77-469b-bf98-cf05b467255c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:57:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-df23816f-02e7-46cd-8b99-48d28e6ed15a req-e0b727a1-e16d-4fd5-bb5f-ac4926cb48a6 service nova] Acquired lock "refresh_cache-af246bb7-2e77-469b-bf98-cf05b467255c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:57:48 user nova-compute[75014]: DEBUG nova.network.neutron [req-df23816f-02e7-46cd-8b99-48d28e6ed15a req-e0b727a1-e16d-4fd5-bb5f-ac4926cb48a6 service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Refreshing network info cache for port c45eca82-c80d-4ee4-87d6-dc301fd5f760 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:57:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:48 user nova-compute[75014]: DEBUG nova.compute.manager [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 03:57:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:48 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 03:57:48 user nova-compute[75014]: INFO nova.compute.claims [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Claim successful on node user
Nov 08 03:57:49 user nova-compute[75014]: DEBUG nova.network.neutron [req-df23816f-02e7-46cd-8b99-48d28e6ed15a req-e0b727a1-e16d-4fd5-bb5f-ac4926cb48a6 service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Updated VIF entry in instance network info cache for port c45eca82-c80d-4ee4-87d6-dc301fd5f760. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:57:49 user nova-compute[75014]: DEBUG nova.network.neutron [req-df23816f-02e7-46cd-8b99-48d28e6ed15a req-e0b727a1-e16d-4fd5-bb5f-ac4926cb48a6 service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Updating instance_info_cache with network_info: [{"id": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "address": "fa:16:3e:6b:fa:e7", "network": {"id": "0c33822d-76e5-44ba-9e89-86e6a2d3351f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-374514491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed74b4d275e441381458eea9bca5aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc45eca82-c8", "ovs_interfaceid": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:57:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-df23816f-02e7-46cd-8b99-48d28e6ed15a req-e0b727a1-e16d-4fd5-bb5f-ac4926cb48a6 service nova] Releasing lock "refresh_cache-af246bb7-2e77-469b-bf98-cf05b467255c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:57:49 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:57:49 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:57:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.597s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:49 user nova-compute[75014]: DEBUG nova.compute.manager [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 03:57:49 user nova-compute[75014]: DEBUG nova.compute.manager [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 03:57:49 user nova-compute[75014]: DEBUG nova.network.neutron [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 03:57:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:49 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 03:57:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:49 user nova-compute[75014]: DEBUG nova.compute.manager [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 03:57:49 user nova-compute[75014]: DEBUG nova.policy [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74a49a9155064771bd4e8a179f9111ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d70b55f2bb42e5b7123acfcd621b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 03:57:49 user nova-compute[75014]: DEBUG nova.compute.manager [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 03:57:49 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 03:57:49 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Creating image(s)
Nov 08 03:57:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "/opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "/opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "/opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:50 user nova-compute[75014]: INFO nova.compute.manager [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Rebuilding instance
Nov 08 03:57:50 user nova-compute[75014]: DEBUG nova.compute.manager [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:57:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.282s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.213s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk 1073741824" returned: 0 in 0.064s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:50 user nova-compute[75014]: DEBUG nova.compute.manager [req-8e833fc4-b12d-442f-85d4-1b7b556b90b1 req-36571326-6471-4002-b4b5-0e5633521f51 service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Received event network-vif-unplugged-c45eca82-c80d-4ee4-87d6-dc301fd5f760 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:57:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8e833fc4-b12d-442f-85d4-1b7b556b90b1 req-36571326-6471-4002-b4b5-0e5633521f51 service nova] Acquiring lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8e833fc4-b12d-442f-85d4-1b7b556b90b1 req-36571326-6471-4002-b4b5-0e5633521f51 service nova] Lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8e833fc4-b12d-442f-85d4-1b7b556b90b1 req-36571326-6471-4002-b4b5-0e5633521f51 service nova] Lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:50 user nova-compute[75014]: DEBUG nova.compute.manager [req-8e833fc4-b12d-442f-85d4-1b7b556b90b1 req-36571326-6471-4002-b4b5-0e5633521f51 service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] No waiting events found dispatching network-vif-unplugged-c45eca82-c80d-4ee4-87d6-dc301fd5f760 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:57:50 user nova-compute[75014]: WARNING nova.compute.manager [req-8e833fc4-b12d-442f-85d4-1b7b556b90b1 req-36571326-6471-4002-b4b5-0e5633521f51 service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Received unexpected event network-vif-unplugged-c45eca82-c80d-4ee4-87d6-dc301fd5f760 for instance with vm_state active and task_state rebuilding.
Nov 08 03:57:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.252s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:50 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Checking if we can resize image /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 03:57:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:50 user nova-compute[75014]: DEBUG nova.compute.manager [req-887e2a1f-f066-449b-a5d4-a42d0c71a03e req-b8e19f90-8c38-4fa8-afae-26f3bc8a5d10 service nova] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Received event network-vif-plugged-51fdb271-ca03-4148-9d9c-a05c8412aaaa {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:57:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-887e2a1f-f066-449b-a5d4-a42d0c71a03e req-b8e19f90-8c38-4fa8-afae-26f3bc8a5d10 service nova] Acquiring lock "e9b9615d-29bf-4a71-adac-180eb1bb8727-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-887e2a1f-f066-449b-a5d4-a42d0c71a03e req-b8e19f90-8c38-4fa8-afae-26f3bc8a5d10 service nova] Lock "e9b9615d-29bf-4a71-adac-180eb1bb8727-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-887e2a1f-f066-449b-a5d4-a42d0c71a03e req-b8e19f90-8c38-4fa8-afae-26f3bc8a5d10 service nova] Lock "e9b9615d-29bf-4a71-adac-180eb1bb8727-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:50 user nova-compute[75014]: DEBUG nova.compute.manager [req-887e2a1f-f066-449b-a5d4-a42d0c71a03e req-b8e19f90-8c38-4fa8-afae-26f3bc8a5d10 service nova] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] No waiting events found dispatching network-vif-plugged-51fdb271-ca03-4148-9d9c-a05c8412aaaa {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:57:50 user nova-compute[75014]: WARNING nova.compute.manager [req-887e2a1f-f066-449b-a5d4-a42d0c71a03e req-b8e19f90-8c38-4fa8-afae-26f3bc8a5d10 service nova] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Received unexpected event network-vif-plugged-51fdb271-ca03-4148-9d9c-a05c8412aaaa for instance with vm_state building and task_state spawning.
Nov 08 03:57:50 user nova-compute[75014]: DEBUG nova.compute.manager [req-887e2a1f-f066-449b-a5d4-a42d0c71a03e req-b8e19f90-8c38-4fa8-afae-26f3bc8a5d10 service nova] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Received event network-vif-plugged-51fdb271-ca03-4148-9d9c-a05c8412aaaa {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:57:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-887e2a1f-f066-449b-a5d4-a42d0c71a03e req-b8e19f90-8c38-4fa8-afae-26f3bc8a5d10 service nova] Acquiring lock "e9b9615d-29bf-4a71-adac-180eb1bb8727-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-887e2a1f-f066-449b-a5d4-a42d0c71a03e req-b8e19f90-8c38-4fa8-afae-26f3bc8a5d10 service nova] Lock "e9b9615d-29bf-4a71-adac-180eb1bb8727-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-887e2a1f-f066-449b-a5d4-a42d0c71a03e req-b8e19f90-8c38-4fa8-afae-26f3bc8a5d10 service nova] Lock "e9b9615d-29bf-4a71-adac-180eb1bb8727-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:50 user nova-compute[75014]: DEBUG nova.compute.manager [req-887e2a1f-f066-449b-a5d4-a42d0c71a03e req-b8e19f90-8c38-4fa8-afae-26f3bc8a5d10 service nova] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] No waiting events found dispatching network-vif-plugged-51fdb271-ca03-4148-9d9c-a05c8412aaaa {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:57:50 user nova-compute[75014]: WARNING nova.compute.manager [req-887e2a1f-f066-449b-a5d4-a42d0c71a03e req-b8e19f90-8c38-4fa8-afae-26f3bc8a5d10 service nova] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Received unexpected event network-vif-plugged-51fdb271-ca03-4148-9d9c-a05c8412aaaa for instance with vm_state building and task_state spawning.
Nov 08 03:57:51 user nova-compute[75014]: DEBUG nova.network.neutron [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Successfully created port: 0ce8dc6f-2116-4163-8c05-2e3519724ee7 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Cannot resize image /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Ensure instance console log exists: /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:51 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Instance destroyed successfully.
Nov 08 03:57:51 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Instance destroyed successfully.
Nov 08 03:57:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:55:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1850919150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-941373465',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrsfdqP450Mbe8oVvdxb3uthC9zeL79XB+4YPPNFemSr8TxtZzWeH1eQHKOVvjEq1C1cLLx7kTdx1hGypUPYqlTsW5kFewd1FNQnedwAOlojPwTmEoLNga9SonIAuwsxw==',key_name='tempest-keypair-1582548590',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:56:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2ed74b4d275e441381458eea9bca5aea',ramdisk_id='',reservation_id='r-hv42b2u3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-344745944',owner_user_name='tempest-ServerActionsV293TestJSON-344745944-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64abc045db314ba0bfd6031a127932f8',uuid=af246bb7-2e77-469b-bf98-cf05b467255c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "address": "fa:16:3e:6b:fa:e7", "network": {"id": "0c33822d-76e5-44ba-9e89-86e6a2d3351f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-374514491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed74b4d275e441381458eea9bca5aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc45eca82-c8", "ovs_interfaceid": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Converting VIF {"id": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "address": "fa:16:3e:6b:fa:e7", "network": {"id": "0c33822d-76e5-44ba-9e89-86e6a2d3351f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-374514491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed74b4d275e441381458eea9bca5aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc45eca82-c8", "ovs_interfaceid": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:fa:e7,bridge_name='br-int',has_traffic_filtering=True,id=c45eca82-c80d-4ee4-87d6-dc301fd5f760,network=Network(0c33822d-76e5-44ba-9e89-86e6a2d3351f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc45eca82-c8') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG os_vif [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:fa:e7,bridge_name='br-int',has_traffic_filtering=True,id=c45eca82-c80d-4ee4-87d6-dc301fd5f760,network=Network(0c33822d-76e5-44ba-9e89-86e6a2d3351f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc45eca82-c8') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc45eca82-c8, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=34a80c06-e899-4f2b-a340-7bb8d1dd01c6) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:51 user nova-compute[75014]: INFO os_vif [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:fa:e7,bridge_name='br-int',has_traffic_filtering=True,id=c45eca82-c80d-4ee4-87d6-dc301fd5f760,network=Network(0c33822d-76e5-44ba-9e89-86e6a2d3351f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc45eca82-c8')
Nov 08 03:57:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbRyqWXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:57:51 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 03:57:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfac1314-3c66-418f-ae9c-3a661ddb4f85]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 03:57:51 user nova-compute[75014]: No targets found.
Nov 08 03:57:51 user nova-compute[75014]: iSNS:
Nov 08 03:57:51 user nova-compute[75014]: No targets found.
Nov 08 03:57:51 user nova-compute[75014]: STATIC:
Nov 08 03:57:51 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec
Nov 08 03:57:51 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:57:51 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:57:51 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 03:57:51 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:57:51 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:57:51 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012
Nov 08 03:57:51 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:57:51 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:57:51 user nova-compute[75014]: FIRMWARE:
Nov 08 03:57:51 user nova-compute[75014]: No targets found.
Nov 08 03:57:51 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 03:57:51 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 03:57:51 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fd8f82-ba73-4124-af9a-ea30ab4b91b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7cfe11-801c-4ce7-96bd-2dc523401aa2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 03:57:51 user nova-compute[75014]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 (non-flash)
Nov 08 03:57:51 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:57:51 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 03:57:51 user nova-compute[75014]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 (non-flash)
Nov 08 03:57:51 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:57:51 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f04001fe0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012'): ({'sdb'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Removing single pathed devices sdb {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ac0f89-e6a3-46e2-9fa0-5d171bf1d5da]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.044s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29fc0c5-642b-4ed8-b425-f29a7624e823]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Flushing IO for device /dev/sdb {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.029s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d477b58d-abd7-405f-8258-e7d9eed8ed7b]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.085s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4057bcfc-7eeb-4ebd-b12f-4cc58f307c55]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] SCSI volumes sdb have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_abf2301e', '/dev/disk/by-id/scsi-1SCST_BIOabf2301e-f65bdaa0a7f2c5ea', '/dev/disk/by-id/scsi-26636356264616130') {{(pid=86544) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[62dfc5c0-e8e0-4fae-8ed4-acdf746c60fb]: (4, None) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.046s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5cbe59-e1b2-4f85-bf74-77a86ac3d4b7]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecc98f0-d6c0-40ec-b365-2aa03c5e34c9]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012, portal: 172.16.0.220,3260]
Nov 08 03:57:51 user nova-compute[75014]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012, portal: 172.16.0.220,3260] successful.
Nov 08 03:57:51 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4513aa91-6828-42b9-a261-75233c26e063]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.530s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] <== disconnect_volume: return (533ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:57:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 03:57:51 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Deleting instance files /opt/stack/data/nova/instances/af246bb7-2e77-469b-bf98-cf05b467255c_del
Nov 08 03:57:51 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Deletion of /opt/stack/data/nova/instances/af246bb7-2e77-469b-bf98-cf05b467255c_del complete
Nov 08 03:57:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:52 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance af246bb7-2e77-469b-bf98-cf05b467255c could not be found.
Nov 08 03:57:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbRyqWXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:57:52 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 03:57:52 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d0ed18-233f-4cb1-91ea-6791e6c47991]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 03:57:52 user nova-compute[75014]: No targets found.
Nov 08 03:57:52 user nova-compute[75014]: iSNS:
Nov 08 03:57:52 user nova-compute[75014]: No targets found.
Nov 08 03:57:52 user nova-compute[75014]: STATIC:
Nov 08 03:57:52 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec
Nov 08 03:57:52 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:57:52 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:57:52 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 03:57:52 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 03:57:52 user nova-compute[75014]:                 Iface Name: default
Nov 08 03:57:52 user nova-compute[75014]: FIRMWARE:
Nov 08 03:57:52 user nova-compute[75014]: No targets found.
Nov 08 03:57:52 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 03:57:52 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 03:57:52 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7568db0-988e-452f-992d-00edc9fe976a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[600cc028-d19b-4dc2-82f8-675152f6f629]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 03:57:52 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:57:52 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 03:57:52 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:57:52 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0400785ea0>, {}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Disconnecting from: [] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.090s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] <== disconnect_volume: return (92ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG nova.network.neutron [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Successfully updated port: 0ce8dc6f-2116-4163-8c05-2e3519724ee7 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "refresh_cache-79dea88d-f5cd-4e8b-a98b-01af128f35ed" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquired lock "refresh_cache-79dea88d-f5cd-4e8b-a98b-01af128f35ed" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG nova.network.neutron [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG nova.network.neutron [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG nova.compute.manager [req-95ca313e-8599-4f12-b3df-ae66b3a183ed req-9cb953b0-15b1-4a5d-a826-335335ac1510 service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Received event network-vif-plugged-c45eca82-c80d-4ee4-87d6-dc301fd5f760 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-95ca313e-8599-4f12-b3df-ae66b3a183ed req-9cb953b0-15b1-4a5d-a826-335335ac1510 service nova] Acquiring lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-95ca313e-8599-4f12-b3df-ae66b3a183ed req-9cb953b0-15b1-4a5d-a826-335335ac1510 service nova] Lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-95ca313e-8599-4f12-b3df-ae66b3a183ed req-9cb953b0-15b1-4a5d-a826-335335ac1510 service nova] Lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG nova.compute.manager [req-95ca313e-8599-4f12-b3df-ae66b3a183ed req-9cb953b0-15b1-4a5d-a826-335335ac1510 service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] No waiting events found dispatching network-vif-plugged-c45eca82-c80d-4ee4-87d6-dc301fd5f760 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:57:52 user nova-compute[75014]: WARNING nova.compute.manager [req-95ca313e-8599-4f12-b3df-ae66b3a183ed req-9cb953b0-15b1-4a5d-a826-335335ac1510 service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Received unexpected event network-vif-plugged-c45eca82-c80d-4ee4-87d6-dc301fd5f760 for instance with vm_state active and task_state rebuilding.
Nov 08 03:57:52 user nova-compute[75014]: DEBUG nova.compute.manager [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 03:57:52 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Instance spawned successfully.
Nov 08 03:57:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG nova.compute.manager [req-d417ddeb-d249-4e6e-8bb5-84972d89802d req-1f12dca4-7a69-4c1c-875c-da6cf0093898 service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Received event network-changed-0ce8dc6f-2116-4163-8c05-2e3519724ee7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG nova.compute.manager [req-d417ddeb-d249-4e6e-8bb5-84972d89802d req-1f12dca4-7a69-4c1c-875c-da6cf0093898 service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Refreshing instance network info cache due to event network-changed-0ce8dc6f-2116-4163-8c05-2e3519724ee7. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d417ddeb-d249-4e6e-8bb5-84972d89802d req-1f12dca4-7a69-4c1c-875c-da6cf0093898 service nova] Acquiring lock "refresh_cache-79dea88d-f5cd-4e8b-a98b-01af128f35ed" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG nova.network.neutron [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Updating instance_info_cache with network_info: [{"id": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "address": "fa:16:3e:e4:5b:42", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce8dc6f-21", "ovs_interfaceid": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Releasing lock "refresh_cache-79dea88d-f5cd-4e8b-a98b-01af128f35ed" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG nova.compute.manager [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Instance network_info: |[{"id": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "address": "fa:16:3e:e4:5b:42", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce8dc6f-21", "ovs_interfaceid": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d417ddeb-d249-4e6e-8bb5-84972d89802d req-1f12dca4-7a69-4c1c-875c-da6cf0093898 service nova] Acquired lock "refresh_cache-79dea88d-f5cd-4e8b-a98b-01af128f35ed" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG nova.network.neutron [req-d417ddeb-d249-4e6e-8bb5-84972d89802d req-1f12dca4-7a69-4c1c-875c-da6cf0093898 service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Refreshing network info cache for port 0ce8dc6f-2116-4163-8c05-2e3519724ee7 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:57:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Start _get_guest_xml network_info=[{"id": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "address": "fa:16:3e:e4:5b:42", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce8dc6f-21", "ovs_interfaceid": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 03:57:53 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:57:53 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:57:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-126106463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-126106463',id=19,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkERAMQEozvUuRL7w/KH8SVpl6H+WMKEN72SColTSftWtRNhuQPQVVmz8MU8JS5GawhQGgUIpcwXO5XKClq5cpqfubM4gfoZ7MgOUQORMPiTldXsMzDtlaEN/70+UwQWA==',key_name='tempest-keypair-1769201340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1d70b55f2bb42e5b7123acfcd621b2f',ramdisk_id='',reservation_id='r-n2lnrofd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-650261566',owner_user_name='tempest-AttachVolumeShelveTestJSON-650261566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74a49a9155064771bd4e8a179f9111ac',uuid=79dea88d-f5cd-4e8b-a98b-01af128f35ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "address": "fa:16:3e:e4:5b:42", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce8dc6f-21", "ovs_interfaceid": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Converting VIF {"id": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "address": "fa:16:3e:e4:5b:42", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce8dc6f-21", "ovs_interfaceid": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5b:42,bridge_name='br-int',has_traffic_filtering=True,id=0ce8dc6f-2116-4163-8c05-2e3519724ee7,network=Network(6ebf42ac-ab65-4622-8529-4c508f9d563c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce8dc6f-21') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG nova.objects.instance [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lazy-loading 'pci_devices' on Instance uuid 79dea88d-f5cd-4e8b-a98b-01af128f35ed {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:57:53 user nova-compute[75014]: INFO nova.compute.manager [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Took 8.28 seconds to spawn the instance on the hypervisor.
Nov 08 03:57:53 user nova-compute[75014]: DEBUG nova.compute.manager [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] End _get_guest_xml xml=<domain type="kvm">
Nov 08 03:57:53 user nova-compute[75014]:   <uuid>79dea88d-f5cd-4e8b-a98b-01af128f35ed</uuid>
Nov 08 03:57:53 user nova-compute[75014]:   <name>instance-00000013</name>
Nov 08 03:57:53 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 03:57:53 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 03:57:53 user nova-compute[75014]:   <metadata>
Nov 08 03:57:53 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 03:57:53 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 03:57:53 user nova-compute[75014]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-126106463</nova:name>
Nov 08 03:57:53 user nova-compute[75014]:       <nova:creationTime>2023-11-08 03:57:53</nova:creationTime>
Nov 08 03:57:53 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 03:57:53 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 03:57:53 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 03:57:53 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 03:57:53 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 03:57:53 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 03:57:53 user nova-compute[75014]:       </nova:flavor>
Nov 08 03:57:53 user nova-compute[75014]:       <nova:owner>
Nov 08 03:57:53 user nova-compute[75014]:         <nova:user uuid="74a49a9155064771bd4e8a179f9111ac">tempest-AttachVolumeShelveTestJSON-650261566-project-member</nova:user>
Nov 08 03:57:53 user nova-compute[75014]:         <nova:project uuid="a1d70b55f2bb42e5b7123acfcd621b2f">tempest-AttachVolumeShelveTestJSON-650261566</nova:project>
Nov 08 03:57:53 user nova-compute[75014]:       </nova:owner>
Nov 08 03:57:53 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 03:57:53 user nova-compute[75014]:       <nova:ports>
Nov 08 03:57:53 user nova-compute[75014]:         <nova:port uuid="0ce8dc6f-2116-4163-8c05-2e3519724ee7">
Nov 08 03:57:53 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 03:57:53 user nova-compute[75014]:         </nova:port>
Nov 08 03:57:53 user nova-compute[75014]:       </nova:ports>
Nov 08 03:57:53 user nova-compute[75014]:     </nova:instance>
Nov 08 03:57:53 user nova-compute[75014]:   </metadata>
Nov 08 03:57:53 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 03:57:53 user nova-compute[75014]:     <system>
Nov 08 03:57:53 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 03:57:53 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 03:57:53 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 03:57:53 user nova-compute[75014]:       <entry name="serial">79dea88d-f5cd-4e8b-a98b-01af128f35ed</entry>
Nov 08 03:57:53 user nova-compute[75014]:       <entry name="uuid">79dea88d-f5cd-4e8b-a98b-01af128f35ed</entry>
Nov 08 03:57:53 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 03:57:53 user nova-compute[75014]:     </system>
Nov 08 03:57:53 user nova-compute[75014]:   </sysinfo>
Nov 08 03:57:53 user nova-compute[75014]:   <os>
Nov 08 03:57:53 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 03:57:53 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 03:57:53 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 03:57:53 user nova-compute[75014]:   </os>
Nov 08 03:57:53 user nova-compute[75014]:   <features>
Nov 08 03:57:53 user nova-compute[75014]:     <acpi/>
Nov 08 03:57:53 user nova-compute[75014]:     <apic/>
Nov 08 03:57:53 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 03:57:53 user nova-compute[75014]:   </features>
Nov 08 03:57:53 user nova-compute[75014]:   <clock offset="utc">
Nov 08 03:57:53 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 03:57:53 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 03:57:53 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 03:57:53 user nova-compute[75014]:   </clock>
Nov 08 03:57:53 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 03:57:53 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 03:57:53 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 03:57:53 user nova-compute[75014]:   </cpu>
Nov 08 03:57:53 user nova-compute[75014]:   <devices>
Nov 08 03:57:53 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 03:57:53 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 03:57:53 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk"/>
Nov 08 03:57:53 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 03:57:53 user nova-compute[75014]:     </disk>
Nov 08 03:57:53 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:57:53 user nova-compute[75014]:       <mac address="fa:16:3e:e4:5b:42"/>
Nov 08 03:57:53 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:57:53 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:57:53 user nova-compute[75014]:       <target dev="tap0ce8dc6f-21"/>
Nov 08 03:57:53 user nova-compute[75014]:     </interface>
Nov 08 03:57:53 user nova-compute[75014]:     <serial type="pty">
Nov 08 03:57:53 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/console.log" append="off"/>
Nov 08 03:57:53 user nova-compute[75014]:     </serial>
Nov 08 03:57:53 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 03:57:53 user nova-compute[75014]:     <video>
Nov 08 03:57:53 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:57:53 user nova-compute[75014]:     </video>
Nov 08 03:57:53 user nova-compute[75014]:     <rng model="virtio">
Nov 08 03:57:53 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 03:57:53 user nova-compute[75014]:     </rng>
Nov 08 03:57:53 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 03:57:53 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 03:57:53 user nova-compute[75014]:       <stats period="10"/>
Nov 08 03:57:53 user nova-compute[75014]:     </memballoon>
Nov 08 03:57:53 user nova-compute[75014]:   </devices>
Nov 08 03:57:53 user nova-compute[75014]: </domain>
Nov 08 03:57:53 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-126106463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-126106463',id=19,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkERAMQEozvUuRL7w/KH8SVpl6H+WMKEN72SColTSftWtRNhuQPQVVmz8MU8JS5GawhQGgUIpcwXO5XKClq5cpqfubM4gfoZ7MgOUQORMPiTldXsMzDtlaEN/70+UwQWA==',key_name='tempest-keypair-1769201340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1d70b55f2bb42e5b7123acfcd621b2f',ramdisk_id='',reservation_id='r-n2lnrofd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-650261566',owner_user_name='tempest-AttachVolumeShelveTestJSON-650261566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74a49a9155064771bd4e8a179f9111ac',uuid=79dea88d-f5cd-4e8b-a98b-01af128f35ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "address": "fa:16:3e:e4:5b:42", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce8dc6f-21", "ovs_interfaceid": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Converting VIF {"id": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "address": "fa:16:3e:e4:5b:42", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce8dc6f-21", "ovs_interfaceid": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5b:42,bridge_name='br-int',has_traffic_filtering=True,id=0ce8dc6f-2116-4163-8c05-2e3519724ee7,network=Network(6ebf42ac-ab65-4622-8529-4c508f9d563c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce8dc6f-21') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG os_vif [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5b:42,bridge_name='br-int',has_traffic_filtering=True,id=0ce8dc6f-2116-4163-8c05-2e3519724ee7,network=Network(6ebf42ac-ab65-4622-8529-4c508f9d563c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce8dc6f-21') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '42966e1d-34e3-565d-af38-eeaa779a1e22', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ce8dc6f-21, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ce8dc6f-21, col_values=(('qos', UUID('b98cc5b5-95d1-4ace-80ff-570a2b5cbcf8')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ce8dc6f-21, col_values=(('external_ids', {'iface-id': '0ce8dc6f-2116-4163-8c05-2e3519724ee7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:5b:42', 'vm-uuid': '79dea88d-f5cd-4e8b-a98b-01af128f35ed'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:53 user nova-compute[75014]: INFO os_vif [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5b:42,bridge_name='br-int',has_traffic_filtering=True,id=0ce8dc6f-2116-4163-8c05-2e3519724ee7,network=Network(6ebf42ac-ab65-4622-8529-4c508f9d563c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce8dc6f-21')
Nov 08 03:57:53 user nova-compute[75014]: INFO nova.compute.manager [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Took 9.25 seconds to build instance.
Nov 08 03:57:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] No VIF found with MAC fa:16:3e:e4:5b:42, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-01e0215f-ddad-436b-b8e0-4a987facd676 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lock "e9b9615d-29bf-4a71-adac-180eb1bb8727" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.427s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG nova.network.neutron [req-d417ddeb-d249-4e6e-8bb5-84972d89802d req-1f12dca4-7a69-4c1c-875c-da6cf0093898 service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Updated VIF entry in instance network info cache for port 0ce8dc6f-2116-4163-8c05-2e3519724ee7. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG nova.network.neutron [req-d417ddeb-d249-4e6e-8bb5-84972d89802d req-1f12dca4-7a69-4c1c-875c-da6cf0093898 service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Updating instance_info_cache with network_info: [{"id": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "address": "fa:16:3e:e4:5b:42", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce8dc6f-21", "ovs_interfaceid": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG nova.compute.manager [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Preparing to wait for external event volume-reimaged-d3fe5b4d-0559-4f95-b369-6d3cf54dc012 {{(pid=75014) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Acquiring lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d417ddeb-d249-4e6e-8bb5-84972d89802d req-1f12dca4-7a69-4c1c-875c-da6cf0093898 service nova] Releasing lock "refresh_cache-79dea88d-f5cd-4e8b-a98b-01af128f35ed" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:57:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4bc6d17d-46ef-4d9a-8302-be4e3eeb2744 tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Acquiring lock "7dd0e158-473f-4785-a5cf-a75b2da85b29" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4bc6d17d-46ef-4d9a-8302-be4e3eeb2744 tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "7dd0e158-473f-4785-a5cf-a75b2da85b29" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4bc6d17d-46ef-4d9a-8302-be4e3eeb2744 tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Acquiring lock "7dd0e158-473f-4785-a5cf-a75b2da85b29-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4bc6d17d-46ef-4d9a-8302-be4e3eeb2744 tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "7dd0e158-473f-4785-a5cf-a75b2da85b29-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4bc6d17d-46ef-4d9a-8302-be4e3eeb2744 tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "7dd0e158-473f-4785-a5cf-a75b2da85b29-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:54 user nova-compute[75014]: INFO nova.compute.manager [None req-4bc6d17d-46ef-4d9a-8302-be4e3eeb2744 tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Terminating instance
Nov 08 03:57:54 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4bc6d17d-46ef-4d9a-8302-be4e3eeb2744 tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 03:57:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:54 user nova-compute[75014]: DEBUG nova.compute.manager [req-3f5a375c-8ab9-4811-b7bf-f180195df22c req-ef25b5ed-1a31-4810-8174-c45f61573ce7 service nova] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Received event network-vif-unplugged-81345e21-7bc0-451c-950d-30053a7181d3 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:57:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3f5a375c-8ab9-4811-b7bf-f180195df22c req-ef25b5ed-1a31-4810-8174-c45f61573ce7 service nova] Acquiring lock "7dd0e158-473f-4785-a5cf-a75b2da85b29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3f5a375c-8ab9-4811-b7bf-f180195df22c req-ef25b5ed-1a31-4810-8174-c45f61573ce7 service nova] Lock "7dd0e158-473f-4785-a5cf-a75b2da85b29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3f5a375c-8ab9-4811-b7bf-f180195df22c req-ef25b5ed-1a31-4810-8174-c45f61573ce7 service nova] Lock "7dd0e158-473f-4785-a5cf-a75b2da85b29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:54 user nova-compute[75014]: DEBUG nova.compute.manager [req-3f5a375c-8ab9-4811-b7bf-f180195df22c req-ef25b5ed-1a31-4810-8174-c45f61573ce7 service nova] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] No waiting events found dispatching network-vif-unplugged-81345e21-7bc0-451c-950d-30053a7181d3 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:57:54 user nova-compute[75014]: DEBUG nova.compute.manager [req-3f5a375c-8ab9-4811-b7bf-f180195df22c req-ef25b5ed-1a31-4810-8174-c45f61573ce7 service nova] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Received event network-vif-unplugged-81345e21-7bc0-451c-950d-30053a7181d3 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 03:57:54 user nova-compute[75014]: DEBUG nova.compute.manager [req-3f5a375c-8ab9-4811-b7bf-f180195df22c req-ef25b5ed-1a31-4810-8174-c45f61573ce7 service nova] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Received event network-vif-plugged-81345e21-7bc0-451c-950d-30053a7181d3 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:57:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3f5a375c-8ab9-4811-b7bf-f180195df22c req-ef25b5ed-1a31-4810-8174-c45f61573ce7 service nova] Acquiring lock "7dd0e158-473f-4785-a5cf-a75b2da85b29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3f5a375c-8ab9-4811-b7bf-f180195df22c req-ef25b5ed-1a31-4810-8174-c45f61573ce7 service nova] Lock "7dd0e158-473f-4785-a5cf-a75b2da85b29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3f5a375c-8ab9-4811-b7bf-f180195df22c req-ef25b5ed-1a31-4810-8174-c45f61573ce7 service nova] Lock "7dd0e158-473f-4785-a5cf-a75b2da85b29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:54 user nova-compute[75014]: DEBUG nova.compute.manager [req-3f5a375c-8ab9-4811-b7bf-f180195df22c req-ef25b5ed-1a31-4810-8174-c45f61573ce7 service nova] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] No waiting events found dispatching network-vif-plugged-81345e21-7bc0-451c-950d-30053a7181d3 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:57:54 user nova-compute[75014]: WARNING nova.compute.manager [req-3f5a375c-8ab9-4811-b7bf-f180195df22c req-ef25b5ed-1a31-4810-8174-c45f61573ce7 service nova] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Received unexpected event network-vif-plugged-81345e21-7bc0-451c-950d-30053a7181d3 for instance with vm_state active and task_state deleting.
Nov 08 03:57:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:55 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Instance destroyed successfully.
Nov 08 03:57:55 user nova-compute[75014]: DEBUG nova.objects.instance [None req-4bc6d17d-46ef-4d9a-8302-be4e3eeb2744 tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lazy-loading 'resources' on Instance uuid 7dd0e158-473f-4785-a5cf-a75b2da85b29 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:57:55 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-4bc6d17d-46ef-4d9a-8302-be4e3eeb2744 tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:49:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-999650202',display_name='tempest-VolumesAdminNegativeTest-server-999650202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-999650202',id=7,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJV1ozyb0Vn6Slm1TLSDTAU5Jdq+/eo/GjyfNGlKMe5sz3EBsmsPBUrvp8r0DSp1CH0PVuOINaTj9GyMMeHOusYtPI0rUwCq7ikOYveBgFIuIvTYiQSiS3SQXCBxiv2oGw==',key_name='tempest-keypair-1201034514',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:49:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca4e7f2292f74b0a88221144ad5220f5',ramdisk_id='',reservation_id='r-vmen5rpd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-730381045',owner_user_name='tempest-VolumesAdminNegativeTest-730381045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T03:50:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e82b4bdb6a464a06ac0afb07401a0ff1',uuid=7dd0e158-473f-4785-a5cf-a75b2da85b29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81345e21-7bc0-451c-950d-30053a7181d3", "address": "fa:16:3e:66:a0:f5", "network": {"id": "24ff600e-3d1c-49d0-90cf-84e1aa25d978", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1636920770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4e7f2292f74b0a88221144ad5220f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81345e21-7b", "ovs_interfaceid": "81345e21-7bc0-451c-950d-30053a7181d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 03:57:55 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-4bc6d17d-46ef-4d9a-8302-be4e3eeb2744 tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Converting VIF {"id": "81345e21-7bc0-451c-950d-30053a7181d3", "address": "fa:16:3e:66:a0:f5", "network": {"id": "24ff600e-3d1c-49d0-90cf-84e1aa25d978", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1636920770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca4e7f2292f74b0a88221144ad5220f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81345e21-7b", "ovs_interfaceid": "81345e21-7bc0-451c-950d-30053a7181d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:57:55 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-4bc6d17d-46ef-4d9a-8302-be4e3eeb2744 tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:a0:f5,bridge_name='br-int',has_traffic_filtering=True,id=81345e21-7bc0-451c-950d-30053a7181d3,network=Network(24ff600e-3d1c-49d0-90cf-84e1aa25d978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81345e21-7b') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:57:55 user nova-compute[75014]: DEBUG os_vif [None req-4bc6d17d-46ef-4d9a-8302-be4e3eeb2744 tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:a0:f5,bridge_name='br-int',has_traffic_filtering=True,id=81345e21-7bc0-451c-950d-30053a7181d3,network=Network(24ff600e-3d1c-49d0-90cf-84e1aa25d978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81345e21-7b') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 03:57:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81345e21-7b, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:57:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:57:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6c65ed37-e5a0-4958-ac02-b0da5dc2570e) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:57:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:55 user nova-compute[75014]: INFO os_vif [None req-4bc6d17d-46ef-4d9a-8302-be4e3eeb2744 tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:a0:f5,bridge_name='br-int',has_traffic_filtering=True,id=81345e21-7bc0-451c-950d-30053a7181d3,network=Network(24ff600e-3d1c-49d0-90cf-84e1aa25d978),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81345e21-7b')
Nov 08 03:57:55 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-4bc6d17d-46ef-4d9a-8302-be4e3eeb2744 tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Deleting instance files /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29_del
Nov 08 03:57:55 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-4bc6d17d-46ef-4d9a-8302-be4e3eeb2744 tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Deletion of /opt/stack/data/nova/instances/7dd0e158-473f-4785-a5cf-a75b2da85b29_del complete
Nov 08 03:57:55 user nova-compute[75014]: INFO nova.compute.manager [None req-4bc6d17d-46ef-4d9a-8302-be4e3eeb2744 tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 08 03:57:55 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-4bc6d17d-46ef-4d9a-8302-be4e3eeb2744 tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 03:57:55 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 03:57:55 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 03:57:55 user nova-compute[75014]: DEBUG nova.compute.manager [req-46750b8f-b8f4-4c6f-815e-3309512cf21f req-8ed862aa-a84f-407f-9693-d6087c83479c service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Received event network-vif-plugged-0ce8dc6f-2116-4163-8c05-2e3519724ee7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:57:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-46750b8f-b8f4-4c6f-815e-3309512cf21f req-8ed862aa-a84f-407f-9693-d6087c83479c service nova] Acquiring lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-46750b8f-b8f4-4c6f-815e-3309512cf21f req-8ed862aa-a84f-407f-9693-d6087c83479c service nova] Lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-46750b8f-b8f4-4c6f-815e-3309512cf21f req-8ed862aa-a84f-407f-9693-d6087c83479c service nova] Lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:55 user nova-compute[75014]: DEBUG nova.compute.manager [req-46750b8f-b8f4-4c6f-815e-3309512cf21f req-8ed862aa-a84f-407f-9693-d6087c83479c service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] No waiting events found dispatching network-vif-plugged-0ce8dc6f-2116-4163-8c05-2e3519724ee7 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:57:55 user nova-compute[75014]: WARNING nova.compute.manager [req-46750b8f-b8f4-4c6f-815e-3309512cf21f req-8ed862aa-a84f-407f-9693-d6087c83479c service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Received unexpected event network-vif-plugged-0ce8dc6f-2116-4163-8c05-2e3519724ee7 for instance with vm_state building and task_state spawning.
Nov 08 03:57:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:56 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:57:56 user nova-compute[75014]: DEBUG nova.compute.manager [req-b52f8ac7-c62c-499d-8547-3675fc489da0 req-9d7eef70-d8c5-4aed-8847-389e168620d4 service nova] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Received event network-vif-deleted-81345e21-7bc0-451c-950d-30053a7181d3 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:57:56 user nova-compute[75014]: INFO nova.compute.manager [req-b52f8ac7-c62c-499d-8547-3675fc489da0 req-9d7eef70-d8c5-4aed-8847-389e168620d4 service nova] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Neutron deleted interface 81345e21-7bc0-451c-950d-30053a7181d3; detaching it from the instance and deleting it from the info cache
Nov 08 03:57:56 user nova-compute[75014]: DEBUG nova.network.neutron [req-b52f8ac7-c62c-499d-8547-3675fc489da0 req-9d7eef70-d8c5-4aed-8847-389e168620d4 service nova] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:57:56 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Took 0.99 seconds to deallocate network for instance.
Nov 08 03:57:56 user nova-compute[75014]: DEBUG nova.compute.manager [req-b52f8ac7-c62c-499d-8547-3675fc489da0 req-9d7eef70-d8c5-4aed-8847-389e168620d4 service nova] [instance: 7dd0e158-473f-4785-a5cf-a75b2da85b29] Detach interface failed, port_id=81345e21-7bc0-451c-950d-30053a7181d3, reason: Instance 7dd0e158-473f-4785-a5cf-a75b2da85b29 could not be found. {{(pid=75014) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 03:57:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4bc6d17d-46ef-4d9a-8302-be4e3eeb2744 tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4bc6d17d-46ef-4d9a-8302-be4e3eeb2744 tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:56 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4bc6d17d-46ef-4d9a-8302-be4e3eeb2744 tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:57:56 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4bc6d17d-46ef-4d9a-8302-be4e3eeb2744 tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:57:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:57:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4bc6d17d-46ef-4d9a-8302-be4e3eeb2744 tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.535s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:56 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-4bc6d17d-46ef-4d9a-8302-be4e3eeb2744 tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Deleted allocations for instance 7dd0e158-473f-4785-a5cf-a75b2da85b29
Nov 08 03:57:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4bc6d17d-46ef-4d9a-8302-be4e3eeb2744 tempest-VolumesAdminNegativeTest-730381045 tempest-VolumesAdminNegativeTest-730381045-project-member] Lock "7dd0e158-473f-4785-a5cf-a75b2da85b29" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.077s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:57 user nova-compute[75014]: DEBUG nova.compute.manager [req-14217e21-baa0-4aa8-ba50-0583adffca2c req-d4158fff-e527-4f86-9aa9-e357070d8000 service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Received event network-vif-plugged-0ce8dc6f-2116-4163-8c05-2e3519724ee7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:57:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-14217e21-baa0-4aa8-ba50-0583adffca2c req-d4158fff-e527-4f86-9aa9-e357070d8000 service nova] Acquiring lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:57:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-14217e21-baa0-4aa8-ba50-0583adffca2c req-d4158fff-e527-4f86-9aa9-e357070d8000 service nova] Lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:57:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-14217e21-baa0-4aa8-ba50-0583adffca2c req-d4158fff-e527-4f86-9aa9-e357070d8000 service nova] Lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:57:57 user nova-compute[75014]: DEBUG nova.compute.manager [req-14217e21-baa0-4aa8-ba50-0583adffca2c req-d4158fff-e527-4f86-9aa9-e357070d8000 service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] No waiting events found dispatching network-vif-plugged-0ce8dc6f-2116-4163-8c05-2e3519724ee7 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:57:57 user nova-compute[75014]: WARNING nova.compute.manager [req-14217e21-baa0-4aa8-ba50-0583adffca2c req-d4158fff-e527-4f86-9aa9-e357070d8000 service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Received unexpected event network-vif-plugged-0ce8dc6f-2116-4163-8c05-2e3519724ee7 for instance with vm_state building and task_state spawning.
Nov 08 03:57:57 user nova-compute[75014]: DEBUG nova.compute.manager [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 03:57:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 03:57:57 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Instance spawned successfully.
Nov 08 03:57:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 03:57:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:57:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:57:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:57:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:57:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:57:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:57:58 user nova-compute[75014]: INFO nova.compute.manager [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Took 8.17 seconds to spawn the instance on the hypervisor.
Nov 08 03:57:58 user nova-compute[75014]: DEBUG nova.compute.manager [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:57:58 user nova-compute[75014]: INFO nova.compute.manager [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Took 9.30 seconds to build instance.
Nov 08 03:57:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e49d57c6-b85c-49c4-86b2-9e1a049b1048 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.455s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:58:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:20 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:21 user nova-compute[75014]: DEBUG nova.compute.manager [req-23bd6938-dd11-4105-8059-bcb93419f610 req-a7a0ef55-1e6a-4249-9439-a86b9b430273 service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Received event network-changed-2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:58:21 user nova-compute[75014]: DEBUG nova.compute.manager [req-23bd6938-dd11-4105-8059-bcb93419f610 req-a7a0ef55-1e6a-4249-9439-a86b9b430273 service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Refreshing instance network info cache due to event network-changed-2d19a877-95a3-4cc5-b98f-c5a097a01304. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:58:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-23bd6938-dd11-4105-8059-bcb93419f610 req-a7a0ef55-1e6a-4249-9439-a86b9b430273 service nova] Acquiring lock "refresh_cache-bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:58:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-23bd6938-dd11-4105-8059-bcb93419f610 req-a7a0ef55-1e6a-4249-9439-a86b9b430273 service nova] Acquired lock "refresh_cache-bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:58:21 user nova-compute[75014]: DEBUG nova.network.neutron [req-23bd6938-dd11-4105-8059-bcb93419f610 req-a7a0ef55-1e6a-4249-9439-a86b9b430273 service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Refreshing network info cache for port 2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:58:21 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:21 user nova-compute[75014]: DEBUG nova.network.neutron [req-23bd6938-dd11-4105-8059-bcb93419f610 req-a7a0ef55-1e6a-4249-9439-a86b9b430273 service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Updated VIF entry in instance network info cache for port 2d19a877-95a3-4cc5-b98f-c5a097a01304. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:58:21 user nova-compute[75014]: DEBUG nova.network.neutron [req-23bd6938-dd11-4105-8059-bcb93419f610 req-a7a0ef55-1e6a-4249-9439-a86b9b430273 service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Updating instance_info_cache with network_info: [{"id": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "address": "fa:16:3e:d8:7a:3e", "network": {"id": "64afeb98-3d7d-4d85-a8ac-2deff17e7463", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-737690621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05de04b5317b4257b434019a2db27f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d19a877-95", "ovs_interfaceid": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:58:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-23bd6938-dd11-4105-8059-bcb93419f610 req-a7a0ef55-1e6a-4249-9439-a86b9b430273 service nova] Releasing lock "refresh_cache-bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:58:22 user nova-compute[75014]: DEBUG nova.compute.manager [None req-2c8caa71-52a7-4e3d-ae82-8639db40e22e tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:58:22 user nova-compute[75014]: INFO nova.compute.manager [None req-2c8caa71-52a7-4e3d-ae82-8639db40e22e tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] instance snapshotting
Nov 08 03:58:22 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-2c8caa71-52a7-4e3d-ae82-8639db40e22e tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Beginning live snapshot process
Nov 08 03:58:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-2c8caa71-52a7-4e3d-ae82-8639db40e22e tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json -f qcow2 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-2c8caa71-52a7-4e3d-ae82-8639db40e22e tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json -f qcow2" returned: 0 in 0.229s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-2c8caa71-52a7-4e3d-ae82-8639db40e22e tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json -f qcow2 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-2c8caa71-52a7-4e3d-ae82-8639db40e22e tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-2c8caa71-52a7-4e3d-ae82-8639db40e22e tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-2c8caa71-52a7-4e3d-ae82-8639db40e22e tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.168s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-2c8caa71-52a7-4e3d-ae82-8639db40e22e tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpktkcz7pq/8e4cee9324074a1a84ec00afab91c34d.delta 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-2c8caa71-52a7-4e3d-ae82-8639db40e22e tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpktkcz7pq/8e4cee9324074a1a84ec00afab91c34d.delta 1073741824" returned: 0 in 0.051s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:23 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-2c8caa71-52a7-4e3d-ae82-8639db40e22e tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 03:58:24 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-2c8caa71-52a7-4e3d-ae82-8639db40e22e tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75014) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 03:58:24 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-2c8caa71-52a7-4e3d-ae82-8639db40e22e tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75014) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 03:58:24 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-2c8caa71-52a7-4e3d-ae82-8639db40e22e tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 03:58:24 user nova-compute[75014]: DEBUG nova.privsep.utils [None req-2c8caa71-52a7-4e3d-ae82-8639db40e22e tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75014) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 03:58:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-2c8caa71-52a7-4e3d-ae82-8639db40e22e tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpktkcz7pq/8e4cee9324074a1a84ec00afab91c34d.delta /opt/stack/data/nova/instances/snapshots/tmpktkcz7pq/8e4cee9324074a1a84ec00afab91c34d {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-2c8caa71-52a7-4e3d-ae82-8639db40e22e tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpktkcz7pq/8e4cee9324074a1a84ec00afab91c34d.delta /opt/stack/data/nova/instances/snapshots/tmpktkcz7pq/8e4cee9324074a1a84ec00afab91c34d" returned: 0 in 0.329s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:25 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-2c8caa71-52a7-4e3d-ae82-8639db40e22e tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Snapshot extracted, beginning image upload
Nov 08 03:58:26 user nova-compute[75014]: DEBUG nova.compute.manager [req-932f21bc-f659-4fce-9462-6d93597880f3 req-0a9bc12b-2183-4534-925c-0b25be243907 service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Received event volume-reimaged-d3fe5b4d-0559-4f95-b369-6d3cf54dc012 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:58:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-932f21bc-f659-4fce-9462-6d93597880f3 req-0a9bc12b-2183-4534-925c-0b25be243907 service nova] Acquiring lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:58:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-932f21bc-f659-4fce-9462-6d93597880f3 req-0a9bc12b-2183-4534-925c-0b25be243907 service nova] Lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:58:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-932f21bc-f659-4fce-9462-6d93597880f3 req-0a9bc12b-2183-4534-925c-0b25be243907 service nova] Lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:58:26 user nova-compute[75014]: DEBUG nova.compute.manager [req-932f21bc-f659-4fce-9462-6d93597880f3 req-0a9bc12b-2183-4534-925c-0b25be243907 service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Processing event volume-reimaged-d3fe5b4d-0559-4f95-b369-6d3cf54dc012 {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 08 03:58:26 user nova-compute[75014]: DEBUG nova.compute.manager [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Instance event wait completed in 32 seconds for volume-reimaged {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 03:58:26 user nova-compute[75014]: INFO nova.virt.block_device [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Booting with volume d3fe5b4d-0559-4f95-b369-6d3cf54dc012 at /dev/vda
Nov 08 03:58:26 user nova-compute[75014]: DEBUG os_brick.utils [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:58:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccb3aca-a436-4f62-97a1-3807487ec5d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:58:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dd50b3-79b3-4c17-9929-742accc65e51]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:58:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0326da88-f85e-4365-be0f-9eb87f573c75]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:58:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[12adba76-e596-42a8-8033-065ab69c279c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:58:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 03:58:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 03:58:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 03:58:26 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 03:58:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[88709a24-6784-48de-ae56-33756b23f90a]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:58:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 03:58:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 03:58:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 03:58:26 user nova-compute[75014]: DEBUG os_brick.utils [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:58:26 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Updating existing volume attachment record: 14cee88d-bad2-487e-a5d9-556e72768602 {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 03:58:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:27 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-2c8caa71-52a7-4e3d-ae82-8639db40e22e tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Snapshot image upload complete
Nov 08 03:58:27 user nova-compute[75014]: INFO nova.compute.manager [None req-2c8caa71-52a7-4e3d-ae82-8639db40e22e tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Took 5.19 seconds to snapshot the instance on the hypervisor.
Nov 08 03:58:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:38 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:58:38 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:58:38 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 03:58:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-8527ee40-fb8a-469b-9696-d7bde8cc96f7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:58:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-8527ee40-fb8a-469b-9696-d7bde8cc96f7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:58:38 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 03:58:38 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Updating instance_info_cache with network_info: [{"id": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "address": "fa:16:3e:eb:34:b6", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa428a2cb-5b", "ovs_interfaceid": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:58:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-8527ee40-fb8a-469b-9696-d7bde8cc96f7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:58:38 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 03:58:38 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:58:38 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:58:38 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:58:38 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:58:38 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:58:38 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:58:38 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 03:58:38 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:58:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:58:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:58:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:58:38 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 03:58:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 03:58:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b9615d-29bf-4a71-adac-180eb1bb8727/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b9615d-29bf-4a71-adac-180eb1bb8727/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b9615d-29bf-4a71-adac-180eb1bb8727/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b9615d-29bf-4a71-adac-180eb1bb8727/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:42 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:58:42 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:58:42 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=7783MB free_disk=25.14472198486328GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 03:58:42 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:58:42 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:58:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9f205fe5-576f-4ef0-874b-1544c0307a7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:58:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 5bfa6580-e0fe-46b0-b497-8db67806113a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:58:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 8527ee40-fb8a-469b-9696-d7bde8cc96f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:58:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 655fe5eb-1271-4b9f-a5a6-6342bd012a69 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:58:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance af246bb7-2e77-469b-bf98-cf05b467255c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:58:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance bd153f84-98cd-4c6d-a7ab-5759b0b5bf55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:58:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 691bf2a3-13b2-466c-90a3-8dd01dfc18cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:58:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance e9b9615d-29bf-4a71-adac-180eb1bb8727 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:58:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 79dea88d-f5cd-4e8b-a98b-01af128f35ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:58:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 03:58:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 03:58:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:43 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:58:43 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:58:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 03:58:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.562s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:58:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:46 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:58:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:58:48 user nova-compute[75014]: DEBUG nova.compute.manager [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 03:58:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:58:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:58:48 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 03:58:48 user nova-compute[75014]: INFO nova.compute.claims [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Claim successful on node user
Nov 08 03:58:48 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:58:48 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:58:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:58:48 user nova-compute[75014]: DEBUG nova.compute.manager [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 03:58:48 user nova-compute[75014]: DEBUG nova.compute.manager [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 03:58:48 user nova-compute[75014]: DEBUG nova.network.neutron [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 03:58:48 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 03:58:48 user nova-compute[75014]: DEBUG nova.compute.manager [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 03:58:48 user nova-compute[75014]: DEBUG nova.policy [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0c5176957284dca9ea64107eff32727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb879b910c742f6a0fbf17bf0909da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 03:58:48 user nova-compute[75014]: DEBUG nova.compute.manager [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 03:58:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 03:58:48 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Creating image(s)
Nov 08 03:58:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "/opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:58:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "/opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:58:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "/opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:58:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.182s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:58:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:58:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.198s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk 1073741824" returned: 0 in 0.055s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:58:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.176s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:49 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 03:58:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:49 user nova-compute[75014]: DEBUG nova.network.neutron [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Successfully created port: ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 03:58:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:49 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Cannot resize image /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 03:58:49 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 03:58:49 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Ensure instance console log exists: /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 03:58:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:58:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:58:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 03:58:50 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Creating image(s)
Nov 08 03:58:50 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Did not create local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Ensure instance console log exists: /opt/stack/data/nova/instances/af246bb7-2e77-469b-bf98-cf05b467255c/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Start _get_guest_xml network_info=[{"id": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "address": "fa:16:3e:6b:fa:e7", "network": {"id": "0c33822d-76e5-44ba-9e89-86e6a2d3351f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-374514491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed74b4d275e441381458eea9bca5aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc45eca82-c8", "ovs_interfaceid": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbRyqWXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'af246bb7-2e77-469b-bf98-cf05b467255c', 'attached_at': '', 'detached_at': '', 'volume_id': 'd3fe5b4d-0559-4f95-b369-6d3cf54dc012', 'serial': 'd3fe5b4d-0559-4f95-b369-6d3cf54dc012'}, 'device_type': 'disk', 'attachment_id': '14cee88d-bad2-487e-a5d9-556e72768602', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 03:58:50 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 08 03:58:50 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 08 03:58:50 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG nova.objects.instance [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lazy-loading 'vcpu_model' on Instance uuid af246bb7-2e77-469b-bf98-cf05b467255c {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbRyqWXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:58:50 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 03:58:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:58:50 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 03:58:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 03:58:50 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e6c5c6-ee48-4475-bb69-b0c414a34dab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 03:58:50 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4d9310-d043-4401-9f90-f83afdb95d0c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012] added
Nov 08 03:58:50 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[232fc5b9-4117-49bd-b045-4791f13b8f3c]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0e0fa3-9f3c-4261-a967-1b5ee078639f]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FbRyqWXU {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FbRyqWXU" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5f043a-1a93-4230-94e6-a314a4e77ef5]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FbRyqWXU'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG nova.network.neutron [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Successfully updated port: ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5793e0db-b203-447b-b565-84227515f406]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "refresh_cache-9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquired lock "refresh_cache-9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG nova.network.neutron [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5457277-128f-42e1-859d-0e4b50d76df2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 03:58:50 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:58:50 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 03:58:50 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:58:50 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG nova.compute.manager [req-caffbb5d-3789-46b7-bfd6-7e0c0b564b97 req-6dd0e093-90af-46a8-b803-a20c8e2fbae8 service nova] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Received event network-changed-ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG nova.compute.manager [req-caffbb5d-3789-46b7-bfd6-7e0c0b564b97 req-6dd0e093-90af-46a8-b803-a20c8e2fbae8 service nova] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Refreshing instance network info cache due to event network-changed-ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-caffbb5d-3789-46b7-bfd6-7e0c0b564b97 req-6dd0e093-90af-46a8-b803-a20c8e2fbae8 service nova] Acquiring lock "refresh_cache-9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG nova.network.neutron [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d080181-e995-4155-95c0-7a86f82af597]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012, portal: 172.16.0.220,3260]
Nov 08 03:58:50 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012, portal: 172.16.0.220,3260] successful.
Nov 08 03:58:50 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf96f0a2-7fae-496a-aaa4-c1668c787def]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1924c16b-bca9-4e57-80b3-eae6a0f28a33]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 03:58:50 user nova-compute[75014]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 (non-flash)
Nov 08 03:58:50 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:58:50 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 03:58:50 user nova-compute[75014]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 (non-flash)
Nov 08 03:58:50 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 03:58:50 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6ebeb8-65d3-4ea1-bada-f4e20ef9eebe]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 03:58:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbRyqWXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.network.neutron [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Updating instance_info_cache with network_info: [{"id": "ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba", "address": "fa:16:3e:8f:4a:4b", "network": {"id": "6e103f9f-8ed5-4e53-ac4a-85f3151d3e9e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-641600740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deb879b910c742f6a0fbf17bf0909da3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf8cfd7-cb", "ovs_interfaceid": "ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Releasing lock "refresh_cache-9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.compute.manager [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Instance network_info: |[{"id": "ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba", "address": "fa:16:3e:8f:4a:4b", "network": {"id": "6e103f9f-8ed5-4e53-ac4a-85f3151d3e9e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-641600740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deb879b910c742f6a0fbf17bf0909da3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf8cfd7-cb", "ovs_interfaceid": "ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-caffbb5d-3789-46b7-bfd6-7e0c0b564b97 req-6dd0e093-90af-46a8-b803-a20c8e2fbae8 service nova] Acquired lock "refresh_cache-9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.network.neutron [req-caffbb5d-3789-46b7-bfd6-7e0c0b564b97 req-6dd0e093-90af-46a8-b803-a20c8e2fbae8 service nova] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Refreshing network info cache for port ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Start _get_guest_xml network_info=[{"id": "ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba", "address": "fa:16:3e:8f:4a:4b", "network": {"id": "6e103f9f-8ed5-4e53-ac4a-85f3151d3e9e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-641600740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deb879b910c742f6a0fbf17bf0909da3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf8cfd7-cb", "ovs_interfaceid": "ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 03:58:51 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:58:51 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1385109673',display_name='tempest-SnapshotDataIntegrityTests-server-1385109673',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1385109673',id=20,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMsu7UBgeDdEoV7syNqUcHSBFWYDVcdfV5D2jMW+65uaSOH1fGFsoh4b+Gn/VD1CMU/t+nl7+gDGNDCwRyNFAcVU2BjfdlyKV8bwyXd6U9K6sfDyJgT1BDSWYZnV9UFTKQ==',key_name='tempest-keypair-1691743874',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='deb879b910c742f6a0fbf17bf0909da3',ramdisk_id='',reservation_id='r-yqe82qjk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-93737511',owner_user_name='tempest-SnapshotDataIntegrityTests-93737511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:58:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0c5176957284dca9ea64107eff32727',uuid=9b21e940-bc4e-41cd-b999-3bdc04c2aa4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba", "address": "fa:16:3e:8f:4a:4b", "network": {"id": "6e103f9f-8ed5-4e53-ac4a-85f3151d3e9e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-641600740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deb879b910c742f6a0fbf17bf0909da3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf8cfd7-cb", "ovs_interfaceid": "ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Converting VIF {"id": "ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba", "address": "fa:16:3e:8f:4a:4b", "network": {"id": "6e103f9f-8ed5-4e53-ac4a-85f3151d3e9e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-641600740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deb879b910c742f6a0fbf17bf0909da3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf8cfd7-cb", "ovs_interfaceid": "ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4a:4b,bridge_name='br-int',has_traffic_filtering=True,id=ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba,network=Network(6e103f9f-8ed5-4e53-ac4a-85f3151d3e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf8cfd7-cb') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.objects.instance [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] End _get_guest_xml xml=<domain type="kvm">
Nov 08 03:58:51 user nova-compute[75014]:   <uuid>9b21e940-bc4e-41cd-b999-3bdc04c2aa4d</uuid>
Nov 08 03:58:51 user nova-compute[75014]:   <name>instance-00000014</name>
Nov 08 03:58:51 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 03:58:51 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 03:58:51 user nova-compute[75014]:   <metadata>
Nov 08 03:58:51 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 03:58:51 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 03:58:51 user nova-compute[75014]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1385109673</nova:name>
Nov 08 03:58:51 user nova-compute[75014]:       <nova:creationTime>2023-11-08 03:58:51</nova:creationTime>
Nov 08 03:58:51 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 03:58:51 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 03:58:51 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 03:58:51 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 03:58:51 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 03:58:51 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 03:58:51 user nova-compute[75014]:       </nova:flavor>
Nov 08 03:58:51 user nova-compute[75014]:       <nova:owner>
Nov 08 03:58:51 user nova-compute[75014]:         <nova:user uuid="a0c5176957284dca9ea64107eff32727">tempest-SnapshotDataIntegrityTests-93737511-project-member</nova:user>
Nov 08 03:58:51 user nova-compute[75014]:         <nova:project uuid="deb879b910c742f6a0fbf17bf0909da3">tempest-SnapshotDataIntegrityTests-93737511</nova:project>
Nov 08 03:58:51 user nova-compute[75014]:       </nova:owner>
Nov 08 03:58:51 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 03:58:51 user nova-compute[75014]:       <nova:ports>
Nov 08 03:58:51 user nova-compute[75014]:         <nova:port uuid="ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba">
Nov 08 03:58:51 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 03:58:51 user nova-compute[75014]:         </nova:port>
Nov 08 03:58:51 user nova-compute[75014]:       </nova:ports>
Nov 08 03:58:51 user nova-compute[75014]:     </nova:instance>
Nov 08 03:58:51 user nova-compute[75014]:   </metadata>
Nov 08 03:58:51 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 03:58:51 user nova-compute[75014]:     <system>
Nov 08 03:58:51 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 03:58:51 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 03:58:51 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 03:58:51 user nova-compute[75014]:       <entry name="serial">9b21e940-bc4e-41cd-b999-3bdc04c2aa4d</entry>
Nov 08 03:58:51 user nova-compute[75014]:       <entry name="uuid">9b21e940-bc4e-41cd-b999-3bdc04c2aa4d</entry>
Nov 08 03:58:51 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 03:58:51 user nova-compute[75014]:     </system>
Nov 08 03:58:51 user nova-compute[75014]:   </sysinfo>
Nov 08 03:58:51 user nova-compute[75014]:   <os>
Nov 08 03:58:51 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 03:58:51 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 03:58:51 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 03:58:51 user nova-compute[75014]:   </os>
Nov 08 03:58:51 user nova-compute[75014]:   <features>
Nov 08 03:58:51 user nova-compute[75014]:     <acpi/>
Nov 08 03:58:51 user nova-compute[75014]:     <apic/>
Nov 08 03:58:51 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 03:58:51 user nova-compute[75014]:   </features>
Nov 08 03:58:51 user nova-compute[75014]:   <clock offset="utc">
Nov 08 03:58:51 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 03:58:51 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 03:58:51 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 03:58:51 user nova-compute[75014]:   </clock>
Nov 08 03:58:51 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 03:58:51 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 03:58:51 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 03:58:51 user nova-compute[75014]:   </cpu>
Nov 08 03:58:51 user nova-compute[75014]:   <devices>
Nov 08 03:58:51 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 03:58:51 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 03:58:51 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk"/>
Nov 08 03:58:51 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 03:58:51 user nova-compute[75014]:     </disk>
Nov 08 03:58:51 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:58:51 user nova-compute[75014]:       <mac address="fa:16:3e:8f:4a:4b"/>
Nov 08 03:58:51 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:58:51 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:58:51 user nova-compute[75014]:       <target dev="tapddf8cfd7-cb"/>
Nov 08 03:58:51 user nova-compute[75014]:     </interface>
Nov 08 03:58:51 user nova-compute[75014]:     <serial type="pty">
Nov 08 03:58:51 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/console.log" append="off"/>
Nov 08 03:58:51 user nova-compute[75014]:     </serial>
Nov 08 03:58:51 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 03:58:51 user nova-compute[75014]:     <video>
Nov 08 03:58:51 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:58:51 user nova-compute[75014]:     </video>
Nov 08 03:58:51 user nova-compute[75014]:     <rng model="virtio">
Nov 08 03:58:51 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 03:58:51 user nova-compute[75014]:     </rng>
Nov 08 03:58:51 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 03:58:51 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 03:58:51 user nova-compute[75014]:       <stats period="10"/>
Nov 08 03:58:51 user nova-compute[75014]:     </memballoon>
Nov 08 03:58:51 user nova-compute[75014]:   </devices>
Nov 08 03:58:51 user nova-compute[75014]: </domain>
Nov 08 03:58:51 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1385109673',display_name='tempest-SnapshotDataIntegrityTests-server-1385109673',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1385109673',id=20,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMsu7UBgeDdEoV7syNqUcHSBFWYDVcdfV5D2jMW+65uaSOH1fGFsoh4b+Gn/VD1CMU/t+nl7+gDGNDCwRyNFAcVU2BjfdlyKV8bwyXd6U9K6sfDyJgT1BDSWYZnV9UFTKQ==',key_name='tempest-keypair-1691743874',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='deb879b910c742f6a0fbf17bf0909da3',ramdisk_id='',reservation_id='r-yqe82qjk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-93737511',owner_user_name='tempest-SnapshotDataIntegrityTests-93737511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:58:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0c5176957284dca9ea64107eff32727',uuid=9b21e940-bc4e-41cd-b999-3bdc04c2aa4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba", "address": "fa:16:3e:8f:4a:4b", "network": {"id": "6e103f9f-8ed5-4e53-ac4a-85f3151d3e9e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-641600740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deb879b910c742f6a0fbf17bf0909da3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf8cfd7-cb", "ovs_interfaceid": "ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Converting VIF {"id": "ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba", "address": "fa:16:3e:8f:4a:4b", "network": {"id": "6e103f9f-8ed5-4e53-ac4a-85f3151d3e9e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-641600740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deb879b910c742f6a0fbf17bf0909da3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf8cfd7-cb", "ovs_interfaceid": "ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4a:4b,bridge_name='br-int',has_traffic_filtering=True,id=ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba,network=Network(6e103f9f-8ed5-4e53-ac4a-85f3151d3e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf8cfd7-cb') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG os_vif [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4a:4b,bridge_name='br-int',has_traffic_filtering=True,id=ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba,network=Network(6e103f9f-8ed5-4e53-ac4a-85f3151d3e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf8cfd7-cb') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8aac31d0-4fce-5d6c-9e06-52b9b5349872', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapddf8cfd7-cb, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapddf8cfd7-cb, col_values=(('qos', UUID('a7bb1274-d065-4e86-a073-27d79fe18093')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapddf8cfd7-cb, col_values=(('external_ids', {'iface-id': 'ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:4a:4b', 'vm-uuid': '9b21e940-bc4e-41cd-b999-3bdc04c2aa4d'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:51 user nova-compute[75014]: INFO os_vif [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4a:4b,bridge_name='br-int',has_traffic_filtering=True,id=ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba,network=Network(6e103f9f-8ed5-4e53-ac4a-85f3151d3e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf8cfd7-cb')
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] No VIF found with MAC fa:16:3e:8f:4a:4b, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.network.neutron [req-caffbb5d-3789-46b7-bfd6-7e0c0b564b97 req-6dd0e093-90af-46a8-b803-a20c8e2fbae8 service nova] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Updated VIF entry in instance network info cache for port ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.network.neutron [req-caffbb5d-3789-46b7-bfd6-7e0c0b564b97 req-6dd0e093-90af-46a8-b803-a20c8e2fbae8 service nova] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Updating instance_info_cache with network_info: [{"id": "ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba", "address": "fa:16:3e:8f:4a:4b", "network": {"id": "6e103f9f-8ed5-4e53-ac4a-85f3151d3e9e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-641600740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deb879b910c742f6a0fbf17bf0909da3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf8cfd7-cb", "ovs_interfaceid": "ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-caffbb5d-3789-46b7-bfd6-7e0c0b564b97 req-6dd0e093-90af-46a8-b803-a20c8e2fbae8 service nova] Releasing lock "refresh_cache-9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '26636356264616130', 'path': '/dev/sdb'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636356264616130', 'path': '/dev/sdb'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T03:55:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1850919150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-941373465',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrsfdqP450Mbe8oVvdxb3uthC9zeL79XB+4YPPNFemSr8TxtZzWeH1eQHKOVvjEq1C1cLLx7kTdx1hGypUPYqlTsW5kFewd1FNQnedwAOlojPwTmEoLNga9SonIAuwsxw==',key_name='tempest-keypair-1582548590',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:56:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2ed74b4d275e441381458eea9bca5aea',ramdisk_id='',reservation_id='r-hv42b2u3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-344745944',owner_user_name='tempest-ServerActionsV293TestJSON-344745944-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:58:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64abc045db314ba0bfd6031a127932f8',uuid=af246bb7-2e77-469b-bf98-cf05b467255c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "address": "fa:16:3e:6b:fa:e7", "network": {"id": "0c33822d-76e5-44ba-9e89-86e6a2d3351f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-374514491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed74b4d275e441381458eea9bca5aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc45eca82-c8", "ovs_interfaceid": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Converting VIF {"id": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "address": "fa:16:3e:6b:fa:e7", "network": {"id": "0c33822d-76e5-44ba-9e89-86e6a2d3351f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-374514491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed74b4d275e441381458eea9bca5aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc45eca82-c8", "ovs_interfaceid": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:fa:e7,bridge_name='br-int',has_traffic_filtering=True,id=c45eca82-c80d-4ee4-87d6-dc301fd5f760,network=Network(0c33822d-76e5-44ba-9e89-86e6a2d3351f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc45eca82-c8') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] End _get_guest_xml xml=<domain type="kvm">
Nov 08 03:58:51 user nova-compute[75014]:   <uuid>af246bb7-2e77-469b-bf98-cf05b467255c</uuid>
Nov 08 03:58:51 user nova-compute[75014]:   <name>instance-0000000f</name>
Nov 08 03:58:51 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 03:58:51 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 03:58:51 user nova-compute[75014]:   <metadata>
Nov 08 03:58:51 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 03:58:51 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 03:58:51 user nova-compute[75014]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1850919150</nova:name>
Nov 08 03:58:51 user nova-compute[75014]:       <nova:creationTime>2023-11-08 03:58:50</nova:creationTime>
Nov 08 03:58:51 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 03:58:51 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 03:58:51 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 03:58:51 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 03:58:51 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 03:58:51 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 03:58:51 user nova-compute[75014]:       </nova:flavor>
Nov 08 03:58:51 user nova-compute[75014]:       <nova:owner>
Nov 08 03:58:51 user nova-compute[75014]:         <nova:user uuid="64abc045db314ba0bfd6031a127932f8">tempest-ServerActionsV293TestJSON-344745944-project-member</nova:user>
Nov 08 03:58:51 user nova-compute[75014]:         <nova:project uuid="2ed74b4d275e441381458eea9bca5aea">tempest-ServerActionsV293TestJSON-344745944</nova:project>
Nov 08 03:58:51 user nova-compute[75014]:       </nova:owner>
Nov 08 03:58:51 user nova-compute[75014]:       <nova:ports>
Nov 08 03:58:51 user nova-compute[75014]:         <nova:port uuid="c45eca82-c80d-4ee4-87d6-dc301fd5f760">
Nov 08 03:58:51 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 03:58:51 user nova-compute[75014]:         </nova:port>
Nov 08 03:58:51 user nova-compute[75014]:       </nova:ports>
Nov 08 03:58:51 user nova-compute[75014]:     </nova:instance>
Nov 08 03:58:51 user nova-compute[75014]:   </metadata>
Nov 08 03:58:51 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 03:58:51 user nova-compute[75014]:     <system>
Nov 08 03:58:51 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 03:58:51 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 03:58:51 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 03:58:51 user nova-compute[75014]:       <entry name="serial">af246bb7-2e77-469b-bf98-cf05b467255c</entry>
Nov 08 03:58:51 user nova-compute[75014]:       <entry name="uuid">af246bb7-2e77-469b-bf98-cf05b467255c</entry>
Nov 08 03:58:51 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 03:58:51 user nova-compute[75014]:     </system>
Nov 08 03:58:51 user nova-compute[75014]:   </sysinfo>
Nov 08 03:58:51 user nova-compute[75014]:   <os>
Nov 08 03:58:51 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 03:58:51 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 03:58:51 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 03:58:51 user nova-compute[75014]:   </os>
Nov 08 03:58:51 user nova-compute[75014]:   <features>
Nov 08 03:58:51 user nova-compute[75014]:     <acpi/>
Nov 08 03:58:51 user nova-compute[75014]:     <apic/>
Nov 08 03:58:51 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 03:58:51 user nova-compute[75014]:   </features>
Nov 08 03:58:51 user nova-compute[75014]:   <clock offset="utc">
Nov 08 03:58:51 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 03:58:51 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 03:58:51 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 03:58:51 user nova-compute[75014]:   </clock>
Nov 08 03:58:51 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 03:58:51 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 03:58:51 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 03:58:51 user nova-compute[75014]:   </cpu>
Nov 08 03:58:51 user nova-compute[75014]:   <devices>
Nov 08 03:58:51 user nova-compute[75014]:     <disk type="block" device="disk">
Nov 08 03:58:51 user nova-compute[75014]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 03:58:51 user nova-compute[75014]:       <source dev="/dev/sdb"/>
Nov 08 03:58:51 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 03:58:51 user nova-compute[75014]:       <serial>d3fe5b4d-0559-4f95-b369-6d3cf54dc012</serial>
Nov 08 03:58:51 user nova-compute[75014]:     </disk>
Nov 08 03:58:51 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:58:51 user nova-compute[75014]:       <mac address="fa:16:3e:6b:fa:e7"/>
Nov 08 03:58:51 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:58:51 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:58:51 user nova-compute[75014]:       <target dev="tapc45eca82-c8"/>
Nov 08 03:58:51 user nova-compute[75014]:     </interface>
Nov 08 03:58:51 user nova-compute[75014]:     <serial type="pty">
Nov 08 03:58:51 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/af246bb7-2e77-469b-bf98-cf05b467255c/console.log" append="off"/>
Nov 08 03:58:51 user nova-compute[75014]:     </serial>
Nov 08 03:58:51 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 03:58:51 user nova-compute[75014]:     <video>
Nov 08 03:58:51 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:58:51 user nova-compute[75014]:     </video>
Nov 08 03:58:51 user nova-compute[75014]:     <rng model="virtio">
Nov 08 03:58:51 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 03:58:51 user nova-compute[75014]:     </rng>
Nov 08 03:58:51 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 03:58:51 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 03:58:51 user nova-compute[75014]:       <stats period="10"/>
Nov 08 03:58:51 user nova-compute[75014]:     </memballoon>
Nov 08 03:58:51 user nova-compute[75014]:   </devices>
Nov 08 03:58:51 user nova-compute[75014]: </domain>
Nov 08 03:58:51 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T03:55:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1850919150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-941373465',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrsfdqP450Mbe8oVvdxb3uthC9zeL79XB+4YPPNFemSr8TxtZzWeH1eQHKOVvjEq1C1cLLx7kTdx1hGypUPYqlTsW5kFewd1FNQnedwAOlojPwTmEoLNga9SonIAuwsxw==',key_name='tempest-keypair-1582548590',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:56:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2ed74b4d275e441381458eea9bca5aea',ramdisk_id='',reservation_id='r-hv42b2u3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-344745944',owner_user_name='tempest-ServerActionsV293TestJSON-344745944-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:58:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64abc045db314ba0bfd6031a127932f8',uuid=af246bb7-2e77-469b-bf98-cf05b467255c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "address": "fa:16:3e:6b:fa:e7", "network": {"id": "0c33822d-76e5-44ba-9e89-86e6a2d3351f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-374514491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed74b4d275e441381458eea9bca5aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc45eca82-c8", "ovs_interfaceid": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Converting VIF {"id": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "address": "fa:16:3e:6b:fa:e7", "network": {"id": "0c33822d-76e5-44ba-9e89-86e6a2d3351f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-374514491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed74b4d275e441381458eea9bca5aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc45eca82-c8", "ovs_interfaceid": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:fa:e7,bridge_name='br-int',has_traffic_filtering=True,id=c45eca82-c80d-4ee4-87d6-dc301fd5f760,network=Network(0c33822d-76e5-44ba-9e89-86e6a2d3351f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc45eca82-c8') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG os_vif [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:fa:e7,bridge_name='br-int',has_traffic_filtering=True,id=c45eca82-c80d-4ee4-87d6-dc301fd5f760,network=Network(0c33822d-76e5-44ba-9e89-86e6a2d3351f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc45eca82-c8') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0fe54600-3cc7-599b-bcad-b8491e602dfc', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc45eca82-c8, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc45eca82-c8, col_values=(('qos', UUID('6ab77f76-2a5e-43fc-a049-050e5dbf451b')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc45eca82-c8, col_values=(('external_ids', {'iface-id': 'c45eca82-c80d-4ee4-87d6-dc301fd5f760', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:fa:e7', 'vm-uuid': 'af246bb7-2e77-469b-bf98-cf05b467255c'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:58:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:51 user nova-compute[75014]: INFO os_vif [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:fa:e7,bridge_name='br-int',has_traffic_filtering=True,id=c45eca82-c80d-4ee4-87d6-dc301fd5f760,network=Network(0c33822d-76e5-44ba-9e89-86e6a2d3351f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc45eca82-c8')
Nov 08 03:58:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:58:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] No VIF found with MAC fa:16:3e:6b:fa:e7, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:58:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:54 user nova-compute[75014]: DEBUG nova.compute.manager [req-21506765-6e1b-48e7-b31d-e394efe100a1 req-3d6bab58-141f-4f7f-bc12-0af62f5adcaf service nova] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Received event network-vif-plugged-ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:58:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-21506765-6e1b-48e7-b31d-e394efe100a1 req-3d6bab58-141f-4f7f-bc12-0af62f5adcaf service nova] Acquiring lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:58:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-21506765-6e1b-48e7-b31d-e394efe100a1 req-3d6bab58-141f-4f7f-bc12-0af62f5adcaf service nova] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:58:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-21506765-6e1b-48e7-b31d-e394efe100a1 req-3d6bab58-141f-4f7f-bc12-0af62f5adcaf service nova] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:58:54 user nova-compute[75014]: DEBUG nova.compute.manager [req-21506765-6e1b-48e7-b31d-e394efe100a1 req-3d6bab58-141f-4f7f-bc12-0af62f5adcaf service nova] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] No waiting events found dispatching network-vif-plugged-ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:58:54 user nova-compute[75014]: WARNING nova.compute.manager [req-21506765-6e1b-48e7-b31d-e394efe100a1 req-3d6bab58-141f-4f7f-bc12-0af62f5adcaf service nova] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Received unexpected event network-vif-plugged-ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba for instance with vm_state building and task_state spawning.
Nov 08 03:58:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:56 user nova-compute[75014]: DEBUG nova.compute.manager [req-927c2c9a-9d69-4011-8be4-306686b47172 req-2021b113-80fb-4d20-b49f-d252c2a9811f service nova] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Received event network-vif-plugged-ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:58:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-927c2c9a-9d69-4011-8be4-306686b47172 req-2021b113-80fb-4d20-b49f-d252c2a9811f service nova] Acquiring lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:58:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-927c2c9a-9d69-4011-8be4-306686b47172 req-2021b113-80fb-4d20-b49f-d252c2a9811f service nova] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:58:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-927c2c9a-9d69-4011-8be4-306686b47172 req-2021b113-80fb-4d20-b49f-d252c2a9811f service nova] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:58:56 user nova-compute[75014]: DEBUG nova.compute.manager [req-927c2c9a-9d69-4011-8be4-306686b47172 req-2021b113-80fb-4d20-b49f-d252c2a9811f service nova] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] No waiting events found dispatching network-vif-plugged-ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:58:56 user nova-compute[75014]: WARNING nova.compute.manager [req-927c2c9a-9d69-4011-8be4-306686b47172 req-2021b113-80fb-4d20-b49f-d252c2a9811f service nova] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Received unexpected event network-vif-plugged-ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba for instance with vm_state building and task_state spawning.
Nov 08 03:58:56 user nova-compute[75014]: DEBUG nova.compute.manager [req-927c2c9a-9d69-4011-8be4-306686b47172 req-2021b113-80fb-4d20-b49f-d252c2a9811f service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Received event network-vif-plugged-c45eca82-c80d-4ee4-87d6-dc301fd5f760 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:58:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-927c2c9a-9d69-4011-8be4-306686b47172 req-2021b113-80fb-4d20-b49f-d252c2a9811f service nova] Acquiring lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:58:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-927c2c9a-9d69-4011-8be4-306686b47172 req-2021b113-80fb-4d20-b49f-d252c2a9811f service nova] Lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:58:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-927c2c9a-9d69-4011-8be4-306686b47172 req-2021b113-80fb-4d20-b49f-d252c2a9811f service nova] Lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:58:56 user nova-compute[75014]: DEBUG nova.compute.manager [req-927c2c9a-9d69-4011-8be4-306686b47172 req-2021b113-80fb-4d20-b49f-d252c2a9811f service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] No waiting events found dispatching network-vif-plugged-c45eca82-c80d-4ee4-87d6-dc301fd5f760 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:58:56 user nova-compute[75014]: WARNING nova.compute.manager [req-927c2c9a-9d69-4011-8be4-306686b47172 req-2021b113-80fb-4d20-b49f-d252c2a9811f service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Received unexpected event network-vif-plugged-c45eca82-c80d-4ee4-87d6-dc301fd5f760 for instance with vm_state active and task_state rebuild_spawning.
Nov 08 03:58:56 user nova-compute[75014]: DEBUG nova.compute.manager [req-927c2c9a-9d69-4011-8be4-306686b47172 req-2021b113-80fb-4d20-b49f-d252c2a9811f service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Received event network-vif-plugged-c45eca82-c80d-4ee4-87d6-dc301fd5f760 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:58:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-927c2c9a-9d69-4011-8be4-306686b47172 req-2021b113-80fb-4d20-b49f-d252c2a9811f service nova] Acquiring lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:58:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-927c2c9a-9d69-4011-8be4-306686b47172 req-2021b113-80fb-4d20-b49f-d252c2a9811f service nova] Lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:58:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-927c2c9a-9d69-4011-8be4-306686b47172 req-2021b113-80fb-4d20-b49f-d252c2a9811f service nova] Lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:58:56 user nova-compute[75014]: DEBUG nova.compute.manager [req-927c2c9a-9d69-4011-8be4-306686b47172 req-2021b113-80fb-4d20-b49f-d252c2a9811f service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] No waiting events found dispatching network-vif-plugged-c45eca82-c80d-4ee4-87d6-dc301fd5f760 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:58:56 user nova-compute[75014]: WARNING nova.compute.manager [req-927c2c9a-9d69-4011-8be4-306686b47172 req-2021b113-80fb-4d20-b49f-d252c2a9811f service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Received unexpected event network-vif-plugged-c45eca82-c80d-4ee4-87d6-dc301fd5f760 for instance with vm_state active and task_state rebuild_spawning.
Nov 08 03:58:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:57 user nova-compute[75014]: DEBUG nova.compute.manager [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 03:58:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 03:58:57 user nova-compute[75014]: DEBUG nova.compute.manager [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 03:58:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 03:58:57 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Instance spawned successfully.
Nov 08 03:58:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 03:58:57 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Instance spawned successfully.
Nov 08 03:58:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 03:58:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:58:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:58:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:58:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:58:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:58:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:58:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:58:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:58:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:58:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:58:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:58:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:58:57 user nova-compute[75014]: INFO nova.compute.manager [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Took 8.35 seconds to spawn the instance on the hypervisor.
Nov 08 03:58:57 user nova-compute[75014]: DEBUG nova.compute.manager [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:58:57 user nova-compute[75014]: DEBUG nova.compute.manager [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:58:57 user nova-compute[75014]: INFO nova.compute.manager [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Took 9.23 seconds to build instance.
Nov 08 03:58:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9eb83f2c-4a33-42d4-8a67-fe1092d0e595 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.408s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:58:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:58:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:58:57 user nova-compute[75014]: DEBUG nova.objects.instance [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75014) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 08 03:58:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-932f21bc-f659-4fce-9462-6d93597880f3 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.157s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:58:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:58:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:05 user nova-compute[75014]: DEBUG nova.compute.manager [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 03:59:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:05 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 03:59:05 user nova-compute[75014]: INFO nova.compute.claims [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Claim successful on node user
Nov 08 03:59:06 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:59:06 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:59:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.644s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:06 user nova-compute[75014]: DEBUG nova.compute.manager [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 03:59:06 user nova-compute[75014]: DEBUG nova.compute.manager [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 03:59:06 user nova-compute[75014]: DEBUG nova.network.neutron [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 03:59:06 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 03:59:06 user nova-compute[75014]: DEBUG nova.compute.manager [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 03:59:06 user nova-compute[75014]: DEBUG nova.policy [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ffadb91b73464e559344658dd11bf60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48713cc3a8e4082b76fc0408088c607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 03:59:06 user nova-compute[75014]: DEBUG nova.compute.manager [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 03:59:06 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 03:59:06 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Creating image(s)
Nov 08 03:59:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "/opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "/opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.198s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.210s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk 1073741824" returned: 0 in 0.057s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.195s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:07 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 03:59:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:07 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Cannot resize image /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 03:59:07 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 03:59:07 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Ensure instance console log exists: /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 03:59:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:08 user nova-compute[75014]: DEBUG nova.network.neutron [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Successfully created port: 564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 03:59:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:09 user nova-compute[75014]: DEBUG nova.network.neutron [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Successfully updated port: 564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 03:59:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "refresh_cache-d4726cd1-51ea-41e2-ad36-be12b4d4c26b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:59:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquired lock "refresh_cache-d4726cd1-51ea-41e2-ad36-be12b4d4c26b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:59:09 user nova-compute[75014]: DEBUG nova.network.neutron [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 03:59:09 user nova-compute[75014]: DEBUG nova.compute.manager [req-814d444f-ed62-40b8-9e3b-fdf5505e357a req-799734c7-33ae-4580-aaf8-dd66f30594ef service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Received event network-changed-564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:59:09 user nova-compute[75014]: DEBUG nova.compute.manager [req-814d444f-ed62-40b8-9e3b-fdf5505e357a req-799734c7-33ae-4580-aaf8-dd66f30594ef service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Refreshing instance network info cache due to event network-changed-564c15b6-eb02-4a0c-8b00-d611297ac247. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:59:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-814d444f-ed62-40b8-9e3b-fdf5505e357a req-799734c7-33ae-4580-aaf8-dd66f30594ef service nova] Acquiring lock "refresh_cache-d4726cd1-51ea-41e2-ad36-be12b4d4c26b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:59:09 user nova-compute[75014]: DEBUG nova.network.neutron [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG nova.network.neutron [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Updating instance_info_cache with network_info: [{"id": "564c15b6-eb02-4a0c-8b00-d611297ac247", "address": "fa:16:3e:60:c7:25", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap564c15b6-eb", "ovs_interfaceid": "564c15b6-eb02-4a0c-8b00-d611297ac247", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Releasing lock "refresh_cache-d4726cd1-51ea-41e2-ad36-be12b4d4c26b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG nova.compute.manager [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Instance network_info: |[{"id": "564c15b6-eb02-4a0c-8b00-d611297ac247", "address": "fa:16:3e:60:c7:25", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap564c15b6-eb", "ovs_interfaceid": "564c15b6-eb02-4a0c-8b00-d611297ac247", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-814d444f-ed62-40b8-9e3b-fdf5505e357a req-799734c7-33ae-4580-aaf8-dd66f30594ef service nova] Acquired lock "refresh_cache-d4726cd1-51ea-41e2-ad36-be12b4d4c26b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG nova.network.neutron [req-814d444f-ed62-40b8-9e3b-fdf5505e357a req-799734c7-33ae-4580-aaf8-dd66f30594ef service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Refreshing network info cache for port 564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Start _get_guest_xml network_info=[{"id": "564c15b6-eb02-4a0c-8b00-d611297ac247", "address": "fa:16:3e:60:c7:25", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap564c15b6-eb", "ovs_interfaceid": "564c15b6-eb02-4a0c-8b00-d611297ac247", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 03:59:10 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:59:10 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:59:10 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:59:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1421912526',display_name='tempest-ServerRescueNegativeTestJSON-server-1421912526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1421912526',id=21,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFwBuDYKBVjyeJogLynZj8+TTisND9lq7izW1C75IPBZUw7A+Avd65fAZEkhYC2Vp028fHOOpOV5PXI6M6n1Bu6VpxGhH8gCkRhrS+3+7bXxUQLK7wqKxJNtOzyYg+8dw==',key_name='tempest-keypair-721990497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b48713cc3a8e4082b76fc0408088c607',ramdisk_id='',reservation_id='r-gnos5l9u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1450625183',owner_user_name='tempest-ServerRescueNegativeTestJSON-1450625183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:59:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffadb91b73464e559344658dd11bf60d',uuid=d4726cd1-51ea-41e2-ad36-be12b4d4c26b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "564c15b6-eb02-4a0c-8b00-d611297ac247", "address": "fa:16:3e:60:c7:25", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap564c15b6-eb", "ovs_interfaceid": "564c15b6-eb02-4a0c-8b00-d611297ac247", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Converting VIF {"id": "564c15b6-eb02-4a0c-8b00-d611297ac247", "address": "fa:16:3e:60:c7:25", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap564c15b6-eb", "ovs_interfaceid": "564c15b6-eb02-4a0c-8b00-d611297ac247", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:c7:25,bridge_name='br-int',has_traffic_filtering=True,id=564c15b6-eb02-4a0c-8b00-d611297ac247,network=Network(982531ca-8a2f-41de-b62e-5b43b6a45a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap564c15b6-eb') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG nova.objects.instance [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lazy-loading 'pci_devices' on Instance uuid d4726cd1-51ea-41e2-ad36-be12b4d4c26b {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] End _get_guest_xml xml=<domain type="kvm">
Nov 08 03:59:10 user nova-compute[75014]:   <uuid>d4726cd1-51ea-41e2-ad36-be12b4d4c26b</uuid>
Nov 08 03:59:10 user nova-compute[75014]:   <name>instance-00000015</name>
Nov 08 03:59:10 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 03:59:10 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 03:59:10 user nova-compute[75014]:   <metadata>
Nov 08 03:59:10 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 03:59:10 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 03:59:10 user nova-compute[75014]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1421912526</nova:name>
Nov 08 03:59:10 user nova-compute[75014]:       <nova:creationTime>2023-11-08 03:59:10</nova:creationTime>
Nov 08 03:59:10 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 03:59:10 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 03:59:10 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 03:59:10 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 03:59:10 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 03:59:10 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 03:59:10 user nova-compute[75014]:       </nova:flavor>
Nov 08 03:59:10 user nova-compute[75014]:       <nova:owner>
Nov 08 03:59:10 user nova-compute[75014]:         <nova:user uuid="ffadb91b73464e559344658dd11bf60d">tempest-ServerRescueNegativeTestJSON-1450625183-project-member</nova:user>
Nov 08 03:59:10 user nova-compute[75014]:         <nova:project uuid="b48713cc3a8e4082b76fc0408088c607">tempest-ServerRescueNegativeTestJSON-1450625183</nova:project>
Nov 08 03:59:10 user nova-compute[75014]:       </nova:owner>
Nov 08 03:59:10 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 03:59:10 user nova-compute[75014]:       <nova:ports>
Nov 08 03:59:10 user nova-compute[75014]:         <nova:port uuid="564c15b6-eb02-4a0c-8b00-d611297ac247">
Nov 08 03:59:10 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 03:59:10 user nova-compute[75014]:         </nova:port>
Nov 08 03:59:10 user nova-compute[75014]:       </nova:ports>
Nov 08 03:59:10 user nova-compute[75014]:     </nova:instance>
Nov 08 03:59:10 user nova-compute[75014]:   </metadata>
Nov 08 03:59:10 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 03:59:10 user nova-compute[75014]:     <system>
Nov 08 03:59:10 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 03:59:10 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 03:59:10 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 03:59:10 user nova-compute[75014]:       <entry name="serial">d4726cd1-51ea-41e2-ad36-be12b4d4c26b</entry>
Nov 08 03:59:10 user nova-compute[75014]:       <entry name="uuid">d4726cd1-51ea-41e2-ad36-be12b4d4c26b</entry>
Nov 08 03:59:10 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 03:59:10 user nova-compute[75014]:     </system>
Nov 08 03:59:10 user nova-compute[75014]:   </sysinfo>
Nov 08 03:59:10 user nova-compute[75014]:   <os>
Nov 08 03:59:10 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 03:59:10 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 03:59:10 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 03:59:10 user nova-compute[75014]:   </os>
Nov 08 03:59:10 user nova-compute[75014]:   <features>
Nov 08 03:59:10 user nova-compute[75014]:     <acpi/>
Nov 08 03:59:10 user nova-compute[75014]:     <apic/>
Nov 08 03:59:10 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 03:59:10 user nova-compute[75014]:   </features>
Nov 08 03:59:10 user nova-compute[75014]:   <clock offset="utc">
Nov 08 03:59:10 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 03:59:10 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 03:59:10 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 03:59:10 user nova-compute[75014]:   </clock>
Nov 08 03:59:10 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 03:59:10 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 03:59:10 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 03:59:10 user nova-compute[75014]:   </cpu>
Nov 08 03:59:10 user nova-compute[75014]:   <devices>
Nov 08 03:59:10 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 03:59:10 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 03:59:10 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk"/>
Nov 08 03:59:10 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 03:59:10 user nova-compute[75014]:     </disk>
Nov 08 03:59:10 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:59:10 user nova-compute[75014]:       <mac address="fa:16:3e:60:c7:25"/>
Nov 08 03:59:10 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:59:10 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:59:10 user nova-compute[75014]:       <target dev="tap564c15b6-eb"/>
Nov 08 03:59:10 user nova-compute[75014]:     </interface>
Nov 08 03:59:10 user nova-compute[75014]:     <serial type="pty">
Nov 08 03:59:10 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/console.log" append="off"/>
Nov 08 03:59:10 user nova-compute[75014]:     </serial>
Nov 08 03:59:10 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 03:59:10 user nova-compute[75014]:     <video>
Nov 08 03:59:10 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:59:10 user nova-compute[75014]:     </video>
Nov 08 03:59:10 user nova-compute[75014]:     <rng model="virtio">
Nov 08 03:59:10 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 03:59:10 user nova-compute[75014]:     </rng>
Nov 08 03:59:10 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 03:59:10 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 03:59:10 user nova-compute[75014]:       <stats period="10"/>
Nov 08 03:59:10 user nova-compute[75014]:     </memballoon>
Nov 08 03:59:10 user nova-compute[75014]:   </devices>
Nov 08 03:59:10 user nova-compute[75014]: </domain>
Nov 08 03:59:10 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:59:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1421912526',display_name='tempest-ServerRescueNegativeTestJSON-server-1421912526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1421912526',id=21,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFwBuDYKBVjyeJogLynZj8+TTisND9lq7izW1C75IPBZUw7A+Avd65fAZEkhYC2Vp028fHOOpOV5PXI6M6n1Bu6VpxGhH8gCkRhrS+3+7bXxUQLK7wqKxJNtOzyYg+8dw==',key_name='tempest-keypair-721990497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b48713cc3a8e4082b76fc0408088c607',ramdisk_id='',reservation_id='r-gnos5l9u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1450625183',owner_user_name='tempest-ServerRescueNegativeTestJSON-1450625183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:59:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffadb91b73464e559344658dd11bf60d',uuid=d4726cd1-51ea-41e2-ad36-be12b4d4c26b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "564c15b6-eb02-4a0c-8b00-d611297ac247", "address": "fa:16:3e:60:c7:25", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap564c15b6-eb", "ovs_interfaceid": "564c15b6-eb02-4a0c-8b00-d611297ac247", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Converting VIF {"id": "564c15b6-eb02-4a0c-8b00-d611297ac247", "address": "fa:16:3e:60:c7:25", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap564c15b6-eb", "ovs_interfaceid": "564c15b6-eb02-4a0c-8b00-d611297ac247", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:c7:25,bridge_name='br-int',has_traffic_filtering=True,id=564c15b6-eb02-4a0c-8b00-d611297ac247,network=Network(982531ca-8a2f-41de-b62e-5b43b6a45a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap564c15b6-eb') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG os_vif [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:c7:25,bridge_name='br-int',has_traffic_filtering=True,id=564c15b6-eb02-4a0c-8b00-d611297ac247,network=Network(982531ca-8a2f-41de-b62e-5b43b6a45a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap564c15b6-eb') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d87d2b3-153e-5069-8412-e05a1eb5c102', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap564c15b6-eb, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap564c15b6-eb, col_values=(('qos', UUID('8ec3448a-86ac-4070-98a5-83511363b27d')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap564c15b6-eb, col_values=(('external_ids', {'iface-id': '564c15b6-eb02-4a0c-8b00-d611297ac247', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:c7:25', 'vm-uuid': 'd4726cd1-51ea-41e2-ad36-be12b4d4c26b'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:10 user nova-compute[75014]: INFO os_vif [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:c7:25,bridge_name='br-int',has_traffic_filtering=True,id=564c15b6-eb02-4a0c-8b00-d611297ac247,network=Network(982531ca-8a2f-41de-b62e-5b43b6a45a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap564c15b6-eb')
Nov 08 03:59:10 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] No VIF found with MAC fa:16:3e:60:c7:25, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG nova.network.neutron [req-814d444f-ed62-40b8-9e3b-fdf5505e357a req-799734c7-33ae-4580-aaf8-dd66f30594ef service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Updated VIF entry in instance network info cache for port 564c15b6-eb02-4a0c-8b00-d611297ac247. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG nova.network.neutron [req-814d444f-ed62-40b8-9e3b-fdf5505e357a req-799734c7-33ae-4580-aaf8-dd66f30594ef service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Updating instance_info_cache with network_info: [{"id": "564c15b6-eb02-4a0c-8b00-d611297ac247", "address": "fa:16:3e:60:c7:25", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap564c15b6-eb", "ovs_interfaceid": "564c15b6-eb02-4a0c-8b00-d611297ac247", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:59:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-814d444f-ed62-40b8-9e3b-fdf5505e357a req-799734c7-33ae-4580-aaf8-dd66f30594ef service nova] Releasing lock "refresh_cache-d4726cd1-51ea-41e2-ad36-be12b4d4c26b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:59:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "44d4794d-91c4-4eb6-a752-37f587f2b420" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "44d4794d-91c4-4eb6-a752-37f587f2b420" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:14 user nova-compute[75014]: DEBUG nova.compute.manager [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 03:59:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:14 user nova-compute[75014]: DEBUG nova.compute.manager [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 03:59:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 03:59:14 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 03:59:14 user nova-compute[75014]: INFO nova.compute.claims [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Claim successful on node user
Nov 08 03:59:14 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Instance spawned successfully.
Nov 08 03:59:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 03:59:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:59:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:59:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:59:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:59:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:59:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:59:14 user nova-compute[75014]: INFO nova.compute.manager [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Took 7.77 seconds to spawn the instance on the hypervisor.
Nov 08 03:59:14 user nova-compute[75014]: DEBUG nova.compute.manager [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:59:14 user nova-compute[75014]: INFO nova.compute.manager [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Took 8.84 seconds to build instance.
Nov 08 03:59:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-96757b41-fc44-4d9d-9667-5bf7f070a8e5 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.977s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:14 user nova-compute[75014]: DEBUG nova.compute.manager [req-326b06c5-393a-4e70-ba89-a8c340943429 req-4e1850ad-839e-490a-b2e7-1f9ed3f826c6 service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Received event network-vif-plugged-564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:59:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-326b06c5-393a-4e70-ba89-a8c340943429 req-4e1850ad-839e-490a-b2e7-1f9ed3f826c6 service nova] Acquiring lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-326b06c5-393a-4e70-ba89-a8c340943429 req-4e1850ad-839e-490a-b2e7-1f9ed3f826c6 service nova] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-326b06c5-393a-4e70-ba89-a8c340943429 req-4e1850ad-839e-490a-b2e7-1f9ed3f826c6 service nova] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:14 user nova-compute[75014]: DEBUG nova.compute.manager [req-326b06c5-393a-4e70-ba89-a8c340943429 req-4e1850ad-839e-490a-b2e7-1f9ed3f826c6 service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] No waiting events found dispatching network-vif-plugged-564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:59:14 user nova-compute[75014]: WARNING nova.compute.manager [req-326b06c5-393a-4e70-ba89-a8c340943429 req-4e1850ad-839e-490a-b2e7-1f9ed3f826c6 service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Received unexpected event network-vif-plugged-564c15b6-eb02-4a0c-8b00-d611297ac247 for instance with vm_state active and task_state None.
Nov 08 03:59:14 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:59:14 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:59:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.530s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:14 user nova-compute[75014]: DEBUG nova.compute.manager [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 03:59:14 user nova-compute[75014]: DEBUG nova.compute.manager [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 03:59:14 user nova-compute[75014]: DEBUG nova.network.neutron [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 03:59:15 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 03:59:15 user nova-compute[75014]: DEBUG nova.compute.manager [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 03:59:15 user nova-compute[75014]: DEBUG nova.policy [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '377368f8d9a540aebd8b8760b7130fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60831c0130424415a7bcf071bba28ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 03:59:15 user nova-compute[75014]: DEBUG nova.compute.manager [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 03:59:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 03:59:15 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Creating image(s)
Nov 08 03:59:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "/opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "/opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "/opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "68492d0b8b75f9135d6b506d5542c276cef0cb3e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "68492d0b8b75f9135d6b506d5542c276cef0cb3e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68492d0b8b75f9135d6b506d5542c276cef0cb3e.part --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:15 user nova-compute[75014]: DEBUG nova.network.neutron [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Successfully created port: 37918aae-d92b-43c0-8477-1355ac936ab0 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 03:59:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68492d0b8b75f9135d6b506d5542c276cef0cb3e.part --force-share --output=json" returned: 0 in 0.217s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:15 user nova-compute[75014]: DEBUG nova.virt.images [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] fc883799-3917-4eb3-ad7b-aec0fef4495b was qcow2, converting to raw {{(pid=75014) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 03:59:15 user nova-compute[75014]: DEBUG nova.privsep.utils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75014) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 03:59:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/68492d0b8b75f9135d6b506d5542c276cef0cb3e.part /opt/stack/data/nova/instances/_base/68492d0b8b75f9135d6b506d5542c276cef0cb3e.converted {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/68492d0b8b75f9135d6b506d5542c276cef0cb3e.part /opt/stack/data/nova/instances/_base/68492d0b8b75f9135d6b506d5542c276cef0cb3e.converted" returned: 0 in 0.154s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68492d0b8b75f9135d6b506d5542c276cef0cb3e.converted --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68492d0b8b75f9135d6b506d5542c276cef0cb3e.converted --force-share --output=json" returned: 0 in 0.223s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "68492d0b8b75f9135d6b506d5542c276cef0cb3e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.052s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68492d0b8b75f9135d6b506d5542c276cef0cb3e --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:16 user nova-compute[75014]: DEBUG nova.network.neutron [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Successfully updated port: 37918aae-d92b-43c0-8477-1355ac936ab0 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 03:59:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "refresh_cache-44d4794d-91c4-4eb6-a752-37f587f2b420" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:59:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquired lock "refresh_cache-44d4794d-91c4-4eb6-a752-37f587f2b420" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:59:16 user nova-compute[75014]: DEBUG nova.network.neutron [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 03:59:16 user nova-compute[75014]: DEBUG nova.compute.manager [req-77838100-2ff2-490d-996b-fbad1c0e18db req-1572d98d-50ed-493d-8d18-4c5d7e8d2b8c service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Received event network-changed-37918aae-d92b-43c0-8477-1355ac936ab0 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:59:16 user nova-compute[75014]: DEBUG nova.compute.manager [req-77838100-2ff2-490d-996b-fbad1c0e18db req-1572d98d-50ed-493d-8d18-4c5d7e8d2b8c service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Refreshing instance network info cache due to event network-changed-37918aae-d92b-43c0-8477-1355ac936ab0. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:59:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-77838100-2ff2-490d-996b-fbad1c0e18db req-1572d98d-50ed-493d-8d18-4c5d7e8d2b8c service nova] Acquiring lock "refresh_cache-44d4794d-91c4-4eb6-a752-37f587f2b420" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:59:16 user nova-compute[75014]: DEBUG nova.network.neutron [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 03:59:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68492d0b8b75f9135d6b506d5542c276cef0cb3e --force-share --output=json" returned: 0 in 0.217s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "68492d0b8b75f9135d6b506d5542c276cef0cb3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "68492d0b8b75f9135d6b506d5542c276cef0cb3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68492d0b8b75f9135d6b506d5542c276cef0cb3e --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68492d0b8b75f9135d6b506d5542c276cef0cb3e --force-share --output=json" returned: 0 in 0.191s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68492d0b8b75f9135d6b506d5542c276cef0cb3e,backing_fmt=raw /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:16 user nova-compute[75014]: DEBUG nova.network.neutron [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Updating instance_info_cache with network_info: [{"id": "37918aae-d92b-43c0-8477-1355ac936ab0", "address": "fa:16:3e:43:25:9f", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37918aae-d9", "ovs_interfaceid": "37918aae-d92b-43c0-8477-1355ac936ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:59:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68492d0b8b75f9135d6b506d5542c276cef0cb3e,backing_fmt=raw /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk 1073741824" returned: 0 in 0.062s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "68492d0b8b75f9135d6b506d5542c276cef0cb3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68492d0b8b75f9135d6b506d5542c276cef0cb3e --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Releasing lock "refresh_cache-44d4794d-91c4-4eb6-a752-37f587f2b420" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:59:16 user nova-compute[75014]: DEBUG nova.compute.manager [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Instance network_info: |[{"id": "37918aae-d92b-43c0-8477-1355ac936ab0", "address": "fa:16:3e:43:25:9f", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37918aae-d9", "ovs_interfaceid": "37918aae-d92b-43c0-8477-1355ac936ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 03:59:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-77838100-2ff2-490d-996b-fbad1c0e18db req-1572d98d-50ed-493d-8d18-4c5d7e8d2b8c service nova] Acquired lock "refresh_cache-44d4794d-91c4-4eb6-a752-37f587f2b420" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:59:16 user nova-compute[75014]: DEBUG nova.network.neutron [req-77838100-2ff2-490d-996b-fbad1c0e18db req-1572d98d-50ed-493d-8d18-4c5d7e8d2b8c service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Refreshing network info cache for port 37918aae-d92b-43c0-8477-1355ac936ab0 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:59:16 user nova-compute[75014]: DEBUG nova.compute.manager [req-f085179e-ed6c-4e9e-bc19-502365d64331 req-324e66f3-e9fd-4b93-b8a0-e8b893e8288a service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Received event network-vif-plugged-564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:59:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f085179e-ed6c-4e9e-bc19-502365d64331 req-324e66f3-e9fd-4b93-b8a0-e8b893e8288a service nova] Acquiring lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f085179e-ed6c-4e9e-bc19-502365d64331 req-324e66f3-e9fd-4b93-b8a0-e8b893e8288a service nova] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f085179e-ed6c-4e9e-bc19-502365d64331 req-324e66f3-e9fd-4b93-b8a0-e8b893e8288a service nova] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:16 user nova-compute[75014]: DEBUG nova.compute.manager [req-f085179e-ed6c-4e9e-bc19-502365d64331 req-324e66f3-e9fd-4b93-b8a0-e8b893e8288a service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] No waiting events found dispatching network-vif-plugged-564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:59:16 user nova-compute[75014]: WARNING nova.compute.manager [req-f085179e-ed6c-4e9e-bc19-502365d64331 req-324e66f3-e9fd-4b93-b8a0-e8b893e8288a service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Received unexpected event network-vif-plugged-564c15b6-eb02-4a0c-8b00-d611297ac247 for instance with vm_state active and task_state None.
Nov 08 03:59:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68492d0b8b75f9135d6b506d5542c276cef0cb3e --force-share --output=json" returned: 0 in 0.237s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Checking if we can resize image /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Cannot resize image /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Ensure instance console log exists: /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Start _get_guest_xml network_info=[{"id": "37918aae-d92b-43c0-8477-1355ac936ab0", "address": "fa:16:3e:43:25:9f", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37918aae-d9", "ovs_interfaceid": "37918aae-d92b-43c0-8477-1355ac936ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:59:11Z,direct_url=<?>,disk_format='qcow2',id=fc883799-3917-4eb3-ad7b-aec0fef4495b,min_disk=0,min_ram=0,name='tempest-scenario-img--1022011073',owner='60831c0130424415a7bcf071bba28ab0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:59:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'fc883799-3917-4eb3-ad7b-aec0fef4495b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 03:59:17 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:59:17 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:59:11Z,direct_url=<?>,disk_format='qcow2',id=fc883799-3917-4eb3-ad7b-aec0fef4495b,min_disk=0,min_ram=0,name='tempest-scenario-img--1022011073',owner='60831c0130424415a7bcf071bba28ab0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:59:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:59:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1283389400',display_name='tempest-TestMinimumBasicScenario-server-1283389400',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1283389400',id=22,image_ref='fc883799-3917-4eb3-ad7b-aec0fef4495b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd4W/27RUr/jFVGcD2SSXjFI9PeHAFU2/fUSyG/RGRc5V0x95Y0r91VEtl6T8buh3ZpbGPW38t75T1O0iy+2Qg623tDMYN5y6qvwp2gWJUmqQS0VB/6/qYXbUlezOiduA==',key_name='tempest-TestMinimumBasicScenario-309319752',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60831c0130424415a7bcf071bba28ab0',ramdisk_id='',reservation_id='r-ykj7rhm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fc883799-3917-4eb3-ad7b-aec0fef4495b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-696617302',owner_user_name='tempest-TestMinimumBasicScenario-696617302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:59:15Z,user_data=None,user_id='377368f8d9a540aebd8b8760b7130fb5',uuid=44d4794d-91c4-4eb6-a752-37f587f2b420,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37918aae-d92b-43c0-8477-1355ac936ab0", "address": "fa:16:3e:43:25:9f", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37918aae-d9", "ovs_interfaceid": "37918aae-d92b-43c0-8477-1355ac936ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Converting VIF {"id": "37918aae-d92b-43c0-8477-1355ac936ab0", "address": "fa:16:3e:43:25:9f", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37918aae-d9", "ovs_interfaceid": "37918aae-d92b-43c0-8477-1355ac936ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:25:9f,bridge_name='br-int',has_traffic_filtering=True,id=37918aae-d92b-43c0-8477-1355ac936ab0,network=Network(b36b65ee-1443-4741-946a-096b65a4e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37918aae-d9') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.objects.instance [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lazy-loading 'pci_devices' on Instance uuid 44d4794d-91c4-4eb6-a752-37f587f2b420 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.network.neutron [req-77838100-2ff2-490d-996b-fbad1c0e18db req-1572d98d-50ed-493d-8d18-4c5d7e8d2b8c service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Updated VIF entry in instance network info cache for port 37918aae-d92b-43c0-8477-1355ac936ab0. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.network.neutron [req-77838100-2ff2-490d-996b-fbad1c0e18db req-1572d98d-50ed-493d-8d18-4c5d7e8d2b8c service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Updating instance_info_cache with network_info: [{"id": "37918aae-d92b-43c0-8477-1355ac936ab0", "address": "fa:16:3e:43:25:9f", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37918aae-d9", "ovs_interfaceid": "37918aae-d92b-43c0-8477-1355ac936ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] End _get_guest_xml xml=<domain type="kvm">
Nov 08 03:59:17 user nova-compute[75014]:   <uuid>44d4794d-91c4-4eb6-a752-37f587f2b420</uuid>
Nov 08 03:59:17 user nova-compute[75014]:   <name>instance-00000016</name>
Nov 08 03:59:17 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 03:59:17 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 03:59:17 user nova-compute[75014]:   <metadata>
Nov 08 03:59:17 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 03:59:17 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 03:59:17 user nova-compute[75014]:       <nova:name>tempest-TestMinimumBasicScenario-server-1283389400</nova:name>
Nov 08 03:59:17 user nova-compute[75014]:       <nova:creationTime>2023-11-08 03:59:17</nova:creationTime>
Nov 08 03:59:17 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 03:59:17 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 03:59:17 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 03:59:17 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 03:59:17 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 03:59:17 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 03:59:17 user nova-compute[75014]:       </nova:flavor>
Nov 08 03:59:17 user nova-compute[75014]:       <nova:owner>
Nov 08 03:59:17 user nova-compute[75014]:         <nova:user uuid="377368f8d9a540aebd8b8760b7130fb5">tempest-TestMinimumBasicScenario-696617302-project-member</nova:user>
Nov 08 03:59:17 user nova-compute[75014]:         <nova:project uuid="60831c0130424415a7bcf071bba28ab0">tempest-TestMinimumBasicScenario-696617302</nova:project>
Nov 08 03:59:17 user nova-compute[75014]:       </nova:owner>
Nov 08 03:59:17 user nova-compute[75014]:       <nova:root type="image" uuid="fc883799-3917-4eb3-ad7b-aec0fef4495b"/>
Nov 08 03:59:17 user nova-compute[75014]:       <nova:ports>
Nov 08 03:59:17 user nova-compute[75014]:         <nova:port uuid="37918aae-d92b-43c0-8477-1355ac936ab0">
Nov 08 03:59:17 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 03:59:17 user nova-compute[75014]:         </nova:port>
Nov 08 03:59:17 user nova-compute[75014]:       </nova:ports>
Nov 08 03:59:17 user nova-compute[75014]:     </nova:instance>
Nov 08 03:59:17 user nova-compute[75014]:   </metadata>
Nov 08 03:59:17 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 03:59:17 user nova-compute[75014]:     <system>
Nov 08 03:59:17 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 03:59:17 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 03:59:17 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 03:59:17 user nova-compute[75014]:       <entry name="serial">44d4794d-91c4-4eb6-a752-37f587f2b420</entry>
Nov 08 03:59:17 user nova-compute[75014]:       <entry name="uuid">44d4794d-91c4-4eb6-a752-37f587f2b420</entry>
Nov 08 03:59:17 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 03:59:17 user nova-compute[75014]:     </system>
Nov 08 03:59:17 user nova-compute[75014]:   </sysinfo>
Nov 08 03:59:17 user nova-compute[75014]:   <os>
Nov 08 03:59:17 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 03:59:17 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 03:59:17 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 03:59:17 user nova-compute[75014]:   </os>
Nov 08 03:59:17 user nova-compute[75014]:   <features>
Nov 08 03:59:17 user nova-compute[75014]:     <acpi/>
Nov 08 03:59:17 user nova-compute[75014]:     <apic/>
Nov 08 03:59:17 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 03:59:17 user nova-compute[75014]:   </features>
Nov 08 03:59:17 user nova-compute[75014]:   <clock offset="utc">
Nov 08 03:59:17 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 03:59:17 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 03:59:17 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 03:59:17 user nova-compute[75014]:   </clock>
Nov 08 03:59:17 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 03:59:17 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 03:59:17 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 03:59:17 user nova-compute[75014]:   </cpu>
Nov 08 03:59:17 user nova-compute[75014]:   <devices>
Nov 08 03:59:17 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 03:59:17 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 03:59:17 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk"/>
Nov 08 03:59:17 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 03:59:17 user nova-compute[75014]:     </disk>
Nov 08 03:59:17 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:59:17 user nova-compute[75014]:       <mac address="fa:16:3e:43:25:9f"/>
Nov 08 03:59:17 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:59:17 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:59:17 user nova-compute[75014]:       <target dev="tap37918aae-d9"/>
Nov 08 03:59:17 user nova-compute[75014]:     </interface>
Nov 08 03:59:17 user nova-compute[75014]:     <serial type="pty">
Nov 08 03:59:17 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/console.log" append="off"/>
Nov 08 03:59:17 user nova-compute[75014]:     </serial>
Nov 08 03:59:17 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 03:59:17 user nova-compute[75014]:     <video>
Nov 08 03:59:17 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:59:17 user nova-compute[75014]:     </video>
Nov 08 03:59:17 user nova-compute[75014]:     <rng model="virtio">
Nov 08 03:59:17 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 03:59:17 user nova-compute[75014]:     </rng>
Nov 08 03:59:17 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 03:59:17 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 03:59:17 user nova-compute[75014]:       <stats period="10"/>
Nov 08 03:59:17 user nova-compute[75014]:     </memballoon>
Nov 08 03:59:17 user nova-compute[75014]:   </devices>
Nov 08 03:59:17 user nova-compute[75014]: </domain>
Nov 08 03:59:17 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:59:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1283389400',display_name='tempest-TestMinimumBasicScenario-server-1283389400',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1283389400',id=22,image_ref='fc883799-3917-4eb3-ad7b-aec0fef4495b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd4W/27RUr/jFVGcD2SSXjFI9PeHAFU2/fUSyG/RGRc5V0x95Y0r91VEtl6T8buh3ZpbGPW38t75T1O0iy+2Qg623tDMYN5y6qvwp2gWJUmqQS0VB/6/qYXbUlezOiduA==',key_name='tempest-TestMinimumBasicScenario-309319752',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60831c0130424415a7bcf071bba28ab0',ramdisk_id='',reservation_id='r-ykj7rhm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fc883799-3917-4eb3-ad7b-aec0fef4495b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-696617302',owner_user_name='tempest-TestMinimumBasicScenario-696617302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:59:15Z,user_data=None,user_id='377368f8d9a540aebd8b8760b7130fb5',uuid=44d4794d-91c4-4eb6-a752-37f587f2b420,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37918aae-d92b-43c0-8477-1355ac936ab0", "address": "fa:16:3e:43:25:9f", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37918aae-d9", "ovs_interfaceid": "37918aae-d92b-43c0-8477-1355ac936ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Converting VIF {"id": "37918aae-d92b-43c0-8477-1355ac936ab0", "address": "fa:16:3e:43:25:9f", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37918aae-d9", "ovs_interfaceid": "37918aae-d92b-43c0-8477-1355ac936ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:25:9f,bridge_name='br-int',has_traffic_filtering=True,id=37918aae-d92b-43c0-8477-1355ac936ab0,network=Network(b36b65ee-1443-4741-946a-096b65a4e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37918aae-d9') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG os_vif [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:25:9f,bridge_name='br-int',has_traffic_filtering=True,id=37918aae-d92b-43c0-8477-1355ac936ab0,network=Network(b36b65ee-1443-4741-946a-096b65a4e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37918aae-d9') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-77838100-2ff2-490d-996b-fbad1c0e18db req-1572d98d-50ed-493d-8d18-4c5d7e8d2b8c service nova] Releasing lock "refresh_cache-44d4794d-91c4-4eb6-a752-37f587f2b420" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2be6d679-d756-5971-bf4a-f012a9b7aa43', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37918aae-d9, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37918aae-d9, col_values=(('qos', UUID('b5cf42c0-7dc2-48cb-a263-27cba65fc993')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37918aae-d9, col_values=(('external_ids', {'iface-id': '37918aae-d92b-43c0-8477-1355ac936ab0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:25:9f', 'vm-uuid': '44d4794d-91c4-4eb6-a752-37f587f2b420'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:17 user nova-compute[75014]: INFO os_vif [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:25:9f,bridge_name='br-int',has_traffic_filtering=True,id=37918aae-d92b-43c0-8477-1355ac936ab0,network=Network(b36b65ee-1443-4741-946a-096b65a4e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37918aae-d9')
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:59:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] No VIF found with MAC fa:16:3e:43:25:9f, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:59:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Acquiring lock "5c23c904-7d83-489c-bb45-04add15c2bf6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lock "5c23c904-7d83-489c-bb45-04add15c2bf6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:19 user nova-compute[75014]: DEBUG nova.compute.manager [req-1943dd80-0cdd-4cdf-a0bf-e74304950367 req-ad55cf73-015f-4714-9794-3276f94afa5d service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Received event network-vif-plugged-37918aae-d92b-43c0-8477-1355ac936ab0 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:59:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1943dd80-0cdd-4cdf-a0bf-e74304950367 req-ad55cf73-015f-4714-9794-3276f94afa5d service nova] Acquiring lock "44d4794d-91c4-4eb6-a752-37f587f2b420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1943dd80-0cdd-4cdf-a0bf-e74304950367 req-ad55cf73-015f-4714-9794-3276f94afa5d service nova] Lock "44d4794d-91c4-4eb6-a752-37f587f2b420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1943dd80-0cdd-4cdf-a0bf-e74304950367 req-ad55cf73-015f-4714-9794-3276f94afa5d service nova] Lock "44d4794d-91c4-4eb6-a752-37f587f2b420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:19 user nova-compute[75014]: DEBUG nova.compute.manager [req-1943dd80-0cdd-4cdf-a0bf-e74304950367 req-ad55cf73-015f-4714-9794-3276f94afa5d service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] No waiting events found dispatching network-vif-plugged-37918aae-d92b-43c0-8477-1355ac936ab0 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:59:19 user nova-compute[75014]: WARNING nova.compute.manager [req-1943dd80-0cdd-4cdf-a0bf-e74304950367 req-ad55cf73-015f-4714-9794-3276f94afa5d service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Received unexpected event network-vif-plugged-37918aae-d92b-43c0-8477-1355ac936ab0 for instance with vm_state building and task_state spawning.
Nov 08 03:59:19 user nova-compute[75014]: DEBUG nova.compute.manager [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 03:59:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:19 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 03:59:19 user nova-compute[75014]: INFO nova.compute.claims [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Claim successful on node user
Nov 08 03:59:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:20 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:59:20 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:59:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.599s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:20 user nova-compute[75014]: DEBUG nova.compute.manager [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 03:59:20 user nova-compute[75014]: DEBUG nova.compute.manager [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 03:59:20 user nova-compute[75014]: DEBUG nova.network.neutron [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 03:59:20 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 03:59:20 user nova-compute[75014]: DEBUG nova.compute.manager [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 03:59:20 user nova-compute[75014]: DEBUG nova.policy [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '685cdd725739412982a0d768ca78b325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1d4a398f55459aaa5526ef57b816ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 03:59:20 user nova-compute[75014]: DEBUG nova.compute.manager [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 03:59:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 03:59:20 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Creating image(s)
Nov 08 03:59:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lock "/opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lock "/opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:20 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:20 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.181s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:20 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:20 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.184s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:20 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:20 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk 1073741824" returned: 0 in 0.048s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:20 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:20 user nova-compute[75014]: DEBUG nova.network.neutron [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Successfully created port: eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 03:59:20 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.195s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:20 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 03:59:20 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:21 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:21 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Cannot resize image /opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 03:59:21 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 03:59:21 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Ensure instance console log exists: /opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 03:59:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:21 user nova-compute[75014]: DEBUG nova.compute.manager [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 03:59:21 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 03:59:21 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Instance spawned successfully.
Nov 08 03:59:21 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 03:59:21 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:59:21 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:59:21 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:59:21 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:59:21 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:59:21 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:59:21 user nova-compute[75014]: INFO nova.compute.manager [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Took 6.18 seconds to spawn the instance on the hypervisor.
Nov 08 03:59:21 user nova-compute[75014]: DEBUG nova.compute.manager [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:59:21 user nova-compute[75014]: INFO nova.compute.manager [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Took 7.19 seconds to build instance.
Nov 08 03:59:21 user nova-compute[75014]: DEBUG nova.compute.manager [req-ddd21776-0ce5-4300-9a5c-8cc86e89bc5a req-6254de06-1cf8-4464-b23f-2ec1b5250698 service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Received event network-vif-plugged-37918aae-d92b-43c0-8477-1355ac936ab0 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:59:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ddd21776-0ce5-4300-9a5c-8cc86e89bc5a req-6254de06-1cf8-4464-b23f-2ec1b5250698 service nova] Acquiring lock "44d4794d-91c4-4eb6-a752-37f587f2b420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ddd21776-0ce5-4300-9a5c-8cc86e89bc5a req-6254de06-1cf8-4464-b23f-2ec1b5250698 service nova] Lock "44d4794d-91c4-4eb6-a752-37f587f2b420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ddd21776-0ce5-4300-9a5c-8cc86e89bc5a req-6254de06-1cf8-4464-b23f-2ec1b5250698 service nova] Lock "44d4794d-91c4-4eb6-a752-37f587f2b420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:21 user nova-compute[75014]: DEBUG nova.compute.manager [req-ddd21776-0ce5-4300-9a5c-8cc86e89bc5a req-6254de06-1cf8-4464-b23f-2ec1b5250698 service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] No waiting events found dispatching network-vif-plugged-37918aae-d92b-43c0-8477-1355ac936ab0 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:59:21 user nova-compute[75014]: WARNING nova.compute.manager [req-ddd21776-0ce5-4300-9a5c-8cc86e89bc5a req-6254de06-1cf8-4464-b23f-2ec1b5250698 service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Received unexpected event network-vif-plugged-37918aae-d92b-43c0-8477-1355ac936ab0 for instance with vm_state active and task_state None.
Nov 08 03:59:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9b38c784-4887-4f5b-98c3-e9c60648cfe4 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "44d4794d-91c4-4eb6-a752-37f587f2b420" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.624s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:21 user nova-compute[75014]: DEBUG nova.network.neutron [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Successfully updated port: eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 03:59:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Acquiring lock "refresh_cache-5c23c904-7d83-489c-bb45-04add15c2bf6" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:59:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Acquired lock "refresh_cache-5c23c904-7d83-489c-bb45-04add15c2bf6" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:59:21 user nova-compute[75014]: DEBUG nova.network.neutron [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 03:59:21 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG nova.network.neutron [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG nova.network.neutron [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Updating instance_info_cache with network_info: [{"id": "eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f", "address": "fa:16:3e:e1:e9:27", "network": {"id": "aec98e5a-5443-47fc-80ec-7aeaafb548c5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2062049335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e1d4a398f55459aaa5526ef57b816ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb7a20ed-c5", "ovs_interfaceid": "eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Releasing lock "refresh_cache-5c23c904-7d83-489c-bb45-04add15c2bf6" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG nova.compute.manager [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Instance network_info: |[{"id": "eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f", "address": "fa:16:3e:e1:e9:27", "network": {"id": "aec98e5a-5443-47fc-80ec-7aeaafb548c5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2062049335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e1d4a398f55459aaa5526ef57b816ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb7a20ed-c5", "ovs_interfaceid": "eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Start _get_guest_xml network_info=[{"id": "eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f", "address": "fa:16:3e:e1:e9:27", "network": {"id": "aec98e5a-5443-47fc-80ec-7aeaafb548c5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2062049335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e1d4a398f55459aaa5526ef57b816ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb7a20ed-c5", "ovs_interfaceid": "eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 03:59:22 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:59:22 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:59:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-974517943',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-974517943',id=23,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdPXIOA7/TBoq0/votl12iKLEhI7NRfXy6j2NIlXxKNWayc0DBpjQWW2qoeBSHfSuOgOB6ZxxP+O5TEB48eK0wLHpB0ujWsQOr2xATZarqhcb9XmT1u6oZJjB9db9Gzpw==',key_name='tempest-keypair-275261075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e1d4a398f55459aaa5526ef57b816ab',ramdisk_id='',reservation_id='r-nodg7g02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1223504486',owner_user_name='tempest-TaggedAttachmentsTest-1223504486-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:59:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='685cdd725739412982a0d768ca78b325',uuid=5c23c904-7d83-489c-bb45-04add15c2bf6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f", "address": "fa:16:3e:e1:e9:27", "network": {"id": "aec98e5a-5443-47fc-80ec-7aeaafb548c5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2062049335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e1d4a398f55459aaa5526ef57b816ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb7a20ed-c5", "ovs_interfaceid": "eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Converting VIF {"id": "eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f", "address": "fa:16:3e:e1:e9:27", "network": {"id": "aec98e5a-5443-47fc-80ec-7aeaafb548c5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2062049335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e1d4a398f55459aaa5526ef57b816ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb7a20ed-c5", "ovs_interfaceid": "eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:e9:27,bridge_name='br-int',has_traffic_filtering=True,id=eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f,network=Network(aec98e5a-5443-47fc-80ec-7aeaafb548c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb7a20ed-c5') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG nova.objects.instance [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c23c904-7d83-489c-bb45-04add15c2bf6 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] End _get_guest_xml xml=<domain type="kvm">
Nov 08 03:59:22 user nova-compute[75014]:   <uuid>5c23c904-7d83-489c-bb45-04add15c2bf6</uuid>
Nov 08 03:59:22 user nova-compute[75014]:   <name>instance-00000017</name>
Nov 08 03:59:22 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 03:59:22 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 03:59:22 user nova-compute[75014]:   <metadata>
Nov 08 03:59:22 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 03:59:22 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 03:59:22 user nova-compute[75014]:       <nova:name>tempest-device-tagging-server-974517943</nova:name>
Nov 08 03:59:22 user nova-compute[75014]:       <nova:creationTime>2023-11-08 03:59:22</nova:creationTime>
Nov 08 03:59:22 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 03:59:22 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 03:59:22 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 03:59:22 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 03:59:22 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 03:59:22 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 03:59:22 user nova-compute[75014]:       </nova:flavor>
Nov 08 03:59:22 user nova-compute[75014]:       <nova:owner>
Nov 08 03:59:22 user nova-compute[75014]:         <nova:user uuid="685cdd725739412982a0d768ca78b325">tempest-TaggedAttachmentsTest-1223504486-project-member</nova:user>
Nov 08 03:59:22 user nova-compute[75014]:         <nova:project uuid="9e1d4a398f55459aaa5526ef57b816ab">tempest-TaggedAttachmentsTest-1223504486</nova:project>
Nov 08 03:59:22 user nova-compute[75014]:       </nova:owner>
Nov 08 03:59:22 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 03:59:22 user nova-compute[75014]:       <nova:ports>
Nov 08 03:59:22 user nova-compute[75014]:         <nova:port uuid="eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f">
Nov 08 03:59:22 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 03:59:22 user nova-compute[75014]:         </nova:port>
Nov 08 03:59:22 user nova-compute[75014]:       </nova:ports>
Nov 08 03:59:22 user nova-compute[75014]:     </nova:instance>
Nov 08 03:59:22 user nova-compute[75014]:   </metadata>
Nov 08 03:59:22 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 03:59:22 user nova-compute[75014]:     <system>
Nov 08 03:59:22 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 03:59:22 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 03:59:22 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 03:59:22 user nova-compute[75014]:       <entry name="serial">5c23c904-7d83-489c-bb45-04add15c2bf6</entry>
Nov 08 03:59:22 user nova-compute[75014]:       <entry name="uuid">5c23c904-7d83-489c-bb45-04add15c2bf6</entry>
Nov 08 03:59:22 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 03:59:22 user nova-compute[75014]:     </system>
Nov 08 03:59:22 user nova-compute[75014]:   </sysinfo>
Nov 08 03:59:22 user nova-compute[75014]:   <os>
Nov 08 03:59:22 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 03:59:22 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 03:59:22 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 03:59:22 user nova-compute[75014]:   </os>
Nov 08 03:59:22 user nova-compute[75014]:   <features>
Nov 08 03:59:22 user nova-compute[75014]:     <acpi/>
Nov 08 03:59:22 user nova-compute[75014]:     <apic/>
Nov 08 03:59:22 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 03:59:22 user nova-compute[75014]:   </features>
Nov 08 03:59:22 user nova-compute[75014]:   <clock offset="utc">
Nov 08 03:59:22 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 03:59:22 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 03:59:22 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 03:59:22 user nova-compute[75014]:   </clock>
Nov 08 03:59:22 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 03:59:22 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 03:59:22 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 03:59:22 user nova-compute[75014]:   </cpu>
Nov 08 03:59:22 user nova-compute[75014]:   <devices>
Nov 08 03:59:22 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 03:59:22 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 03:59:22 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk"/>
Nov 08 03:59:22 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 03:59:22 user nova-compute[75014]:     </disk>
Nov 08 03:59:22 user nova-compute[75014]:     <disk type="file" device="cdrom">
Nov 08 03:59:22 user nova-compute[75014]:       <driver name="qemu" type="raw" cache="none"/>
Nov 08 03:59:22 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk.config"/>
Nov 08 03:59:22 user nova-compute[75014]:       <target dev="hda" bus="ide"/>
Nov 08 03:59:22 user nova-compute[75014]:     </disk>
Nov 08 03:59:22 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:59:22 user nova-compute[75014]:       <mac address="fa:16:3e:e1:e9:27"/>
Nov 08 03:59:22 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:59:22 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:59:22 user nova-compute[75014]:       <target dev="tapeb7a20ed-c5"/>
Nov 08 03:59:22 user nova-compute[75014]:     </interface>
Nov 08 03:59:22 user nova-compute[75014]:     <serial type="pty">
Nov 08 03:59:22 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/console.log" append="off"/>
Nov 08 03:59:22 user nova-compute[75014]:     </serial>
Nov 08 03:59:22 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 03:59:22 user nova-compute[75014]:     <video>
Nov 08 03:59:22 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:59:22 user nova-compute[75014]:     </video>
Nov 08 03:59:22 user nova-compute[75014]:     <rng model="virtio">
Nov 08 03:59:22 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 03:59:22 user nova-compute[75014]:     </rng>
Nov 08 03:59:22 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 03:59:22 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 03:59:22 user nova-compute[75014]:       <stats period="10"/>
Nov 08 03:59:22 user nova-compute[75014]:     </memballoon>
Nov 08 03:59:22 user nova-compute[75014]:   </devices>
Nov 08 03:59:22 user nova-compute[75014]: </domain>
Nov 08 03:59:22 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-974517943',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-974517943',id=23,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdPXIOA7/TBoq0/votl12iKLEhI7NRfXy6j2NIlXxKNWayc0DBpjQWW2qoeBSHfSuOgOB6ZxxP+O5TEB48eK0wLHpB0ujWsQOr2xATZarqhcb9XmT1u6oZJjB9db9Gzpw==',key_name='tempest-keypair-275261075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e1d4a398f55459aaa5526ef57b816ab',ramdisk_id='',reservation_id='r-nodg7g02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1223504486',owner_user_name='tempest-TaggedAttachmentsTest-1223504486-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:59:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='685cdd725739412982a0d768ca78b325',uuid=5c23c904-7d83-489c-bb45-04add15c2bf6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f", "address": "fa:16:3e:e1:e9:27", "network": {"id": "aec98e5a-5443-47fc-80ec-7aeaafb548c5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2062049335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e1d4a398f55459aaa5526ef57b816ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb7a20ed-c5", "ovs_interfaceid": "eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Converting VIF {"id": "eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f", "address": "fa:16:3e:e1:e9:27", "network": {"id": "aec98e5a-5443-47fc-80ec-7aeaafb548c5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2062049335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e1d4a398f55459aaa5526ef57b816ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb7a20ed-c5", "ovs_interfaceid": "eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:e9:27,bridge_name='br-int',has_traffic_filtering=True,id=eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f,network=Network(aec98e5a-5443-47fc-80ec-7aeaafb548c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb7a20ed-c5') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG os_vif [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:e9:27,bridge_name='br-int',has_traffic_filtering=True,id=eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f,network=Network(aec98e5a-5443-47fc-80ec-7aeaafb548c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb7a20ed-c5') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '06758f6f-c8f3-5f0d-82db-baf59111823f', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb7a20ed-c5, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb7a20ed-c5, col_values=(('qos', UUID('516af1a5-c0c4-425a-a073-53e656cdf733')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb7a20ed-c5, col_values=(('external_ids', {'iface-id': 'eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:e9:27', 'vm-uuid': '5c23c904-7d83-489c-bb45-04add15c2bf6'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:22 user nova-compute[75014]: INFO os_vif [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:e9:27,bridge_name='br-int',has_traffic_filtering=True,id=eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f,network=Network(aec98e5a-5443-47fc-80ec-7aeaafb548c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb7a20ed-c5')
Nov 08 03:59:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] No BDM found with device name hda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] No VIF found with MAC fa:16:3e:e1:e9:27, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:59:22 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Using config drive
Nov 08 03:59:22 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Creating config drive at /opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk.config
Nov 08 03:59:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7nbx8jb3 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7nbx8jb3" returned: 0 in 0.052s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:23 user nova-compute[75014]: DEBUG nova.compute.manager [req-afbb01bb-1238-4b9d-b77e-fdc9c491e548 req-f02425e3-b3ef-4096-8dc0-605d9fe277a9 service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Received event network-changed-eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:59:23 user nova-compute[75014]: DEBUG nova.compute.manager [req-afbb01bb-1238-4b9d-b77e-fdc9c491e548 req-f02425e3-b3ef-4096-8dc0-605d9fe277a9 service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Refreshing instance network info cache due to event network-changed-eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:59:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-afbb01bb-1238-4b9d-b77e-fdc9c491e548 req-f02425e3-b3ef-4096-8dc0-605d9fe277a9 service nova] Acquiring lock "refresh_cache-5c23c904-7d83-489c-bb45-04add15c2bf6" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:59:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-afbb01bb-1238-4b9d-b77e-fdc9c491e548 req-f02425e3-b3ef-4096-8dc0-605d9fe277a9 service nova] Acquired lock "refresh_cache-5c23c904-7d83-489c-bb45-04add15c2bf6" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:59:23 user nova-compute[75014]: DEBUG nova.network.neutron [req-afbb01bb-1238-4b9d-b77e-fdc9c491e548 req-f02425e3-b3ef-4096-8dc0-605d9fe277a9 service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Refreshing network info cache for port eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:59:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:24 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:24 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:24 user nova-compute[75014]: DEBUG nova.network.neutron [req-afbb01bb-1238-4b9d-b77e-fdc9c491e548 req-f02425e3-b3ef-4096-8dc0-605d9fe277a9 service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Updated VIF entry in instance network info cache for port eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:59:24 user nova-compute[75014]: DEBUG nova.network.neutron [req-afbb01bb-1238-4b9d-b77e-fdc9c491e548 req-f02425e3-b3ef-4096-8dc0-605d9fe277a9 service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Updating instance_info_cache with network_info: [{"id": "eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f", "address": "fa:16:3e:e1:e9:27", "network": {"id": "aec98e5a-5443-47fc-80ec-7aeaafb548c5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2062049335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e1d4a398f55459aaa5526ef57b816ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb7a20ed-c5", "ovs_interfaceid": "eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:59:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-afbb01bb-1238-4b9d-b77e-fdc9c491e548 req-f02425e3-b3ef-4096-8dc0-605d9fe277a9 service nova] Releasing lock "refresh_cache-5c23c904-7d83-489c-bb45-04add15c2bf6" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:59:24 user nova-compute[75014]: DEBUG nova.compute.manager [req-496578bd-9a8b-428f-8f13-86230410a731 req-db6e843e-4c55-4468-9b01-61a6e2ac03b2 service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Received event network-vif-plugged-eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:59:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-496578bd-9a8b-428f-8f13-86230410a731 req-db6e843e-4c55-4468-9b01-61a6e2ac03b2 service nova] Acquiring lock "5c23c904-7d83-489c-bb45-04add15c2bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-496578bd-9a8b-428f-8f13-86230410a731 req-db6e843e-4c55-4468-9b01-61a6e2ac03b2 service nova] Lock "5c23c904-7d83-489c-bb45-04add15c2bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-496578bd-9a8b-428f-8f13-86230410a731 req-db6e843e-4c55-4468-9b01-61a6e2ac03b2 service nova] Lock "5c23c904-7d83-489c-bb45-04add15c2bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:24 user nova-compute[75014]: DEBUG nova.compute.manager [req-496578bd-9a8b-428f-8f13-86230410a731 req-db6e843e-4c55-4468-9b01-61a6e2ac03b2 service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] No waiting events found dispatching network-vif-plugged-eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:59:24 user nova-compute[75014]: WARNING nova.compute.manager [req-496578bd-9a8b-428f-8f13-86230410a731 req-db6e843e-4c55-4468-9b01-61a6e2ac03b2 service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Received unexpected event network-vif-plugged-eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f for instance with vm_state building and task_state spawning.
Nov 08 03:59:24 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:24 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:26 user nova-compute[75014]: DEBUG nova.compute.manager [req-8543a33c-9fdc-45f4-b982-c98b8ee26508 req-b90be694-011f-4e54-b92d-916f04e68f44 service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Received event network-vif-plugged-eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:59:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8543a33c-9fdc-45f4-b982-c98b8ee26508 req-b90be694-011f-4e54-b92d-916f04e68f44 service nova] Acquiring lock "5c23c904-7d83-489c-bb45-04add15c2bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8543a33c-9fdc-45f4-b982-c98b8ee26508 req-b90be694-011f-4e54-b92d-916f04e68f44 service nova] Lock "5c23c904-7d83-489c-bb45-04add15c2bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8543a33c-9fdc-45f4-b982-c98b8ee26508 req-b90be694-011f-4e54-b92d-916f04e68f44 service nova] Lock "5c23c904-7d83-489c-bb45-04add15c2bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:26 user nova-compute[75014]: DEBUG nova.compute.manager [req-8543a33c-9fdc-45f4-b982-c98b8ee26508 req-b90be694-011f-4e54-b92d-916f04e68f44 service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] No waiting events found dispatching network-vif-plugged-eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:59:26 user nova-compute[75014]: WARNING nova.compute.manager [req-8543a33c-9fdc-45f4-b982-c98b8ee26508 req-b90be694-011f-4e54-b92d-916f04e68f44 service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Received unexpected event network-vif-plugged-eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f for instance with vm_state building and task_state spawning.
Nov 08 03:59:26 user nova-compute[75014]: DEBUG nova.compute.manager [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 03:59:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 03:59:26 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Instance spawned successfully.
Nov 08 03:59:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 03:59:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:59:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:59:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:59:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:59:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:59:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:59:26 user nova-compute[75014]: INFO nova.compute.manager [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Took 6.35 seconds to spawn the instance on the hypervisor.
Nov 08 03:59:26 user nova-compute[75014]: DEBUG nova.compute.manager [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:59:26 user nova-compute[75014]: INFO nova.compute.manager [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Took 7.29 seconds to build instance.
Nov 08 03:59:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ade43a90-aa70-4032-b806-36ebdc68f7a2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lock "5c23c904-7d83-489c-bb45-04add15c2bf6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.479s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:28 user nova-compute[75014]: DEBUG nova.compute.manager [req-d889000f-be61-44fb-b029-3ff02cf44fb1 req-851d4e9e-0caf-4780-bec1-a2f25e83a8a7 service nova] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Received event network-changed-fddcd530-d245-4d58-a0ca-59ddc2ac0121 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:59:28 user nova-compute[75014]: DEBUG nova.compute.manager [req-d889000f-be61-44fb-b029-3ff02cf44fb1 req-851d4e9e-0caf-4780-bec1-a2f25e83a8a7 service nova] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Refreshing instance network info cache due to event network-changed-fddcd530-d245-4d58-a0ca-59ddc2ac0121. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:59:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d889000f-be61-44fb-b029-3ff02cf44fb1 req-851d4e9e-0caf-4780-bec1-a2f25e83a8a7 service nova] Acquiring lock "refresh_cache-691bf2a3-13b2-466c-90a3-8dd01dfc18cb" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:59:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d889000f-be61-44fb-b029-3ff02cf44fb1 req-851d4e9e-0caf-4780-bec1-a2f25e83a8a7 service nova] Acquired lock "refresh_cache-691bf2a3-13b2-466c-90a3-8dd01dfc18cb" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:59:28 user nova-compute[75014]: DEBUG nova.network.neutron [req-d889000f-be61-44fb-b029-3ff02cf44fb1 req-851d4e9e-0caf-4780-bec1-a2f25e83a8a7 service nova] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Refreshing network info cache for port fddcd530-d245-4d58-a0ca-59ddc2ac0121 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:59:28 user nova-compute[75014]: DEBUG nova.network.neutron [req-d889000f-be61-44fb-b029-3ff02cf44fb1 req-851d4e9e-0caf-4780-bec1-a2f25e83a8a7 service nova] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Updated VIF entry in instance network info cache for port fddcd530-d245-4d58-a0ca-59ddc2ac0121. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:59:28 user nova-compute[75014]: DEBUG nova.network.neutron [req-d889000f-be61-44fb-b029-3ff02cf44fb1 req-851d4e9e-0caf-4780-bec1-a2f25e83a8a7 service nova] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Updating instance_info_cache with network_info: [{"id": "fddcd530-d245-4d58-a0ca-59ddc2ac0121", "address": "fa:16:3e:27:87:8b", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfddcd530-d2", "ovs_interfaceid": "fddcd530-d245-4d58-a0ca-59ddc2ac0121", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:59:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d889000f-be61-44fb-b029-3ff02cf44fb1 req-851d4e9e-0caf-4780-bec1-a2f25e83a8a7 service nova] Releasing lock "refresh_cache-691bf2a3-13b2-466c-90a3-8dd01dfc18cb" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:59:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "d555b6b3-86ec-40ae-aa20-48846b5157d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "d555b6b3-86ec-40ae-aa20-48846b5157d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:33 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 03:59:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:33 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 03:59:33 user nova-compute[75014]: INFO nova.compute.claims [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Claim successful on node user
Nov 08 03:59:33 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:59:33 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:59:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.621s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:33 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 03:59:33 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 03:59:33 user nova-compute[75014]: DEBUG nova.network.neutron [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 03:59:33 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 03:59:33 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 03:59:34 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Creating image(s)
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "/opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "/opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "/opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "691bf2a3-13b2-466c-90a3-8dd01dfc18cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "691bf2a3-13b2-466c-90a3-8dd01dfc18cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG nova.objects.instance [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lazy-loading 'flavor' on Instance uuid 691bf2a3-13b2-466c-90a3-8dd01dfc18cb {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG nova.policy [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '630b9ba8f1d9471f9cea51f74106381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a182cdeb8543fea1ab24326734991e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "691bf2a3-13b2-466c-90a3-8dd01dfc18cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.226s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "691bf2a3-13b2-466c-90a3-8dd01dfc18cb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "691bf2a3-13b2-466c-90a3-8dd01dfc18cb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:34 user nova-compute[75014]: INFO nova.compute.manager [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Attaching volume 6473b6b6-2ad6-4da7-9799-a570400bdc37 to /dev/vdb
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9a60f989-2e62-4a02-bcbc-0e41697f0b51 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Acquiring lock "e9b9615d-29bf-4a71-adac-180eb1bb8727" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9a60f989-2e62-4a02-bcbc-0e41697f0b51 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lock "e9b9615d-29bf-4a71-adac-180eb1bb8727" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9a60f989-2e62-4a02-bcbc-0e41697f0b51 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Acquiring lock "e9b9615d-29bf-4a71-adac-180eb1bb8727-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9a60f989-2e62-4a02-bcbc-0e41697f0b51 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lock "e9b9615d-29bf-4a71-adac-180eb1bb8727-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9a60f989-2e62-4a02-bcbc-0e41697f0b51 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lock "e9b9615d-29bf-4a71-adac-180eb1bb8727-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:34 user nova-compute[75014]: INFO nova.compute.manager [None req-9a60f989-2e62-4a02-bcbc-0e41697f0b51 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Terminating instance
Nov 08 03:59:34 user nova-compute[75014]: DEBUG nova.compute.manager [None req-9a60f989-2e62-4a02-bcbc-0e41697f0b51 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG os_brick.utils [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb305306-a40b-43e7-b1d4-94f4b984e505]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0228c0fb-3e63-4587-8e09-9463f17ed729]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.229s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[554db7bf-af16-41b9-a4fa-46c70604285c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fab19e6-d6ec-41e6-9c6f-64034fb70ebf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk 1073741824" returned: 0 in 0.063s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.341s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 03:59:34 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7610de2e-b55e-4246-8c07-f38a48aa5155]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG os_brick.utils [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] <== get_connector_properties: return (260ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Updating existing volume attachment record: b2e2ce73-d11f-4997-999c-e70e48746293 {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG nova.network.neutron [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Successfully created port: 611f5c87-6ea2-44f7-95ff-c2a8375bbb76 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.223s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG nova.compute.manager [req-972ae8da-da75-4fc3-8a62-3b5c03991473 req-6686519d-7e20-4571-8d2d-b813540903be service nova] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Received event network-vif-unplugged-51fdb271-ca03-4148-9d9c-a05c8412aaaa {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-972ae8da-da75-4fc3-8a62-3b5c03991473 req-6686519d-7e20-4571-8d2d-b813540903be service nova] Acquiring lock "e9b9615d-29bf-4a71-adac-180eb1bb8727-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-972ae8da-da75-4fc3-8a62-3b5c03991473 req-6686519d-7e20-4571-8d2d-b813540903be service nova] Lock "e9b9615d-29bf-4a71-adac-180eb1bb8727-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-972ae8da-da75-4fc3-8a62-3b5c03991473 req-6686519d-7e20-4571-8d2d-b813540903be service nova] Lock "e9b9615d-29bf-4a71-adac-180eb1bb8727-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG nova.compute.manager [req-972ae8da-da75-4fc3-8a62-3b5c03991473 req-6686519d-7e20-4571-8d2d-b813540903be service nova] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] No waiting events found dispatching network-vif-unplugged-51fdb271-ca03-4148-9d9c-a05c8412aaaa {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:59:34 user nova-compute[75014]: DEBUG nova.compute.manager [req-972ae8da-da75-4fc3-8a62-3b5c03991473 req-6686519d-7e20-4571-8d2d-b813540903be service nova] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Received event network-vif-unplugged-51fdb271-ca03-4148-9d9c-a05c8412aaaa for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Cannot resize image /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Ensure instance console log exists: /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-655fe5eb-1271-4b9f-a5a6-6342bd012a69" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-655fe5eb-1271-4b9f-a5a6-6342bd012a69" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:35 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Instance destroyed successfully.
Nov 08 03:59:35 user nova-compute[75014]: DEBUG nova.objects.instance [None req-9a60f989-2e62-4a02-bcbc-0e41697f0b51 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lazy-loading 'resources' on Instance uuid e9b9615d-29bf-4a71-adac-180eb1bb8727 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-9a60f989-2e62-4a02-bcbc-0e41697f0b51 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:57:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-729698497',display_name='tempest-VolumesActionsTest-instance-729698497',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-729698497',id=18,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:57:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a77d1e7a3adc430ab1a17b1c954db9a4',ramdisk_id='',reservation_id='r-atxy6hph',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-158235265',owner_user_name='tempest-VolumesActionsTest-158235265-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T03:57:53Z,user_data=None,user_id='2952d351dfab46f2bd6caa61d6d59540',uuid=e9b9615d-29bf-4a71-adac-180eb1bb8727,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51fdb271-ca03-4148-9d9c-a05c8412aaaa", "address": "fa:16:3e:9c:a3:b7", "network": {"id": "8ee4c37f-4f4b-4886-9824-d394b2d3d49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-754640303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77d1e7a3adc430ab1a17b1c954db9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fdb271-ca", "ovs_interfaceid": "51fdb271-ca03-4148-9d9c-a05c8412aaaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-9a60f989-2e62-4a02-bcbc-0e41697f0b51 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Converting VIF {"id": "51fdb271-ca03-4148-9d9c-a05c8412aaaa", "address": "fa:16:3e:9c:a3:b7", "network": {"id": "8ee4c37f-4f4b-4886-9824-d394b2d3d49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-754640303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77d1e7a3adc430ab1a17b1c954db9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fdb271-ca", "ovs_interfaceid": "51fdb271-ca03-4148-9d9c-a05c8412aaaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-9a60f989-2e62-4a02-bcbc-0e41697f0b51 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:a3:b7,bridge_name='br-int',has_traffic_filtering=True,id=51fdb271-ca03-4148-9d9c-a05c8412aaaa,network=Network(8ee4c37f-4f4b-4886-9824-d394b2d3d49d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51fdb271-ca') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG os_vif [None req-9a60f989-2e62-4a02-bcbc-0e41697f0b51 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:a3:b7,bridge_name='br-int',has_traffic_filtering=True,id=51fdb271-ca03-4148-9d9c-a05c8412aaaa,network=Network(8ee4c37f-4f4b-4886-9824-d394b2d3d49d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51fdb271-ca') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51fdb271-ca, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f0c68415-2d5e-4a14-80aa-9fd4d0ebd0b1) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:35 user nova-compute[75014]: INFO os_vif [None req-9a60f989-2e62-4a02-bcbc-0e41697f0b51 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:a3:b7,bridge_name='br-int',has_traffic_filtering=True,id=51fdb271-ca03-4148-9d9c-a05c8412aaaa,network=Network(8ee4c37f-4f4b-4886-9824-d394b2d3d49d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51fdb271-ca')
Nov 08 03:59:35 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-9a60f989-2e62-4a02-bcbc-0e41697f0b51 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Deleting instance files /opt/stack/data/nova/instances/e9b9615d-29bf-4a71-adac-180eb1bb8727_del
Nov 08 03:59:35 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-9a60f989-2e62-4a02-bcbc-0e41697f0b51 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Deletion of /opt/stack/data/nova/instances/e9b9615d-29bf-4a71-adac-180eb1bb8727_del complete
Nov 08 03:59:35 user nova-compute[75014]: INFO nova.compute.manager [None req-9a60f989-2e62-4a02-bcbc-0e41697f0b51 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 08 03:59:35 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-9a60f989-2e62-4a02-bcbc-0e41697f0b51 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Updating instance_info_cache with network_info: [{"id": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "address": "fa:16:3e:65:33:45", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9034975-10", "ovs_interfaceid": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-655fe5eb-1271-4b9f-a5a6-6342bd012a69" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:59:35 user nova-compute[75014]: DEBUG nova.compute.manager [req-e6502a9b-d401-4a34-be40-7372bbbc1c7a req-8ddcfa33-6c15-4dda-9357-e53bdd4fe34c service nova] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Received event network-vif-deleted-51fdb271-ca03-4148-9d9c-a05c8412aaaa {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:59:35 user nova-compute[75014]: INFO nova.compute.manager [req-e6502a9b-d401-4a34-be40-7372bbbc1c7a req-8ddcfa33-6c15-4dda-9357-e53bdd4fe34c service nova] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Neutron deleted interface 51fdb271-ca03-4148-9d9c-a05c8412aaaa; detaching it from the instance and deleting it from the info cache
Nov 08 03:59:35 user nova-compute[75014]: DEBUG nova.network.neutron [req-e6502a9b-d401-4a34-be40-7372bbbc1c7a req-8ddcfa33-6c15-4dda-9357-e53bdd4fe34c service nova] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:59:35 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Took 0.67 seconds to deallocate network for instance.
Nov 08 03:59:35 user nova-compute[75014]: DEBUG nova.compute.manager [req-e6502a9b-d401-4a34-be40-7372bbbc1c7a req-8ddcfa33-6c15-4dda-9357-e53bdd4fe34c service nova] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Detach interface failed, port_id=51fdb271-ca03-4148-9d9c-a05c8412aaaa, reason: Instance e9b9615d-29bf-4a71-adac-180eb1bb8727 could not be found. {{(pid=75014) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.network.neutron [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Successfully updated port: 611f5c87-6ea2-44f7-95ff-c2a8375bbb76 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "refresh_cache-d555b6b3-86ec-40ae-aa20-48846b5157d5" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquired lock "refresh_cache-d555b6b3-86ec-40ae-aa20-48846b5157d5" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.network.neutron [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9a60f989-2e62-4a02-bcbc-0e41697f0b51 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9a60f989-2e62-4a02-bcbc-0e41697f0b51 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.network.neutron [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.network.neutron [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Updating instance_info_cache with network_info: [{"id": "611f5c87-6ea2-44f7-95ff-c2a8375bbb76", "address": "fa:16:3e:1b:8a:50", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap611f5c87-6e", "ovs_interfaceid": "611f5c87-6ea2-44f7-95ff-c2a8375bbb76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Releasing lock "refresh_cache-d555b6b3-86ec-40ae-aa20-48846b5157d5" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Instance network_info: |[{"id": "611f5c87-6ea2-44f7-95ff-c2a8375bbb76", "address": "fa:16:3e:1b:8a:50", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap611f5c87-6e", "ovs_interfaceid": "611f5c87-6ea2-44f7-95ff-c2a8375bbb76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Start _get_guest_xml network_info=[{"id": "611f5c87-6ea2-44f7-95ff-c2a8375bbb76", "address": "fa:16:3e:1b:8a:50", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap611f5c87-6e", "ovs_interfaceid": "611f5c87-6ea2-44f7-95ff-c2a8375bbb76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 03:59:36 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:59:36 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:59:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-348183258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-348183258',id=24,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92a182cdeb8543fea1ab24326734991e',ramdisk_id='',reservation_id='r-qlshhsjx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648299000',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:59:34Z,user_data=None,user_id='630b9ba8f1d9471f9cea51f74106381a',uuid=d555b6b3-86ec-40ae-aa20-48846b5157d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "611f5c87-6ea2-44f7-95ff-c2a8375bbb76", "address": "fa:16:3e:1b:8a:50", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap611f5c87-6e", "ovs_interfaceid": "611f5c87-6ea2-44f7-95ff-c2a8375bbb76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Converting VIF {"id": "611f5c87-6ea2-44f7-95ff-c2a8375bbb76", "address": "fa:16:3e:1b:8a:50", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap611f5c87-6e", "ovs_interfaceid": "611f5c87-6ea2-44f7-95ff-c2a8375bbb76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:8a:50,bridge_name='br-int',has_traffic_filtering=True,id=611f5c87-6ea2-44f7-95ff-c2a8375bbb76,network=Network(d45dbf14-9570-46c1-91a3-cbe2f7972b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap611f5c87-6e') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.objects.instance [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lazy-loading 'pci_devices' on Instance uuid d555b6b3-86ec-40ae-aa20-48846b5157d5 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] End _get_guest_xml xml=<domain type="kvm">
Nov 08 03:59:36 user nova-compute[75014]:   <uuid>d555b6b3-86ec-40ae-aa20-48846b5157d5</uuid>
Nov 08 03:59:36 user nova-compute[75014]:   <name>instance-00000018</name>
Nov 08 03:59:36 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 03:59:36 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 03:59:36 user nova-compute[75014]:   <metadata>
Nov 08 03:59:36 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 03:59:36 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 03:59:36 user nova-compute[75014]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-348183258</nova:name>
Nov 08 03:59:36 user nova-compute[75014]:       <nova:creationTime>2023-11-08 03:59:36</nova:creationTime>
Nov 08 03:59:36 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 03:59:36 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 03:59:36 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 03:59:36 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 03:59:36 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 03:59:36 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 03:59:36 user nova-compute[75014]:       </nova:flavor>
Nov 08 03:59:36 user nova-compute[75014]:       <nova:owner>
Nov 08 03:59:36 user nova-compute[75014]:         <nova:user uuid="630b9ba8f1d9471f9cea51f74106381a">tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member</nova:user>
Nov 08 03:59:36 user nova-compute[75014]:         <nova:project uuid="92a182cdeb8543fea1ab24326734991e">tempest-ServerBootFromVolumeStableRescueTest-1648299000</nova:project>
Nov 08 03:59:36 user nova-compute[75014]:       </nova:owner>
Nov 08 03:59:36 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 03:59:36 user nova-compute[75014]:       <nova:ports>
Nov 08 03:59:36 user nova-compute[75014]:         <nova:port uuid="611f5c87-6ea2-44f7-95ff-c2a8375bbb76">
Nov 08 03:59:36 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 03:59:36 user nova-compute[75014]:         </nova:port>
Nov 08 03:59:36 user nova-compute[75014]:       </nova:ports>
Nov 08 03:59:36 user nova-compute[75014]:     </nova:instance>
Nov 08 03:59:36 user nova-compute[75014]:   </metadata>
Nov 08 03:59:36 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 03:59:36 user nova-compute[75014]:     <system>
Nov 08 03:59:36 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 03:59:36 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 03:59:36 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 03:59:36 user nova-compute[75014]:       <entry name="serial">d555b6b3-86ec-40ae-aa20-48846b5157d5</entry>
Nov 08 03:59:36 user nova-compute[75014]:       <entry name="uuid">d555b6b3-86ec-40ae-aa20-48846b5157d5</entry>
Nov 08 03:59:36 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 03:59:36 user nova-compute[75014]:     </system>
Nov 08 03:59:36 user nova-compute[75014]:   </sysinfo>
Nov 08 03:59:36 user nova-compute[75014]:   <os>
Nov 08 03:59:36 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 03:59:36 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 03:59:36 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 03:59:36 user nova-compute[75014]:   </os>
Nov 08 03:59:36 user nova-compute[75014]:   <features>
Nov 08 03:59:36 user nova-compute[75014]:     <acpi/>
Nov 08 03:59:36 user nova-compute[75014]:     <apic/>
Nov 08 03:59:36 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 03:59:36 user nova-compute[75014]:   </features>
Nov 08 03:59:36 user nova-compute[75014]:   <clock offset="utc">
Nov 08 03:59:36 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 03:59:36 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 03:59:36 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 03:59:36 user nova-compute[75014]:   </clock>
Nov 08 03:59:36 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 03:59:36 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 03:59:36 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 03:59:36 user nova-compute[75014]:   </cpu>
Nov 08 03:59:36 user nova-compute[75014]:   <devices>
Nov 08 03:59:36 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 03:59:36 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 03:59:36 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk"/>
Nov 08 03:59:36 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 03:59:36 user nova-compute[75014]:     </disk>
Nov 08 03:59:36 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 03:59:36 user nova-compute[75014]:       <mac address="fa:16:3e:1b:8a:50"/>
Nov 08 03:59:36 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:59:36 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 03:59:36 user nova-compute[75014]:       <target dev="tap611f5c87-6e"/>
Nov 08 03:59:36 user nova-compute[75014]:     </interface>
Nov 08 03:59:36 user nova-compute[75014]:     <serial type="pty">
Nov 08 03:59:36 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/console.log" append="off"/>
Nov 08 03:59:36 user nova-compute[75014]:     </serial>
Nov 08 03:59:36 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 03:59:36 user nova-compute[75014]:     <video>
Nov 08 03:59:36 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 03:59:36 user nova-compute[75014]:     </video>
Nov 08 03:59:36 user nova-compute[75014]:     <rng model="virtio">
Nov 08 03:59:36 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 03:59:36 user nova-compute[75014]:     </rng>
Nov 08 03:59:36 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 03:59:36 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 03:59:36 user nova-compute[75014]:       <stats period="10"/>
Nov 08 03:59:36 user nova-compute[75014]:     </memballoon>
Nov 08 03:59:36 user nova-compute[75014]:   </devices>
Nov 08 03:59:36 user nova-compute[75014]: </domain>
Nov 08 03:59:36 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:59:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-348183258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-348183258',id=24,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92a182cdeb8543fea1ab24326734991e',ramdisk_id='',reservation_id='r-qlshhsjx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648299000',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:59:34Z,user_data=None,user_id='630b9ba8f1d9471f9cea51f74106381a',uuid=d555b6b3-86ec-40ae-aa20-48846b5157d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "611f5c87-6ea2-44f7-95ff-c2a8375bbb76", "address": "fa:16:3e:1b:8a:50", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap611f5c87-6e", "ovs_interfaceid": "611f5c87-6ea2-44f7-95ff-c2a8375bbb76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Converting VIF {"id": "611f5c87-6ea2-44f7-95ff-c2a8375bbb76", "address": "fa:16:3e:1b:8a:50", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap611f5c87-6e", "ovs_interfaceid": "611f5c87-6ea2-44f7-95ff-c2a8375bbb76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:8a:50,bridge_name='br-int',has_traffic_filtering=True,id=611f5c87-6ea2-44f7-95ff-c2a8375bbb76,network=Network(d45dbf14-9570-46c1-91a3-cbe2f7972b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap611f5c87-6e') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG os_vif [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:8a:50,bridge_name='br-int',has_traffic_filtering=True,id=611f5c87-6ea2-44f7-95ff-c2a8375bbb76,network=Network(d45dbf14-9570-46c1-91a3-cbe2f7972b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap611f5c87-6e') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ada4d32-4f9a-54a8-ba20-e71e733d7483', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap611f5c87-6e, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap611f5c87-6e, col_values=(('qos', UUID('610de61c-28cd-4b1e-8c38-3bb67ec707d8')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap611f5c87-6e, col_values=(('external_ids', {'iface-id': '611f5c87-6ea2-44f7-95ff-c2a8375bbb76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:8a:50', 'vm-uuid': 'd555b6b3-86ec-40ae-aa20-48846b5157d5'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:36 user nova-compute[75014]: INFO os_vif [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:8a:50,bridge_name='br-int',has_traffic_filtering=True,id=611f5c87-6ea2-44f7-95ff-c2a8375bbb76,network=Network(d45dbf14-9570-46c1-91a3-cbe2f7972b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap611f5c87-6e')
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-9a60f989-2e62-4a02-bcbc-0e41697f0b51 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] No VIF found with MAC fa:16:3e:1b:8a:50, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-9a60f989-2e62-4a02-bcbc-0e41697f0b51 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9a60f989-2e62-4a02-bcbc-0e41697f0b51 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.740s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:36 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-9a60f989-2e62-4a02-bcbc-0e41697f0b51 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Deleted allocations for instance e9b9615d-29bf-4a71-adac-180eb1bb8727
Nov 08 03:59:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.compute.manager [req-44864dae-0a27-4d9b-b802-e5d6b4eb42bb req-d8f240ae-eb6a-418d-9c2c-5965e71cfd39 service nova] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Received event network-vif-plugged-51fdb271-ca03-4148-9d9c-a05c8412aaaa {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-44864dae-0a27-4d9b-b802-e5d6b4eb42bb req-d8f240ae-eb6a-418d-9c2c-5965e71cfd39 service nova] Acquiring lock "e9b9615d-29bf-4a71-adac-180eb1bb8727-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-44864dae-0a27-4d9b-b802-e5d6b4eb42bb req-d8f240ae-eb6a-418d-9c2c-5965e71cfd39 service nova] Lock "e9b9615d-29bf-4a71-adac-180eb1bb8727-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-44864dae-0a27-4d9b-b802-e5d6b4eb42bb req-d8f240ae-eb6a-418d-9c2c-5965e71cfd39 service nova] Lock "e9b9615d-29bf-4a71-adac-180eb1bb8727-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.compute.manager [req-44864dae-0a27-4d9b-b802-e5d6b4eb42bb req-d8f240ae-eb6a-418d-9c2c-5965e71cfd39 service nova] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] No waiting events found dispatching network-vif-plugged-51fdb271-ca03-4148-9d9c-a05c8412aaaa {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:59:36 user nova-compute[75014]: WARNING nova.compute.manager [req-44864dae-0a27-4d9b-b802-e5d6b4eb42bb req-d8f240ae-eb6a-418d-9c2c-5965e71cfd39 service nova] [instance: e9b9615d-29bf-4a71-adac-180eb1bb8727] Received unexpected event network-vif-plugged-51fdb271-ca03-4148-9d9c-a05c8412aaaa for instance with vm_state deleted and task_state None.
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.compute.manager [req-44864dae-0a27-4d9b-b802-e5d6b4eb42bb req-d8f240ae-eb6a-418d-9c2c-5965e71cfd39 service nova] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Received event network-changed-611f5c87-6ea2-44f7-95ff-c2a8375bbb76 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.compute.manager [req-44864dae-0a27-4d9b-b802-e5d6b4eb42bb req-d8f240ae-eb6a-418d-9c2c-5965e71cfd39 service nova] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Refreshing instance network info cache due to event network-changed-611f5c87-6ea2-44f7-95ff-c2a8375bbb76. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-44864dae-0a27-4d9b-b802-e5d6b4eb42bb req-d8f240ae-eb6a-418d-9c2c-5965e71cfd39 service nova] Acquiring lock "refresh_cache-d555b6b3-86ec-40ae-aa20-48846b5157d5" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-44864dae-0a27-4d9b-b802-e5d6b4eb42bb req-d8f240ae-eb6a-418d-9c2c-5965e71cfd39 service nova] Acquired lock "refresh_cache-d555b6b3-86ec-40ae-aa20-48846b5157d5" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:59:36 user nova-compute[75014]: DEBUG nova.network.neutron [req-44864dae-0a27-4d9b-b802-e5d6b4eb42bb req-d8f240ae-eb6a-418d-9c2c-5965e71cfd39 service nova] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Refreshing network info cache for port 611f5c87-6ea2-44f7-95ff-c2a8375bbb76 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:59:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:37 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 03:59:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9a60f989-2e62-4a02-bcbc-0e41697f0b51 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lock "e9b9615d-29bf-4a71-adac-180eb1bb8727" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.721s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:37 user nova-compute[75014]: DEBUG nova.network.neutron [req-44864dae-0a27-4d9b-b802-e5d6b4eb42bb req-d8f240ae-eb6a-418d-9c2c-5965e71cfd39 service nova] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Updated VIF entry in instance network info cache for port 611f5c87-6ea2-44f7-95ff-c2a8375bbb76. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:59:37 user nova-compute[75014]: DEBUG nova.network.neutron [req-44864dae-0a27-4d9b-b802-e5d6b4eb42bb req-d8f240ae-eb6a-418d-9c2c-5965e71cfd39 service nova] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Updating instance_info_cache with network_info: [{"id": "611f5c87-6ea2-44f7-95ff-c2a8375bbb76", "address": "fa:16:3e:1b:8a:50", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap611f5c87-6e", "ovs_interfaceid": "611f5c87-6ea2-44f7-95ff-c2a8375bbb76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:59:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-44864dae-0a27-4d9b-b802-e5d6b4eb42bb req-d8f240ae-eb6a-418d-9c2c-5965e71cfd39 service nova] Releasing lock "refresh_cache-d555b6b3-86ec-40ae-aa20-48846b5157d5" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:59:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:38 user nova-compute[75014]: DEBUG nova.compute.manager [req-6b19af22-88bf-4574-8545-f2f4e2e8dc75 req-bc222266-7fbf-423b-8265-41709c26ffa3 service nova] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Received event network-vif-plugged-611f5c87-6ea2-44f7-95ff-c2a8375bbb76 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:59:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-6b19af22-88bf-4574-8545-f2f4e2e8dc75 req-bc222266-7fbf-423b-8265-41709c26ffa3 service nova] Acquiring lock "d555b6b3-86ec-40ae-aa20-48846b5157d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-6b19af22-88bf-4574-8545-f2f4e2e8dc75 req-bc222266-7fbf-423b-8265-41709c26ffa3 service nova] Lock "d555b6b3-86ec-40ae-aa20-48846b5157d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-6b19af22-88bf-4574-8545-f2f4e2e8dc75 req-bc222266-7fbf-423b-8265-41709c26ffa3 service nova] Lock "d555b6b3-86ec-40ae-aa20-48846b5157d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:38 user nova-compute[75014]: DEBUG nova.compute.manager [req-6b19af22-88bf-4574-8545-f2f4e2e8dc75 req-bc222266-7fbf-423b-8265-41709c26ffa3 service nova] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] No waiting events found dispatching network-vif-plugged-611f5c87-6ea2-44f7-95ff-c2a8375bbb76 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:59:38 user nova-compute[75014]: WARNING nova.compute.manager [req-6b19af22-88bf-4574-8545-f2f4e2e8dc75 req-bc222266-7fbf-423b-8265-41709c26ffa3 service nova] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Received unexpected event network-vif-plugged-611f5c87-6ea2-44f7-95ff-c2a8375bbb76 for instance with vm_state building and task_state spawning.
Nov 08 03:59:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 03:59:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json" returned: 0 in 0.242s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:40 user nova-compute[75014]: DEBUG nova.compute.manager [req-2d78f1b5-d196-4975-b614-d1f98ba5c886 req-30ba1ba8-2237-4ae9-b39d-4e2cd7453431 service nova] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Received event network-vif-plugged-611f5c87-6ea2-44f7-95ff-c2a8375bbb76 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:59:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2d78f1b5-d196-4975-b614-d1f98ba5c886 req-30ba1ba8-2237-4ae9-b39d-4e2cd7453431 service nova] Acquiring lock "d555b6b3-86ec-40ae-aa20-48846b5157d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2d78f1b5-d196-4975-b614-d1f98ba5c886 req-30ba1ba8-2237-4ae9-b39d-4e2cd7453431 service nova] Lock "d555b6b3-86ec-40ae-aa20-48846b5157d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2d78f1b5-d196-4975-b614-d1f98ba5c886 req-30ba1ba8-2237-4ae9-b39d-4e2cd7453431 service nova] Lock "d555b6b3-86ec-40ae-aa20-48846b5157d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:40 user nova-compute[75014]: DEBUG nova.compute.manager [req-2d78f1b5-d196-4975-b614-d1f98ba5c886 req-30ba1ba8-2237-4ae9-b39d-4e2cd7453431 service nova] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] No waiting events found dispatching network-vif-plugged-611f5c87-6ea2-44f7-95ff-c2a8375bbb76 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 03:59:40 user nova-compute[75014]: WARNING nova.compute.manager [req-2d78f1b5-d196-4975-b614-d1f98ba5c886 req-30ba1ba8-2237-4ae9-b39d-4e2cd7453431 service nova] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Received unexpected event network-vif-plugged-611f5c87-6ea2-44f7-95ff-c2a8375bbb76 for instance with vm_state building and task_state spawning.
Nov 08 03:59:40 user nova-compute[75014]: DEBUG nova.compute.manager [req-2d78f1b5-d196-4975-b614-d1f98ba5c886 req-30ba1ba8-2237-4ae9-b39d-4e2cd7453431 service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Received event network-changed-0ce8dc6f-2116-4163-8c05-2e3519724ee7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 03:59:40 user nova-compute[75014]: DEBUG nova.compute.manager [req-2d78f1b5-d196-4975-b614-d1f98ba5c886 req-30ba1ba8-2237-4ae9-b39d-4e2cd7453431 service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Refreshing instance network info cache due to event network-changed-0ce8dc6f-2116-4163-8c05-2e3519724ee7. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 03:59:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2d78f1b5-d196-4975-b614-d1f98ba5c886 req-30ba1ba8-2237-4ae9-b39d-4e2cd7453431 service nova] Acquiring lock "refresh_cache-79dea88d-f5cd-4e8b-a98b-01af128f35ed" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 03:59:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2d78f1b5-d196-4975-b614-d1f98ba5c886 req-30ba1ba8-2237-4ae9-b39d-4e2cd7453431 service nova] Acquired lock "refresh_cache-79dea88d-f5cd-4e8b-a98b-01af128f35ed" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 03:59:40 user nova-compute[75014]: DEBUG nova.network.neutron [req-2d78f1b5-d196-4975-b614-d1f98ba5c886 req-30ba1ba8-2237-4ae9-b39d-4e2cd7453431 service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Refreshing network info cache for port 0ce8dc6f-2116-4163-8c05-2e3519724ee7 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 03:59:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:40 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 03:59:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 03:59:40 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Instance spawned successfully.
Nov 08 03:59:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 03:59:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:59:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:59:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:59:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:59:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:59:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 03:59:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 03:59:40 user nova-compute[75014]: INFO nova.compute.manager [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Took 6.66 seconds to spawn the instance on the hypervisor.
Nov 08 03:59:40 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 03:59:40 user nova-compute[75014]: INFO nova.compute.manager [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Took 7.70 seconds to build instance.
Nov 08 03:59:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 03:59:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a70d4976-b5f9-4862-a097-e5daebbf87e6 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "d555b6b3-86ec-40ae-aa20-48846b5157d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.801s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:41 user nova-compute[75014]: DEBUG nova.network.neutron [req-2d78f1b5-d196-4975-b614-d1f98ba5c886 req-30ba1ba8-2237-4ae9-b39d-4e2cd7453431 service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Updated VIF entry in instance network info cache for port 0ce8dc6f-2116-4163-8c05-2e3519724ee7. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 03:59:41 user nova-compute[75014]: DEBUG nova.network.neutron [req-2d78f1b5-d196-4975-b614-d1f98ba5c886 req-30ba1ba8-2237-4ae9-b39d-4e2cd7453431 service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Updating instance_info_cache with network_info: [{"id": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "address": "fa:16:3e:e4:5b:42", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce8dc6f-21", "ovs_interfaceid": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 03:59:41 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:59:41 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 03:59:41 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=7215MB free_disk=25.023338317871094GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 03:59:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 03:59:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 03:59:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2d78f1b5-d196-4975-b614-d1f98ba5c886 req-30ba1ba8-2237-4ae9-b39d-4e2cd7453431 service nova] Releasing lock "refresh_cache-79dea88d-f5cd-4e8b-a98b-01af128f35ed" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 03:59:41 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9f205fe5-576f-4ef0-874b-1544c0307a7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:59:41 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 5bfa6580-e0fe-46b0-b497-8db67806113a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:59:41 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 8527ee40-fb8a-469b-9696-d7bde8cc96f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:59:41 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 655fe5eb-1271-4b9f-a5a6-6342bd012a69 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:59:41 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance af246bb7-2e77-469b-bf98-cf05b467255c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:59:41 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance bd153f84-98cd-4c6d-a7ab-5759b0b5bf55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:59:41 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 691bf2a3-13b2-466c-90a3-8dd01dfc18cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:59:41 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 79dea88d-f5cd-4e8b-a98b-01af128f35ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:59:41 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:59:41 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance d4726cd1-51ea-41e2-ad36-be12b4d4c26b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:59:41 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 44d4794d-91c4-4eb6-a752-37f587f2b420 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:59:41 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 5c23c904-7d83-489c-bb45-04add15c2bf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:59:41 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance d555b6b3-86ec-40ae-aa20-48846b5157d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 03:59:41 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 03:59:41 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 03:59:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:41 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 03:59:41 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 03:59:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:41 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 03:59:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.626s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 03:59:46 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:46 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 03:59:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZIzTkPtd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:00:02 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:00:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:00:02 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:00:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:00:02 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:00:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abef031-c6ef-40c6-b73d-22e476345c8b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:00:02 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ef6d44-cd5c-41c3-8c2c-fec3b009071d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37] added
Nov 08 04:00:02 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a945df-7d26-45c1-b5d4-4773c7c9be22]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1363c9b-21c0-418a-8aa9-b4f6366eefae]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZIzTkPtd {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZIzTkPtd" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b416fc5-2520-41d0-8a34-3ed12cab8be8]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZIzTkPtd'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdfd7e8-905f-4b22-bd56-8e87109d65b4]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8db816-1748-486e-ba5c-864df9bca8dc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:00:02 user nova-compute[75014]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 (non-flash)
Nov 08 04:00:02 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:00:02 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:00:02 user nova-compute[75014]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 (non-flash)
Nov 08 04:00:02 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:00:02 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[577fca0a-ddee-4a87-a060-e0f1d1317858]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37, portal: 172.16.0.220,3260]
Nov 08 04:00:02 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37, portal: 172.16.0.220,3260] successful.
Nov 08 04:00:02 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[27766b52-b926-47ec-9206-194c0fde46e7]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:00:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:03 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:03 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8919425c-f8b8-47e0-8484-853730b7530d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:03 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:00:03 user nova-compute[75014]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 (non-flash)
Nov 08 04:00:03 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:00:03 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:00:03 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:00:03 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:00:03 user nova-compute[75014]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 (non-flash)
Nov 08 04:00:03 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:00:03 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:00:03 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:00:03 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:00:03 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:00:03 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:00:03 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:00:03 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:03 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:03 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1197a146-2c55-45f3-a7e7-6bff8b38ef0e]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:03 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:00:03 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZIzTkPtd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:00:04 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:00:04 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23461313164633731', 'path': '/dev/sdd'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:00:04 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461313164633731', 'path': '/dev/sdd'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:00:04 user nova-compute[75014]: DEBUG nova.objects.instance [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lazy-loading 'flavor' on Instance uuid 691bf2a3-13b2-466c-90a3-8dd01dfc18cb {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:00:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:04 user nova-compute[75014]: INFO nova.compute.manager [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Shelving
Nov 08 04:00:04 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 04:00:04 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:00:04 user nova-compute[75014]:   <source dev="/dev/sdd"/>
Nov 08 04:00:04 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:00:04 user nova-compute[75014]:   <serial>6473b6b6-2ad6-4da7-9799-a570400bdc37</serial>
Nov 08 04:00:04 user nova-compute[75014]: </disk>
Nov 08 04:00:04 user nova-compute[75014]:  {{(pid=75014) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 04:00:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:04 user nova-compute[75014]: DEBUG nova.compute.manager [req-765a229a-ccc8-47f8-95d3-b63ba691ca3a req-a8aaa9c3-285f-4bb7-8b29-5cec50d4a0a9 service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Received event network-vif-unplugged-0ce8dc6f-2116-4163-8c05-2e3519724ee7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:00:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-765a229a-ccc8-47f8-95d3-b63ba691ca3a req-a8aaa9c3-285f-4bb7-8b29-5cec50d4a0a9 service nova] Acquiring lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-765a229a-ccc8-47f8-95d3-b63ba691ca3a req-a8aaa9c3-285f-4bb7-8b29-5cec50d4a0a9 service nova] Lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-765a229a-ccc8-47f8-95d3-b63ba691ca3a req-a8aaa9c3-285f-4bb7-8b29-5cec50d4a0a9 service nova] Lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:04 user nova-compute[75014]: DEBUG nova.compute.manager [req-765a229a-ccc8-47f8-95d3-b63ba691ca3a req-a8aaa9c3-285f-4bb7-8b29-5cec50d4a0a9 service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] No waiting events found dispatching network-vif-unplugged-0ce8dc6f-2116-4163-8c05-2e3519724ee7 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:00:04 user nova-compute[75014]: WARNING nova.compute.manager [req-765a229a-ccc8-47f8-95d3-b63ba691ca3a req-a8aaa9c3-285f-4bb7-8b29-5cec50d4a0a9 service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Received unexpected event network-vif-unplugged-0ce8dc6f-2116-4163-8c05-2e3519724ee7 for instance with vm_state active and task_state shelving.
Nov 08 04:00:04 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:00:04 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:00:04 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] No VIF found with MAC fa:16:3e:27:87:8b, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:00:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-88eb8a3f-9493-4099-9e18-d5c9891c1a9b tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "691bf2a3-13b2-466c-90a3-8dd01dfc18cb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.392s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:04 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Instance destroyed successfully.
Nov 08 04:00:04 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Beginning cold snapshot process
Nov 08 04:00:05 user nova-compute[75014]: DEBUG nova.privsep.utils [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75014) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 04:00:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk /opt/stack/data/nova/instances/snapshots/tmpb6c37l8f/aea59cf5e8234712b6ff77088ca88d87 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:06 user nova-compute[75014]: DEBUG nova.compute.manager [req-5c64d9fd-1e5b-42cc-9e7f-deaff9c10935 req-7ad422f2-dbe0-4c21-9806-be7184c8df62 service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Received event network-vif-plugged-0ce8dc6f-2116-4163-8c05-2e3519724ee7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:00:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5c64d9fd-1e5b-42cc-9e7f-deaff9c10935 req-7ad422f2-dbe0-4c21-9806-be7184c8df62 service nova] Acquiring lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5c64d9fd-1e5b-42cc-9e7f-deaff9c10935 req-7ad422f2-dbe0-4c21-9806-be7184c8df62 service nova] Lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5c64d9fd-1e5b-42cc-9e7f-deaff9c10935 req-7ad422f2-dbe0-4c21-9806-be7184c8df62 service nova] Lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:06 user nova-compute[75014]: DEBUG nova.compute.manager [req-5c64d9fd-1e5b-42cc-9e7f-deaff9c10935 req-7ad422f2-dbe0-4c21-9806-be7184c8df62 service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] No waiting events found dispatching network-vif-plugged-0ce8dc6f-2116-4163-8c05-2e3519724ee7 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:00:06 user nova-compute[75014]: WARNING nova.compute.manager [req-5c64d9fd-1e5b-42cc-9e7f-deaff9c10935 req-7ad422f2-dbe0-4c21-9806-be7184c8df62 service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Received unexpected event network-vif-plugged-0ce8dc6f-2116-4163-8c05-2e3519724ee7 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 08 04:00:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk /opt/stack/data/nova/instances/snapshots/tmpb6c37l8f/aea59cf5e8234712b6ff77088ca88d87" returned: 0 in 1.806s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:07 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Snapshot extracted, beginning image upload
Nov 08 04:00:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "94391dc2-758d-483f-a814-a2ab46e8b033" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "94391dc2-758d-483f-a814-a2ab46e8b033" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:08 user nova-compute[75014]: DEBUG nova.compute.manager [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 04:00:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:09 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 04:00:09 user nova-compute[75014]: INFO nova.compute.claims [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Claim successful on node user
Nov 08 04:00:09 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:00:09 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:00:09 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Snapshot image upload complete
Nov 08 04:00:09 user nova-compute[75014]: DEBUG nova.compute.manager [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:00:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:09 user nova-compute[75014]: DEBUG nova.compute.manager [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 04:00:09 user nova-compute[75014]: DEBUG nova.compute.manager [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 04:00:09 user nova-compute[75014]: DEBUG nova.network.neutron [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 04:00:09 user nova-compute[75014]: INFO nova.compute.manager [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Shelve offloading
Nov 08 04:00:09 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 04:00:09 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Instance destroyed successfully.
Nov 08 04:00:09 user nova-compute[75014]: DEBUG nova.compute.manager [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:00:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "refresh_cache-79dea88d-f5cd-4e8b-a98b-01af128f35ed" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:00:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquired lock "refresh_cache-79dea88d-f5cd-4e8b-a98b-01af128f35ed" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:00:09 user nova-compute[75014]: DEBUG nova.network.neutron [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:00:09 user nova-compute[75014]: DEBUG nova.compute.manager [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 04:00:09 user nova-compute[75014]: DEBUG nova.policy [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c8c674d8b2cf49c08cf254a8095ef8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c9753cb588478a8a93182be3256674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 04:00:09 user nova-compute[75014]: DEBUG nova.compute.manager [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 04:00:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 04:00:09 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Creating image(s)
Nov 08 04:00:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "/opt/stack/data/nova/instances/94391dc2-758d-483f-a814-a2ab46e8b033/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "/opt/stack/data/nova/instances/94391dc2-758d-483f-a814-a2ab46e8b033/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "/opt/stack/data/nova/instances/94391dc2-758d-483f-a814-a2ab46e8b033/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.201s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG nova.network.neutron [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Updating instance_info_cache with network_info: [{"id": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "address": "fa:16:3e:e4:5b:42", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce8dc6f-21", "ovs_interfaceid": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Releasing lock "refresh_cache-79dea88d-f5cd-4e8b-a98b-01af128f35ed" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.191s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/94391dc2-758d-483f-a814-a2ab46e8b033/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/94391dc2-758d-483f-a814-a2ab46e8b033/disk 1073741824" returned: 0 in 0.056s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG nova.network.neutron [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Successfully created port: 4d671092-8e1a-4c12-b91d-934efc96f495 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.182s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94391dc2-758d-483f-a814-a2ab46e8b033/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94391dc2-758d-483f-a814-a2ab46e8b033/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94391dc2-758d-483f-a814-a2ab46e8b033/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Cannot resize image /opt/stack/data/nova/instances/94391dc2-758d-483f-a814-a2ab46e8b033/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Ensure instance console log exists: /opt/stack/data/nova/instances/94391dc2-758d-483f-a814-a2ab46e8b033/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:10 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Instance destroyed successfully.
Nov 08 04:00:10 user nova-compute[75014]: DEBUG nova.objects.instance [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lazy-loading 'resources' on Instance uuid 79dea88d-f5cd-4e8b-a98b-01af128f35ed {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-126106463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-126106463',id=19,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkERAMQEozvUuRL7w/KH8SVpl6H+WMKEN72SColTSftWtRNhuQPQVVmz8MU8JS5GawhQGgUIpcwXO5XKClq5cpqfubM4gfoZ7MgOUQORMPiTldXsMzDtlaEN/70+UwQWA==',key_name='tempest-keypair-1769201340',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:57:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a1d70b55f2bb42e5b7123acfcd621b2f',ramdisk_id='',reservation_id='r-n2lnrofd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-650261566',owner_user_name='tempest-AttachVolumeShelveTestJSON-650261566-project-member',shelved_at='2023-11-08T04:00:09.569695',shelved_host='user',shelved_image_id='ae3a2ff1-fca0-4480-b352-446152854834'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74a49a9155064771bd4e8a179f9111ac',uuid=79dea88d-f5cd-4e8b-a98b-01af128f35ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "address": "fa:16:3e:e4:5b:42", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce8dc6f-21", "ovs_interfaceid": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Converting VIF {"id": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "address": "fa:16:3e:e4:5b:42", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce8dc6f-21", "ovs_interfaceid": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5b:42,bridge_name='br-int',has_traffic_filtering=True,id=0ce8dc6f-2116-4163-8c05-2e3519724ee7,network=Network(6ebf42ac-ab65-4622-8529-4c508f9d563c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce8dc6f-21') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG os_vif [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5b:42,bridge_name='br-int',has_traffic_filtering=True,id=0ce8dc6f-2116-4163-8c05-2e3519724ee7,network=Network(6ebf42ac-ab65-4622-8529-4c508f9d563c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce8dc6f-21') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ce8dc6f-21, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b98cc5b5-95d1-4ace-80ff-570a2b5cbcf8) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:00:10 user nova-compute[75014]: INFO os_vif [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5b:42,bridge_name='br-int',has_traffic_filtering=True,id=0ce8dc6f-2116-4163-8c05-2e3519724ee7,network=Network(6ebf42ac-ab65-4622-8529-4c508f9d563c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce8dc6f-21')
Nov 08 04:00:10 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Deleting instance files /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed_del
Nov 08 04:00:10 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Deletion of /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed_del complete
Nov 08 04:00:10 user nova-compute[75014]: DEBUG nova.compute.manager [req-b4234e7d-0688-45c0-9a75-a8b362c1c4b0 req-09b9db01-af77-4acc-81ba-e82f422332d6 service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Received event network-changed-0ce8dc6f-2116-4163-8c05-2e3519724ee7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG nova.compute.manager [req-b4234e7d-0688-45c0-9a75-a8b362c1c4b0 req-09b9db01-af77-4acc-81ba-e82f422332d6 service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Refreshing instance network info cache due to event network-changed-0ce8dc6f-2116-4163-8c05-2e3519724ee7. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b4234e7d-0688-45c0-9a75-a8b362c1c4b0 req-09b9db01-af77-4acc-81ba-e82f422332d6 service nova] Acquiring lock "refresh_cache-79dea88d-f5cd-4e8b-a98b-01af128f35ed" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b4234e7d-0688-45c0-9a75-a8b362c1c4b0 req-09b9db01-af77-4acc-81ba-e82f422332d6 service nova] Acquired lock "refresh_cache-79dea88d-f5cd-4e8b-a98b-01af128f35ed" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG nova.network.neutron [req-b4234e7d-0688-45c0-9a75-a8b362c1c4b0 req-09b9db01-af77-4acc-81ba-e82f422332d6 service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Refreshing network info cache for port 0ce8dc6f-2116-4163-8c05-2e3519724ee7 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:00:10 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Deleted allocations for instance 79dea88d-f5cd-4e8b-a98b-01af128f35ed
Nov 08 04:00:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG nova.objects.instance [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lazy-loading 'numa_topology' on Instance uuid 79dea88d-f5cd-4e8b-a98b-01af128f35ed {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:00:10 user nova-compute[75014]: DEBUG nova.objects.base [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Object Instance<79dea88d-f5cd-4e8b-a98b-01af128f35ed> lazy-loaded attributes: resources,numa_topology {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.network.neutron [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Successfully updated port: 4d671092-8e1a-4c12-b91d-934efc96f495 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "refresh_cache-94391dc2-758d-483f-a814-a2ab46e8b033" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquired lock "refresh_cache-94391dc2-758d-483f-a814-a2ab46e8b033" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.network.neutron [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.network.neutron [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.compute.manager [req-9316074d-13e2-400a-b10f-4c4c5adc02ad req-de9ac0e3-67ff-4bd7-afc0-5e0ef0861bca service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Received event network-changed-4d671092-8e1a-4c12-b91d-934efc96f495 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.compute.manager [req-9316074d-13e2-400a-b10f-4c4c5adc02ad req-de9ac0e3-67ff-4bd7-afc0-5e0ef0861bca service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Refreshing instance network info cache due to event network-changed-4d671092-8e1a-4c12-b91d-934efc96f495. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-9316074d-13e2-400a-b10f-4c4c5adc02ad req-de9ac0e3-67ff-4bd7-afc0-5e0ef0861bca service nova] Acquiring lock "refresh_cache-94391dc2-758d-483f-a814-a2ab46e8b033" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.network.neutron [req-b4234e7d-0688-45c0-9a75-a8b362c1c4b0 req-09b9db01-af77-4acc-81ba-e82f422332d6 service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Updated VIF entry in instance network info cache for port 0ce8dc6f-2116-4163-8c05-2e3519724ee7. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.network.neutron [req-b4234e7d-0688-45c0-9a75-a8b362c1c4b0 req-09b9db01-af77-4acc-81ba-e82f422332d6 service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Updating instance_info_cache with network_info: [{"id": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "address": "fa:16:3e:e4:5b:42", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap0ce8dc6f-21", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b4234e7d-0688-45c0-9a75-a8b362c1c4b0 req-09b9db01-af77-4acc-81ba-e82f422332d6 service nova] Releasing lock "refresh_cache-79dea88d-f5cd-4e8b-a98b-01af128f35ed" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.477s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.network.neutron [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Updating instance_info_cache with network_info: [{"id": "4d671092-8e1a-4c12-b91d-934efc96f495", "address": "fa:16:3e:29:8d:b6", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d671092-8e", "ovs_interfaceid": "4d671092-8e1a-4c12-b91d-934efc96f495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Releasing lock "refresh_cache-94391dc2-758d-483f-a814-a2ab46e8b033" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.compute.manager [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Instance network_info: |[{"id": "4d671092-8e1a-4c12-b91d-934efc96f495", "address": "fa:16:3e:29:8d:b6", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d671092-8e", "ovs_interfaceid": "4d671092-8e1a-4c12-b91d-934efc96f495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-9316074d-13e2-400a-b10f-4c4c5adc02ad req-de9ac0e3-67ff-4bd7-afc0-5e0ef0861bca service nova] Acquired lock "refresh_cache-94391dc2-758d-483f-a814-a2ab46e8b033" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.network.neutron [req-9316074d-13e2-400a-b10f-4c4c5adc02ad req-de9ac0e3-67ff-4bd7-afc0-5e0ef0861bca service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Refreshing network info cache for port 4d671092-8e1a-4c12-b91d-934efc96f495 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Start _get_guest_xml network_info=[{"id": "4d671092-8e1a-4c12-b91d-934efc96f495", "address": "fa:16:3e:29:8d:b6", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d671092-8e", "ovs_interfaceid": "4d671092-8e1a-4c12-b91d-934efc96f495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:00:11 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:00:11 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-273439371',display_name='tempest-AttachVolumeNegativeTest-server-273439371',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-273439371',id=25,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIB2vqM9zzsPD5JVptNY+zGx2xOQbeZ5bjeUuD7fkNFpMLZrUf+EM3QCvxYZee38qw8oF7kZh01LFvMx/LEbLiOVuhQKRTgr2jp2T61shTnwL8/TP9KviPhAdk7pxOd2yw==',key_name='tempest-keypair-744292143',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1c9753cb588478a8a93182be3256674',ramdisk_id='',reservation_id='r-filw2ji5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1215701914',owner_user_name='tempest-AttachVolumeNegativeTest-1215701914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:00:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8c674d8b2cf49c08cf254a8095ef8ea',uuid=94391dc2-758d-483f-a814-a2ab46e8b033,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d671092-8e1a-4c12-b91d-934efc96f495", "address": "fa:16:3e:29:8d:b6", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d671092-8e", "ovs_interfaceid": "4d671092-8e1a-4c12-b91d-934efc96f495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Converting VIF {"id": "4d671092-8e1a-4c12-b91d-934efc96f495", "address": "fa:16:3e:29:8d:b6", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d671092-8e", "ovs_interfaceid": "4d671092-8e1a-4c12-b91d-934efc96f495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:8d:b6,bridge_name='br-int',has_traffic_filtering=True,id=4d671092-8e1a-4c12-b91d-934efc96f495,network=Network(f3d67270-d525-45d9-958c-a901d121d510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d671092-8e') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.objects.instance [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lazy-loading 'pci_devices' on Instance uuid 94391dc2-758d-483f-a814-a2ab46e8b033 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9119241e-c302-44b2-a5f7-acbe88018436 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.431s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:00:11 user nova-compute[75014]:   <uuid>94391dc2-758d-483f-a814-a2ab46e8b033</uuid>
Nov 08 04:00:11 user nova-compute[75014]:   <name>instance-00000019</name>
Nov 08 04:00:11 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:00:11 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:00:11 user nova-compute[75014]:   <metadata>
Nov 08 04:00:11 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:00:11 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:00:11 user nova-compute[75014]:       <nova:name>tempest-AttachVolumeNegativeTest-server-273439371</nova:name>
Nov 08 04:00:11 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:00:11</nova:creationTime>
Nov 08 04:00:11 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:00:11 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:00:11 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:00:11 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:00:11 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:00:11 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:00:11 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:00:11 user nova-compute[75014]:       <nova:owner>
Nov 08 04:00:11 user nova-compute[75014]:         <nova:user uuid="c8c674d8b2cf49c08cf254a8095ef8ea">tempest-AttachVolumeNegativeTest-1215701914-project-member</nova:user>
Nov 08 04:00:11 user nova-compute[75014]:         <nova:project uuid="f1c9753cb588478a8a93182be3256674">tempest-AttachVolumeNegativeTest-1215701914</nova:project>
Nov 08 04:00:11 user nova-compute[75014]:       </nova:owner>
Nov 08 04:00:11 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:00:11 user nova-compute[75014]:       <nova:ports>
Nov 08 04:00:11 user nova-compute[75014]:         <nova:port uuid="4d671092-8e1a-4c12-b91d-934efc96f495">
Nov 08 04:00:11 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 04:00:11 user nova-compute[75014]:         </nova:port>
Nov 08 04:00:11 user nova-compute[75014]:       </nova:ports>
Nov 08 04:00:11 user nova-compute[75014]:     </nova:instance>
Nov 08 04:00:11 user nova-compute[75014]:   </metadata>
Nov 08 04:00:11 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:00:11 user nova-compute[75014]:     <system>
Nov 08 04:00:11 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:00:11 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:00:11 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:00:11 user nova-compute[75014]:       <entry name="serial">94391dc2-758d-483f-a814-a2ab46e8b033</entry>
Nov 08 04:00:11 user nova-compute[75014]:       <entry name="uuid">94391dc2-758d-483f-a814-a2ab46e8b033</entry>
Nov 08 04:00:11 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:00:11 user nova-compute[75014]:     </system>
Nov 08 04:00:11 user nova-compute[75014]:   </sysinfo>
Nov 08 04:00:11 user nova-compute[75014]:   <os>
Nov 08 04:00:11 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:00:11 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:00:11 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:00:11 user nova-compute[75014]:   </os>
Nov 08 04:00:11 user nova-compute[75014]:   <features>
Nov 08 04:00:11 user nova-compute[75014]:     <acpi/>
Nov 08 04:00:11 user nova-compute[75014]:     <apic/>
Nov 08 04:00:11 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:00:11 user nova-compute[75014]:   </features>
Nov 08 04:00:11 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:00:11 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:00:11 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:00:11 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:00:11 user nova-compute[75014]:   </clock>
Nov 08 04:00:11 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:00:11 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:00:11 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:00:11 user nova-compute[75014]:   </cpu>
Nov 08 04:00:11 user nova-compute[75014]:   <devices>
Nov 08 04:00:11 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 04:00:11 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 04:00:11 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/94391dc2-758d-483f-a814-a2ab46e8b033/disk"/>
Nov 08 04:00:11 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:00:11 user nova-compute[75014]:     </disk>
Nov 08 04:00:11 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:00:11 user nova-compute[75014]:       <mac address="fa:16:3e:29:8d:b6"/>
Nov 08 04:00:11 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:00:11 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:00:11 user nova-compute[75014]:       <target dev="tap4d671092-8e"/>
Nov 08 04:00:11 user nova-compute[75014]:     </interface>
Nov 08 04:00:11 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:00:11 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/94391dc2-758d-483f-a814-a2ab46e8b033/console.log" append="off"/>
Nov 08 04:00:11 user nova-compute[75014]:     </serial>
Nov 08 04:00:11 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:00:11 user nova-compute[75014]:     <video>
Nov 08 04:00:11 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:00:11 user nova-compute[75014]:     </video>
Nov 08 04:00:11 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:00:11 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:00:11 user nova-compute[75014]:     </rng>
Nov 08 04:00:11 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:00:11 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:00:11 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:00:11 user nova-compute[75014]:     </memballoon>
Nov 08 04:00:11 user nova-compute[75014]:   </devices>
Nov 08 04:00:11 user nova-compute[75014]: </domain>
Nov 08 04:00:11 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-273439371',display_name='tempest-AttachVolumeNegativeTest-server-273439371',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-273439371',id=25,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIB2vqM9zzsPD5JVptNY+zGx2xOQbeZ5bjeUuD7fkNFpMLZrUf+EM3QCvxYZee38qw8oF7kZh01LFvMx/LEbLiOVuhQKRTgr2jp2T61shTnwL8/TP9KviPhAdk7pxOd2yw==',key_name='tempest-keypair-744292143',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1c9753cb588478a8a93182be3256674',ramdisk_id='',reservation_id='r-filw2ji5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1215701914',owner_user_name='tempest-AttachVolumeNegativeTest-1215701914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:00:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8c674d8b2cf49c08cf254a8095ef8ea',uuid=94391dc2-758d-483f-a814-a2ab46e8b033,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d671092-8e1a-4c12-b91d-934efc96f495", "address": "fa:16:3e:29:8d:b6", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d671092-8e", "ovs_interfaceid": "4d671092-8e1a-4c12-b91d-934efc96f495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Converting VIF {"id": "4d671092-8e1a-4c12-b91d-934efc96f495", "address": "fa:16:3e:29:8d:b6", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d671092-8e", "ovs_interfaceid": "4d671092-8e1a-4c12-b91d-934efc96f495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:8d:b6,bridge_name='br-int',has_traffic_filtering=True,id=4d671092-8e1a-4c12-b91d-934efc96f495,network=Network(f3d67270-d525-45d9-958c-a901d121d510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d671092-8e') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG os_vif [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:8d:b6,bridge_name='br-int',has_traffic_filtering=True,id=4d671092-8e1a-4c12-b91d-934efc96f495,network=Network(f3d67270-d525-45d9-958c-a901d121d510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d671092-8e') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '319ef099-1b4f-5b47-923f-7824309c93e9', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d671092-8e, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d671092-8e, col_values=(('qos', UUID('bd9e6a88-ef4d-4113-9de3-1ff608c7a9a0')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d671092-8e, col_values=(('external_ids', {'iface-id': '4d671092-8e1a-4c12-b91d-934efc96f495', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:8d:b6', 'vm-uuid': '94391dc2-758d-483f-a814-a2ab46e8b033'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:11 user nova-compute[75014]: INFO os_vif [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:8d:b6,bridge_name='br-int',has_traffic_filtering=True,id=4d671092-8e1a-4c12-b91d-934efc96f495,network=Network(f3d67270-d525-45d9-958c-a901d121d510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d671092-8e')
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] No VIF found with MAC fa:16:3e:29:8d:b6, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.network.neutron [req-9316074d-13e2-400a-b10f-4c4c5adc02ad req-de9ac0e3-67ff-4bd7-afc0-5e0ef0861bca service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Updated VIF entry in instance network info cache for port 4d671092-8e1a-4c12-b91d-934efc96f495. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG nova.network.neutron [req-9316074d-13e2-400a-b10f-4c4c5adc02ad req-de9ac0e3-67ff-4bd7-afc0-5e0ef0861bca service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Updating instance_info_cache with network_info: [{"id": "4d671092-8e1a-4c12-b91d-934efc96f495", "address": "fa:16:3e:29:8d:b6", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d671092-8e", "ovs_interfaceid": "4d671092-8e1a-4c12-b91d-934efc96f495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-9316074d-13e2-400a-b10f-4c4c5adc02ad req-de9ac0e3-67ff-4bd7-afc0-5e0ef0861bca service nova] Releasing lock "refresh_cache-94391dc2-758d-483f-a814-a2ab46e8b033" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:00:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:13 user nova-compute[75014]: DEBUG nova.compute.manager [req-8d052313-afee-4350-8e29-11d513f7ff36 req-aa57e65e-dfdd-4bb5-90cf-fff5493a2012 service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Received event network-vif-plugged-4d671092-8e1a-4c12-b91d-934efc96f495 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:00:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8d052313-afee-4350-8e29-11d513f7ff36 req-aa57e65e-dfdd-4bb5-90cf-fff5493a2012 service nova] Acquiring lock "94391dc2-758d-483f-a814-a2ab46e8b033-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8d052313-afee-4350-8e29-11d513f7ff36 req-aa57e65e-dfdd-4bb5-90cf-fff5493a2012 service nova] Lock "94391dc2-758d-483f-a814-a2ab46e8b033-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8d052313-afee-4350-8e29-11d513f7ff36 req-aa57e65e-dfdd-4bb5-90cf-fff5493a2012 service nova] Lock "94391dc2-758d-483f-a814-a2ab46e8b033-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:13 user nova-compute[75014]: DEBUG nova.compute.manager [req-8d052313-afee-4350-8e29-11d513f7ff36 req-aa57e65e-dfdd-4bb5-90cf-fff5493a2012 service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] No waiting events found dispatching network-vif-plugged-4d671092-8e1a-4c12-b91d-934efc96f495 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:00:13 user nova-compute[75014]: WARNING nova.compute.manager [req-8d052313-afee-4350-8e29-11d513f7ff36 req-aa57e65e-dfdd-4bb5-90cf-fff5493a2012 service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Received unexpected event network-vif-plugged-4d671092-8e1a-4c12-b91d-934efc96f495 for instance with vm_state building and task_state spawning.
Nov 08 04:00:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Acquiring lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:13 user nova-compute[75014]: DEBUG nova.objects.instance [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lazy-loading 'flavor' on Instance uuid bd153f84-98cd-4c6d-a7ab-5759b0b5bf55 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:00:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Acquiring lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:13 user nova-compute[75014]: INFO nova.compute.manager [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Attaching volume 65b5a229-3d47-4b3c-bfec-b2ea92cb906a to /dev/vdb
Nov 08 04:00:14 user nova-compute[75014]: DEBUG os_brick.utils [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:00:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[655002a9-1b84-4a98-98b5-f33ab8f51735]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc13db9-c262-4670-bb07-a6cbbdd6bc9a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e173bb-b590-4d31-a23a-e6f79c73a549]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1899fd-aedd-465e-8070-e318ae967fec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:00:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:00:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:00:14 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:00:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5740608-d81f-4a8e-9ee4-d98ecf76f3b8]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:00:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:00:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:00:14 user nova-compute[75014]: DEBUG os_brick.utils [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:00:14 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Updating existing volume attachment record: 1b2dd320-6258-4dc8-8c2c-f38ed6733c93 {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:00:15 user nova-compute[75014]: DEBUG nova.compute.manager [req-3151d0fa-fe9d-4b07-8c91-316ff204aa0a req-40c4f8d8-66e7-4760-b8ec-bd14b253c2f1 service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Received event network-vif-plugged-4d671092-8e1a-4c12-b91d-934efc96f495 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:00:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3151d0fa-fe9d-4b07-8c91-316ff204aa0a req-40c4f8d8-66e7-4760-b8ec-bd14b253c2f1 service nova] Acquiring lock "94391dc2-758d-483f-a814-a2ab46e8b033-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3151d0fa-fe9d-4b07-8c91-316ff204aa0a req-40c4f8d8-66e7-4760-b8ec-bd14b253c2f1 service nova] Lock "94391dc2-758d-483f-a814-a2ab46e8b033-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3151d0fa-fe9d-4b07-8c91-316ff204aa0a req-40c4f8d8-66e7-4760-b8ec-bd14b253c2f1 service nova] Lock "94391dc2-758d-483f-a814-a2ab46e8b033-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:15 user nova-compute[75014]: DEBUG nova.compute.manager [req-3151d0fa-fe9d-4b07-8c91-316ff204aa0a req-40c4f8d8-66e7-4760-b8ec-bd14b253c2f1 service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] No waiting events found dispatching network-vif-plugged-4d671092-8e1a-4c12-b91d-934efc96f495 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:00:15 user nova-compute[75014]: WARNING nova.compute.manager [req-3151d0fa-fe9d-4b07-8c91-316ff204aa0a req-40c4f8d8-66e7-4760-b8ec-bd14b253c2f1 service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Received unexpected event network-vif-plugged-4d671092-8e1a-4c12-b91d-934efc96f495 for instance with vm_state building and task_state spawning.
Nov 08 04:00:15 user nova-compute[75014]: DEBUG nova.compute.manager [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:00:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 04:00:15 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Instance spawned successfully.
Nov 08 04:00:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 04:00:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:00:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:00:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:00:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:00:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:00:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:00:15 user nova-compute[75014]: INFO nova.compute.manager [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Took 5.61 seconds to spawn the instance on the hypervisor.
Nov 08 04:00:15 user nova-compute[75014]: DEBUG nova.compute.manager [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:00:15 user nova-compute[75014]: INFO nova.compute.manager [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Took 6.51 seconds to build instance.
Nov 08 04:00:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e24d59f6-d2aa-4939-b92b-9c33bf3518fc tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "94391dc2-758d-483f-a814-a2ab46e8b033" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.619s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:21 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:21 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Acquiring lock "e432a710-90cd-4b46-8b49-f6b3ab8480dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lock "e432a710-90cd-4b46-8b49-f6b3ab8480dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:26 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 04:00:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:26 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 04:00:26 user nova-compute[75014]: INFO nova.compute.claims [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Claim successful on node user
Nov 08 04:00:27 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:00:27 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:00:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.649s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:27 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 04:00:27 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 04:00:27 user nova-compute[75014]: DEBUG nova.network.neutron [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 04:00:27 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 04:00:27 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 04:00:27 user nova-compute[75014]: DEBUG nova.policy [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2952d351dfab46f2bd6caa61d6d59540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77d1e7a3adc430ab1a17b1c954db9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 04:00:27 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 04:00:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 04:00:27 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Creating image(s)
Nov 08 04:00:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Acquiring lock "/opt/stack/data/nova/instances/e432a710-90cd-4b46-8b49-f6b3ab8480dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lock "/opt/stack/data/nova/instances/e432a710-90cd-4b46-8b49-f6b3ab8480dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lock "/opt/stack/data/nova/instances/e432a710-90cd-4b46-8b49-f6b3ab8480dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.179s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.183s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/e432a710-90cd-4b46-8b49-f6b3ab8480dc/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/e432a710-90cd-4b46-8b49-f6b3ab8480dc/disk 1073741824" returned: 0 in 0.053s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.188s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:28 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e432a710-90cd-4b46-8b49-f6b3ab8480dc/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 04:00:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e432a710-90cd-4b46-8b49-f6b3ab8480dc/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e432a710-90cd-4b46-8b49-f6b3ab8480dc/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:28 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Cannot resize image /opt/stack/data/nova/instances/e432a710-90cd-4b46-8b49-f6b3ab8480dc/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 04:00:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 04:00:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Ensure instance console log exists: /opt/stack/data/nova/instances/e432a710-90cd-4b46-8b49-f6b3ab8480dc/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:00:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:28 user nova-compute[75014]: DEBUG nova.network.neutron [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Successfully created port: 2df00777-dbee-4261-bd75-145228e8364b {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 04:00:29 user nova-compute[75014]: DEBUG nova.network.neutron [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Successfully updated port: 2df00777-dbee-4261-bd75-145228e8364b {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 04:00:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Acquiring lock "refresh_cache-e432a710-90cd-4b46-8b49-f6b3ab8480dc" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:00:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Acquired lock "refresh_cache-e432a710-90cd-4b46-8b49-f6b3ab8480dc" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:00:29 user nova-compute[75014]: DEBUG nova.network.neutron [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:00:29 user nova-compute[75014]: DEBUG nova.compute.manager [req-bb265548-eac5-4a57-b261-d99b30ddbed1 req-f2f66e5d-27ef-4b3f-accc-1f2c2a2b452f service nova] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Received event network-changed-2df00777-dbee-4261-bd75-145228e8364b {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:00:29 user nova-compute[75014]: DEBUG nova.compute.manager [req-bb265548-eac5-4a57-b261-d99b30ddbed1 req-f2f66e5d-27ef-4b3f-accc-1f2c2a2b452f service nova] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Refreshing instance network info cache due to event network-changed-2df00777-dbee-4261-bd75-145228e8364b. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:00:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-bb265548-eac5-4a57-b261-d99b30ddbed1 req-f2f66e5d-27ef-4b3f-accc-1f2c2a2b452f service nova] Acquiring lock "refresh_cache-e432a710-90cd-4b46-8b49-f6b3ab8480dc" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:00:29 user nova-compute[75014]: DEBUG nova.network.neutron [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG nova.network.neutron [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Updating instance_info_cache with network_info: [{"id": "2df00777-dbee-4261-bd75-145228e8364b", "address": "fa:16:3e:8b:b6:a9", "network": {"id": "8ee4c37f-4f4b-4886-9824-d394b2d3d49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-754640303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77d1e7a3adc430ab1a17b1c954db9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df00777-db", "ovs_interfaceid": "2df00777-dbee-4261-bd75-145228e8364b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Releasing lock "refresh_cache-e432a710-90cd-4b46-8b49-f6b3ab8480dc" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Instance network_info: |[{"id": "2df00777-dbee-4261-bd75-145228e8364b", "address": "fa:16:3e:8b:b6:a9", "network": {"id": "8ee4c37f-4f4b-4886-9824-d394b2d3d49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-754640303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77d1e7a3adc430ab1a17b1c954db9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df00777-db", "ovs_interfaceid": "2df00777-dbee-4261-bd75-145228e8364b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-bb265548-eac5-4a57-b261-d99b30ddbed1 req-f2f66e5d-27ef-4b3f-accc-1f2c2a2b452f service nova] Acquired lock "refresh_cache-e432a710-90cd-4b46-8b49-f6b3ab8480dc" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG nova.network.neutron [req-bb265548-eac5-4a57-b261-d99b30ddbed1 req-f2f66e5d-27ef-4b3f-accc-1f2c2a2b452f service nova] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Refreshing network info cache for port 2df00777-dbee-4261-bd75-145228e8364b {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Start _get_guest_xml network_info=[{"id": "2df00777-dbee-4261-bd75-145228e8364b", "address": "fa:16:3e:8b:b6:a9", "network": {"id": "8ee4c37f-4f4b-4886-9824-d394b2d3d49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-754640303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77d1e7a3adc430ab1a17b1c954db9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df00777-db", "ovs_interfaceid": "2df00777-dbee-4261-bd75-145228e8364b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:00:30 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:00:30 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:00:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2043684667',display_name='tempest-VolumesActionsTest-instance-2043684667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2043684667',id=26,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a77d1e7a3adc430ab1a17b1c954db9a4',ramdisk_id='',reservation_id='r-gap580gx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-158235265',owner_user_name='tempest-VolumesActionsTest-158235265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:00:27Z,user_data=None,user_id='2952d351dfab46f2bd6caa61d6d59540',uuid=e432a710-90cd-4b46-8b49-f6b3ab8480dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2df00777-dbee-4261-bd75-145228e8364b", "address": "fa:16:3e:8b:b6:a9", "network": {"id": "8ee4c37f-4f4b-4886-9824-d394b2d3d49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-754640303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77d1e7a3adc430ab1a17b1c954db9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df00777-db", "ovs_interfaceid": "2df00777-dbee-4261-bd75-145228e8364b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Converting VIF {"id": "2df00777-dbee-4261-bd75-145228e8364b", "address": "fa:16:3e:8b:b6:a9", "network": {"id": "8ee4c37f-4f4b-4886-9824-d394b2d3d49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-754640303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77d1e7a3adc430ab1a17b1c954db9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df00777-db", "ovs_interfaceid": "2df00777-dbee-4261-bd75-145228e8364b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:b6:a9,bridge_name='br-int',has_traffic_filtering=True,id=2df00777-dbee-4261-bd75-145228e8364b,network=Network(8ee4c37f-4f4b-4886-9824-d394b2d3d49d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df00777-db') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG nova.objects.instance [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lazy-loading 'pci_devices' on Instance uuid e432a710-90cd-4b46-8b49-f6b3ab8480dc {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:00:30 user nova-compute[75014]:   <uuid>e432a710-90cd-4b46-8b49-f6b3ab8480dc</uuid>
Nov 08 04:00:30 user nova-compute[75014]:   <name>instance-0000001a</name>
Nov 08 04:00:30 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:00:30 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:00:30 user nova-compute[75014]:   <metadata>
Nov 08 04:00:30 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:00:30 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:00:30 user nova-compute[75014]:       <nova:name>tempest-VolumesActionsTest-instance-2043684667</nova:name>
Nov 08 04:00:30 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:00:30</nova:creationTime>
Nov 08 04:00:30 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:00:30 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:00:30 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:00:30 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:00:30 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:00:30 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:00:30 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:00:30 user nova-compute[75014]:       <nova:owner>
Nov 08 04:00:30 user nova-compute[75014]:         <nova:user uuid="2952d351dfab46f2bd6caa61d6d59540">tempest-VolumesActionsTest-158235265-project-member</nova:user>
Nov 08 04:00:30 user nova-compute[75014]:         <nova:project uuid="a77d1e7a3adc430ab1a17b1c954db9a4">tempest-VolumesActionsTest-158235265</nova:project>
Nov 08 04:00:30 user nova-compute[75014]:       </nova:owner>
Nov 08 04:00:30 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:00:30 user nova-compute[75014]:       <nova:ports>
Nov 08 04:00:30 user nova-compute[75014]:         <nova:port uuid="2df00777-dbee-4261-bd75-145228e8364b">
Nov 08 04:00:30 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 04:00:30 user nova-compute[75014]:         </nova:port>
Nov 08 04:00:30 user nova-compute[75014]:       </nova:ports>
Nov 08 04:00:30 user nova-compute[75014]:     </nova:instance>
Nov 08 04:00:30 user nova-compute[75014]:   </metadata>
Nov 08 04:00:30 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:00:30 user nova-compute[75014]:     <system>
Nov 08 04:00:30 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:00:30 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:00:30 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:00:30 user nova-compute[75014]:       <entry name="serial">e432a710-90cd-4b46-8b49-f6b3ab8480dc</entry>
Nov 08 04:00:30 user nova-compute[75014]:       <entry name="uuid">e432a710-90cd-4b46-8b49-f6b3ab8480dc</entry>
Nov 08 04:00:30 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:00:30 user nova-compute[75014]:     </system>
Nov 08 04:00:30 user nova-compute[75014]:   </sysinfo>
Nov 08 04:00:30 user nova-compute[75014]:   <os>
Nov 08 04:00:30 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:00:30 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:00:30 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:00:30 user nova-compute[75014]:   </os>
Nov 08 04:00:30 user nova-compute[75014]:   <features>
Nov 08 04:00:30 user nova-compute[75014]:     <acpi/>
Nov 08 04:00:30 user nova-compute[75014]:     <apic/>
Nov 08 04:00:30 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:00:30 user nova-compute[75014]:   </features>
Nov 08 04:00:30 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:00:30 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:00:30 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:00:30 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:00:30 user nova-compute[75014]:   </clock>
Nov 08 04:00:30 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:00:30 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:00:30 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:00:30 user nova-compute[75014]:   </cpu>
Nov 08 04:00:30 user nova-compute[75014]:   <devices>
Nov 08 04:00:30 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 04:00:30 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 04:00:30 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/e432a710-90cd-4b46-8b49-f6b3ab8480dc/disk"/>
Nov 08 04:00:30 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:00:30 user nova-compute[75014]:     </disk>
Nov 08 04:00:30 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:00:30 user nova-compute[75014]:       <mac address="fa:16:3e:8b:b6:a9"/>
Nov 08 04:00:30 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:00:30 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:00:30 user nova-compute[75014]:       <target dev="tap2df00777-db"/>
Nov 08 04:00:30 user nova-compute[75014]:     </interface>
Nov 08 04:00:30 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:00:30 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/e432a710-90cd-4b46-8b49-f6b3ab8480dc/console.log" append="off"/>
Nov 08 04:00:30 user nova-compute[75014]:     </serial>
Nov 08 04:00:30 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:00:30 user nova-compute[75014]:     <video>
Nov 08 04:00:30 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:00:30 user nova-compute[75014]:     </video>
Nov 08 04:00:30 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:00:30 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:00:30 user nova-compute[75014]:     </rng>
Nov 08 04:00:30 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:00:30 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:00:30 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:00:30 user nova-compute[75014]:     </memballoon>
Nov 08 04:00:30 user nova-compute[75014]:   </devices>
Nov 08 04:00:30 user nova-compute[75014]: </domain>
Nov 08 04:00:30 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2043684667',display_name='tempest-VolumesActionsTest-instance-2043684667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2043684667',id=26,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a77d1e7a3adc430ab1a17b1c954db9a4',ramdisk_id='',reservation_id='r-gap580gx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-158235265',owner_user_name='tempest-VolumesActionsTest-158235265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:00:27Z,user_data=None,user_id='2952d351dfab46f2bd6caa61d6d59540',uuid=e432a710-90cd-4b46-8b49-f6b3ab8480dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2df00777-dbee-4261-bd75-145228e8364b", "address": "fa:16:3e:8b:b6:a9", "network": {"id": "8ee4c37f-4f4b-4886-9824-d394b2d3d49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-754640303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77d1e7a3adc430ab1a17b1c954db9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df00777-db", "ovs_interfaceid": "2df00777-dbee-4261-bd75-145228e8364b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Converting VIF {"id": "2df00777-dbee-4261-bd75-145228e8364b", "address": "fa:16:3e:8b:b6:a9", "network": {"id": "8ee4c37f-4f4b-4886-9824-d394b2d3d49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-754640303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77d1e7a3adc430ab1a17b1c954db9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df00777-db", "ovs_interfaceid": "2df00777-dbee-4261-bd75-145228e8364b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:b6:a9,bridge_name='br-int',has_traffic_filtering=True,id=2df00777-dbee-4261-bd75-145228e8364b,network=Network(8ee4c37f-4f4b-4886-9824-d394b2d3d49d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df00777-db') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG os_vif [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:b6:a9,bridge_name='br-int',has_traffic_filtering=True,id=2df00777-dbee-4261-bd75-145228e8364b,network=Network(8ee4c37f-4f4b-4886-9824-d394b2d3d49d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df00777-db') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e772276-5f58-5ff2-b5d1-d174fc172366', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2df00777-db, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2df00777-db, col_values=(('qos', UUID('501e7893-e9b4-4a66-938b-9953f5928a37')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2df00777-db, col_values=(('external_ids', {'iface-id': '2df00777-dbee-4261-bd75-145228e8364b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:b6:a9', 'vm-uuid': 'e432a710-90cd-4b46-8b49-f6b3ab8480dc'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:30 user nova-compute[75014]: INFO os_vif [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:b6:a9,bridge_name='br-int',has_traffic_filtering=True,id=2df00777-dbee-4261-bd75-145228e8364b,network=Network(8ee4c37f-4f4b-4886-9824-d394b2d3d49d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df00777-db')
Nov 08 04:00:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:00:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] No VIF found with MAC fa:16:3e:8b:b6:a9, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:00:31 user nova-compute[75014]: DEBUG nova.network.neutron [req-bb265548-eac5-4a57-b261-d99b30ddbed1 req-f2f66e5d-27ef-4b3f-accc-1f2c2a2b452f service nova] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Updated VIF entry in instance network info cache for port 2df00777-dbee-4261-bd75-145228e8364b. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:00:31 user nova-compute[75014]: DEBUG nova.network.neutron [req-bb265548-eac5-4a57-b261-d99b30ddbed1 req-f2f66e5d-27ef-4b3f-accc-1f2c2a2b452f service nova] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Updating instance_info_cache with network_info: [{"id": "2df00777-dbee-4261-bd75-145228e8364b", "address": "fa:16:3e:8b:b6:a9", "network": {"id": "8ee4c37f-4f4b-4886-9824-d394b2d3d49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-754640303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77d1e7a3adc430ab1a17b1c954db9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df00777-db", "ovs_interfaceid": "2df00777-dbee-4261-bd75-145228e8364b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:00:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-bb265548-eac5-4a57-b261-d99b30ddbed1 req-f2f66e5d-27ef-4b3f-accc-1f2c2a2b452f service nova] Releasing lock "refresh_cache-e432a710-90cd-4b46-8b49-f6b3ab8480dc" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:00:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:31 user nova-compute[75014]: DEBUG nova.compute.manager [req-6bbd979b-438d-43f9-8300-c0899dd7cfaf req-3841f688-9fed-466e-a8a6-7e4148f07ca0 service nova] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Received event network-vif-plugged-2df00777-dbee-4261-bd75-145228e8364b {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:00:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-6bbd979b-438d-43f9-8300-c0899dd7cfaf req-3841f688-9fed-466e-a8a6-7e4148f07ca0 service nova] Acquiring lock "e432a710-90cd-4b46-8b49-f6b3ab8480dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-6bbd979b-438d-43f9-8300-c0899dd7cfaf req-3841f688-9fed-466e-a8a6-7e4148f07ca0 service nova] Lock "e432a710-90cd-4b46-8b49-f6b3ab8480dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-6bbd979b-438d-43f9-8300-c0899dd7cfaf req-3841f688-9fed-466e-a8a6-7e4148f07ca0 service nova] Lock "e432a710-90cd-4b46-8b49-f6b3ab8480dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:31 user nova-compute[75014]: DEBUG nova.compute.manager [req-6bbd979b-438d-43f9-8300-c0899dd7cfaf req-3841f688-9fed-466e-a8a6-7e4148f07ca0 service nova] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] No waiting events found dispatching network-vif-plugged-2df00777-dbee-4261-bd75-145228e8364b {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:00:31 user nova-compute[75014]: WARNING nova.compute.manager [req-6bbd979b-438d-43f9-8300-c0899dd7cfaf req-3841f688-9fed-466e-a8a6-7e4148f07ca0 service nova] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Received unexpected event network-vif-plugged-2df00777-dbee-4261-bd75-145228e8364b for instance with vm_state building and task_state spawning.
Nov 08 04:00:32 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:00:32 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:00:32 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:00:32 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Didn't find any instances for network info cache update. {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 04:00:32 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:00:32 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:00:32 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:00:32 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:00:32 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:00:32 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:00:32 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:00:32 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:00:32 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=75014) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 04:00:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Acquiring lock "af246bb7-2e77-469b-bf98-cf05b467255c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lock "af246bb7-2e77-469b-bf98-cf05b467255c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Acquiring lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:32 user nova-compute[75014]: INFO nova.compute.manager [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Terminating instance
Nov 08 04:00:32 user nova-compute[75014]: DEBUG nova.compute.manager [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:00:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG nova.compute.manager [req-44ffd01d-a05d-42ce-9d10-f5bcb0ef292c req-7123b115-8bbb-461b-84da-261a465fffc2 service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Received event network-vif-unplugged-c45eca82-c80d-4ee4-87d6-dc301fd5f760 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-44ffd01d-a05d-42ce-9d10-f5bcb0ef292c req-7123b115-8bbb-461b-84da-261a465fffc2 service nova] Acquiring lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-44ffd01d-a05d-42ce-9d10-f5bcb0ef292c req-7123b115-8bbb-461b-84da-261a465fffc2 service nova] Lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-44ffd01d-a05d-42ce-9d10-f5bcb0ef292c req-7123b115-8bbb-461b-84da-261a465fffc2 service nova] Lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG nova.compute.manager [req-44ffd01d-a05d-42ce-9d10-f5bcb0ef292c req-7123b115-8bbb-461b-84da-261a465fffc2 service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] No waiting events found dispatching network-vif-unplugged-c45eca82-c80d-4ee4-87d6-dc301fd5f760 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG nova.compute.manager [req-44ffd01d-a05d-42ce-9d10-f5bcb0ef292c req-7123b115-8bbb-461b-84da-261a465fffc2 service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Received event network-vif-unplugged-c45eca82-c80d-4ee4-87d6-dc301fd5f760 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:00:33 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Instance destroyed successfully.
Nov 08 04:00:33 user nova-compute[75014]: DEBUG nova.objects.instance [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lazy-loading 'resources' on Instance uuid af246bb7-2e77-469b-bf98-cf05b467255c {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T03:55:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1850919150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-941373465',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrsfdqP450Mbe8oVvdxb3uthC9zeL79XB+4YPPNFemSr8TxtZzWeH1eQHKOVvjEq1C1cLLx7kTdx1hGypUPYqlTsW5kFewd1FNQnedwAOlojPwTmEoLNga9SonIAuwsxw==',key_name='tempest-keypair-1582548590',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:58:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ed74b4d275e441381458eea9bca5aea',ramdisk_id='',reservation_id='r-hv42b2u3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-344745944',owner_user_name='tempest-ServerActionsV293TestJSON-344745944-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T03:58:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64abc045db314ba0bfd6031a127932f8',uuid=af246bb7-2e77-469b-bf98-cf05b467255c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "address": "fa:16:3e:6b:fa:e7", "network": {"id": "0c33822d-76e5-44ba-9e89-86e6a2d3351f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-374514491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed74b4d275e441381458eea9bca5aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc45eca82-c8", "ovs_interfaceid": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Converting VIF {"id": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "address": "fa:16:3e:6b:fa:e7", "network": {"id": "0c33822d-76e5-44ba-9e89-86e6a2d3351f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-374514491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed74b4d275e441381458eea9bca5aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc45eca82-c8", "ovs_interfaceid": "c45eca82-c80d-4ee4-87d6-dc301fd5f760", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:fa:e7,bridge_name='br-int',has_traffic_filtering=True,id=c45eca82-c80d-4ee4-87d6-dc301fd5f760,network=Network(0c33822d-76e5-44ba-9e89-86e6a2d3351f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc45eca82-c8') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG os_vif [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:fa:e7,bridge_name='br-int',has_traffic_filtering=True,id=c45eca82-c80d-4ee4-87d6-dc301fd5f760,network=Network(0c33822d-76e5-44ba-9e89-86e6a2d3351f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc45eca82-c8') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc45eca82-c8, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ab77f76-2a5e-43fc-a049-050e5dbf451b) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:33 user nova-compute[75014]: INFO os_vif [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:fa:e7,bridge_name='br-int',has_traffic_filtering=True,id=c45eca82-c80d-4ee4-87d6-dc301fd5f760,network=Network(0c33822d-76e5-44ba-9e89-86e6a2d3351f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc45eca82-c8')
Nov 08 04:00:33 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbRyqWXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:00:33 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:00:33 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e49e9e-5d75-4c9e-93b6-ec7f8cfb5660]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:00:33 user nova-compute[75014]: No targets found.
Nov 08 04:00:33 user nova-compute[75014]: iSNS:
Nov 08 04:00:33 user nova-compute[75014]: No targets found.
Nov 08 04:00:33 user nova-compute[75014]: STATIC:
Nov 08 04:00:33 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec
Nov 08 04:00:33 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:00:33 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:00:33 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:00:33 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:00:33 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:00:33 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012
Nov 08 04:00:33 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:00:33 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:00:33 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37
Nov 08 04:00:33 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:00:33 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:00:33 user nova-compute[75014]: FIRMWARE:
Nov 08 04:00:33 user nova-compute[75014]: No targets found.
Nov 08 04:00:33 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:00:33 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:00:33 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[463c6328-3942-4e8c-80cd-8f4bd672105b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae3845e-2c73-4cd3-a136-124f0722b17a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:00:33 user nova-compute[75014]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 (non-flash)
Nov 08 04:00:33 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:00:33 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:00:33 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:00:33 user nova-compute[75014]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 (non-flash)
Nov 08 04:00:33 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:00:33 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:00:33 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0418210790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012'): ({'sdb'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Removing single pathed devices sdb {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[687915fa-26c3-4bcf-83cb-259e81427c4c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa407f9-e283-47b0-b730-bbd14b2ecf1a]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Flushing IO for device /dev/sdb {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f17640-e488-4d3d-981c-63c86504879a]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7bc394-db0b-44a2-80ef-098366176aa8]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] SCSI volumes sdb have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab02374a-9f11-4e25-8acc-66a524da5d78]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9251da3-4b8a-4be4-90d3-85bb5fd1bad5]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012, portal: 172.16.0.220,3260]
Nov 08 04:00:33 user nova-compute[75014]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012, portal: 172.16.0.220,3260] successful.
Nov 08 04:00:33 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3fe5b4d-0559-4f95-b369-6d3cf54dc012 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a532b9-2ceb-4950-b771-71880abfeb38]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] <== disconnect_volume: return (365ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:00:33 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Deleting instance files /opt/stack/data/nova/instances/af246bb7-2e77-469b-bf98-cf05b467255c_del
Nov 08 04:00:33 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Deletion of /opt/stack/data/nova/instances/af246bb7-2e77-469b-bf98-cf05b467255c_del complete
Nov 08 04:00:33 user nova-compute[75014]: INFO nova.compute.manager [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 08 04:00:33 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:00:33 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:00:34 user nova-compute[75014]: DEBUG nova.compute.manager [req-5609ebd0-b348-4ae7-88dd-495f39ae6659 req-339787a2-2885-4b13-ae17-12e836b0afda service nova] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Received event network-vif-plugged-2df00777-dbee-4261-bd75-145228e8364b {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:00:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5609ebd0-b348-4ae7-88dd-495f39ae6659 req-339787a2-2885-4b13-ae17-12e836b0afda service nova] Acquiring lock "e432a710-90cd-4b46-8b49-f6b3ab8480dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5609ebd0-b348-4ae7-88dd-495f39ae6659 req-339787a2-2885-4b13-ae17-12e836b0afda service nova] Lock "e432a710-90cd-4b46-8b49-f6b3ab8480dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5609ebd0-b348-4ae7-88dd-495f39ae6659 req-339787a2-2885-4b13-ae17-12e836b0afda service nova] Lock "e432a710-90cd-4b46-8b49-f6b3ab8480dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:34 user nova-compute[75014]: DEBUG nova.compute.manager [req-5609ebd0-b348-4ae7-88dd-495f39ae6659 req-339787a2-2885-4b13-ae17-12e836b0afda service nova] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] No waiting events found dispatching network-vif-plugged-2df00777-dbee-4261-bd75-145228e8364b {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:00:34 user nova-compute[75014]: WARNING nova.compute.manager [req-5609ebd0-b348-4ae7-88dd-495f39ae6659 req-339787a2-2885-4b13-ae17-12e836b0afda service nova] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Received unexpected event network-vif-plugged-2df00777-dbee-4261-bd75-145228e8364b for instance with vm_state building and task_state spawning.
Nov 08 04:00:34 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:00:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 04:00:34 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Instance spawned successfully.
Nov 08 04:00:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 04:00:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:00:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:00:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:00:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:00:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:00:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:00:34 user nova-compute[75014]: INFO nova.compute.manager [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Took 6.81 seconds to spawn the instance on the hypervisor.
Nov 08 04:00:34 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:00:34 user nova-compute[75014]: INFO nova.compute.manager [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Took 7.91 seconds to build instance.
Nov 08 04:00:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a5387d3c-2dae-42b4-a47d-cdf5311ce60c tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lock "e432a710-90cd-4b46-8b49-f6b3ab8480dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.158s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:34 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:00:34 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Took 1.03 seconds to deallocate network for instance.
Nov 08 04:00:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "c23c9e00-b782-4530-bb01-a7a167951c1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "c23c9e00-b782-4530-bb01-a7a167951c1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:35 user nova-compute[75014]: DEBUG nova.compute.manager [req-043185ef-a30a-4d18-b547-e0d188e41d1d req-1b0611f6-10d6-40a3-8d04-c9337404d4d1 service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Received event network-vif-plugged-c45eca82-c80d-4ee4-87d6-dc301fd5f760 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:00:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-043185ef-a30a-4d18-b547-e0d188e41d1d req-1b0611f6-10d6-40a3-8d04-c9337404d4d1 service nova] Acquiring lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-043185ef-a30a-4d18-b547-e0d188e41d1d req-1b0611f6-10d6-40a3-8d04-c9337404d4d1 service nova] Lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-043185ef-a30a-4d18-b547-e0d188e41d1d req-1b0611f6-10d6-40a3-8d04-c9337404d4d1 service nova] Lock "af246bb7-2e77-469b-bf98-cf05b467255c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:35 user nova-compute[75014]: DEBUG nova.compute.manager [req-043185ef-a30a-4d18-b547-e0d188e41d1d req-1b0611f6-10d6-40a3-8d04-c9337404d4d1 service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] No waiting events found dispatching network-vif-plugged-c45eca82-c80d-4ee4-87d6-dc301fd5f760 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:00:35 user nova-compute[75014]: WARNING nova.compute.manager [req-043185ef-a30a-4d18-b547-e0d188e41d1d req-1b0611f6-10d6-40a3-8d04-c9337404d4d1 service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Received unexpected event network-vif-plugged-c45eca82-c80d-4ee4-87d6-dc301fd5f760 for instance with vm_state active and task_state deleting.
Nov 08 04:00:35 user nova-compute[75014]: DEBUG nova.compute.manager [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 04:00:35 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:00:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:35 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:00:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:35 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 04:00:35 user nova-compute[75014]: INFO nova.compute.claims [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Claim successful on node user
Nov 08 04:00:35 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Refreshing inventories for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 04:00:35 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Updating ProviderTree inventory for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 04:00:35 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Updating inventory in ProviderTree for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 04:00:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:35 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Refreshing aggregate associations for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0, aggregates: None {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 04:00:35 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Refreshing trait associations for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 04:00:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:35 user nova-compute[75014]: INFO nova.compute.manager [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Took 1.02 seconds to detach 1 volumes for instance.
Nov 08 04:00:35 user nova-compute[75014]: DEBUG nova.compute.manager [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Deleting volume: d3fe5b4d-0559-4f95-b369-6d3cf54dc012 {{(pid=75014) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 04:00:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:36 user nova-compute[75014]: DEBUG nova.compute.manager [req-a94e4794-9d33-4161-850d-d8a40cbd91b6 req-a04826c7-23a4-47b1-85c9-c107013143bf service nova] [instance: af246bb7-2e77-469b-bf98-cf05b467255c] Received event network-vif-deleted-c45eca82-c80d-4ee4-87d6-dc301fd5f760 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:00:36 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:00:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:36 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:00:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.034s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:36 user nova-compute[75014]: DEBUG nova.compute.manager [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 04:00:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.269s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:36 user nova-compute[75014]: DEBUG nova.compute.manager [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 04:00:36 user nova-compute[75014]: DEBUG nova.network.neutron [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 04:00:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:00:36 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 04:00:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:36 user nova-compute[75014]: DEBUG nova.compute.manager [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 04:00:36 user nova-compute[75014]: DEBUG nova.policy [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8398fcf62a014e7f943bff6fcc3f72f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9ecaed30ba4ad1a9d5eaca02633604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 04:00:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:36 user nova-compute[75014]: DEBUG nova.compute.manager [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 04:00:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 04:00:36 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Creating image(s)
Nov 08 04:00:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "/opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "/opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "/opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.213s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:37 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:00:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:37 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:00:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.235s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.909s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk 1073741824" returned: 0 in 0.075s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.329s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:37 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Deleted allocations for instance af246bb7-2e77-469b-bf98-cf05b467255c
Nov 08 04:00:37 user nova-compute[75014]: DEBUG nova.network.neutron [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Successfully created port: 4f3b192f-a567-463a-b120-1b328e11feaa {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 04:00:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94391dc2-758d-483f-a814-a2ab46e8b033/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0e26064f-6a36-40bb-9c49-78f8a3d3fae2 tempest-ServerActionsV293TestJSON-344745944 tempest-ServerActionsV293TestJSON-344745944-project-member] Lock "af246bb7-2e77-469b-bf98-cf05b467255c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.894s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.202s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:37 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 04:00:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94391dc2-758d-483f-a814-a2ab46e8b033/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94391dc2-758d-483f-a814-a2ab46e8b033/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:37 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Cannot resize image /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 04:00:37 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 04:00:37 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Ensure instance console log exists: /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:00:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94391dc2-758d-483f-a814-a2ab46e8b033/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.network.neutron [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Successfully updated port: 4f3b192f-a567-463a-b120-1b328e11feaa {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "refresh_cache-c23c9e00-b782-4530-bb01-a7a167951c1d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquired lock "refresh_cache-c23c9e00-b782-4530-bb01-a7a167951c1d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.network.neutron [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.compute.manager [req-41ce283c-45d1-4fca-a47b-9d270c62d544 req-532f1daf-d146-440c-a634-07feee90a493 service nova] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Received event network-changed-4f3b192f-a567-463a-b120-1b328e11feaa {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.compute.manager [req-41ce283c-45d1-4fca-a47b-9d270c62d544 req-532f1daf-d146-440c-a634-07feee90a493 service nova] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Refreshing instance network info cache due to event network-changed-4f3b192f-a567-463a-b120-1b328e11feaa. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-41ce283c-45d1-4fca-a47b-9d270c62d544 req-532f1daf-d146-440c-a634-07feee90a493 service nova] Acquiring lock "refresh_cache-c23c9e00-b782-4530-bb01-a7a167951c1d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.network.neutron [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.network.neutron [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Updating instance_info_cache with network_info: [{"id": "4f3b192f-a567-463a-b120-1b328e11feaa", "address": "fa:16:3e:70:b6:a1", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3b192f-a5", "ovs_interfaceid": "4f3b192f-a567-463a-b120-1b328e11feaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Releasing lock "refresh_cache-c23c9e00-b782-4530-bb01-a7a167951c1d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.compute.manager [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Instance network_info: |[{"id": "4f3b192f-a567-463a-b120-1b328e11feaa", "address": "fa:16:3e:70:b6:a1", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3b192f-a5", "ovs_interfaceid": "4f3b192f-a567-463a-b120-1b328e11feaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-41ce283c-45d1-4fca-a47b-9d270c62d544 req-532f1daf-d146-440c-a634-07feee90a493 service nova] Acquired lock "refresh_cache-c23c9e00-b782-4530-bb01-a7a167951c1d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.network.neutron [req-41ce283c-45d1-4fca-a47b-9d270c62d544 req-532f1daf-d146-440c-a634-07feee90a493 service nova] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Refreshing network info cache for port 4f3b192f-a567-463a-b120-1b328e11feaa {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Start _get_guest_xml network_info=[{"id": "4f3b192f-a567-463a-b120-1b328e11feaa", "address": "fa:16:3e:70:b6:a1", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3b192f-a5", "ovs_interfaceid": "4f3b192f-a567-463a-b120-1b328e11feaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:00:38 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:00:38 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:00:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-508777179',display_name='tempest-ServerActionsTestOtherA-server-508777179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-508777179',id=27,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrmtIbZxgIG+Mj0FCPzPyxgkvpjo1RlPcXcxfMKotFzO42Fyp9FxpoU2iamZDPiUFM+ibJrBLSV5KEQ2GBDLuvdHnBp4eyBffs9QFbrBPe1RSRIG54GYFQAZ3CvgZJG1Q==',key_name='tempest-keypair-516992333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b9ecaed30ba4ad1a9d5eaca02633604',ramdisk_id='',reservation_id='r-nt4tf759',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-537496863',owner_user_name='tempest-ServerActionsTestOtherA-537496863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:00:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8398fcf62a014e7f943bff6fcc3f72f3',uuid=c23c9e00-b782-4530-bb01-a7a167951c1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f3b192f-a567-463a-b120-1b328e11feaa", "address": "fa:16:3e:70:b6:a1", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3b192f-a5", "ovs_interfaceid": "4f3b192f-a567-463a-b120-1b328e11feaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Converting VIF {"id": "4f3b192f-a567-463a-b120-1b328e11feaa", "address": "fa:16:3e:70:b6:a1", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3b192f-a5", "ovs_interfaceid": "4f3b192f-a567-463a-b120-1b328e11feaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:b6:a1,bridge_name='br-int',has_traffic_filtering=True,id=4f3b192f-a567-463a-b120-1b328e11feaa,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f3b192f-a5') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.objects.instance [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lazy-loading 'pci_devices' on Instance uuid c23c9e00-b782-4530-bb01-a7a167951c1d {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:00:38 user nova-compute[75014]:   <uuid>c23c9e00-b782-4530-bb01-a7a167951c1d</uuid>
Nov 08 04:00:38 user nova-compute[75014]:   <name>instance-0000001b</name>
Nov 08 04:00:38 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:00:38 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:00:38 user nova-compute[75014]:   <metadata>
Nov 08 04:00:38 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:00:38 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:00:38 user nova-compute[75014]:       <nova:name>tempest-ServerActionsTestOtherA-server-508777179</nova:name>
Nov 08 04:00:38 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:00:38</nova:creationTime>
Nov 08 04:00:38 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:00:38 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:00:38 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:00:38 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:00:38 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:00:38 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:00:38 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:00:38 user nova-compute[75014]:       <nova:owner>
Nov 08 04:00:38 user nova-compute[75014]:         <nova:user uuid="8398fcf62a014e7f943bff6fcc3f72f3">tempest-ServerActionsTestOtherA-537496863-project-member</nova:user>
Nov 08 04:00:38 user nova-compute[75014]:         <nova:project uuid="7b9ecaed30ba4ad1a9d5eaca02633604">tempest-ServerActionsTestOtherA-537496863</nova:project>
Nov 08 04:00:38 user nova-compute[75014]:       </nova:owner>
Nov 08 04:00:38 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:00:38 user nova-compute[75014]:       <nova:ports>
Nov 08 04:00:38 user nova-compute[75014]:         <nova:port uuid="4f3b192f-a567-463a-b120-1b328e11feaa">
Nov 08 04:00:38 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 04:00:38 user nova-compute[75014]:         </nova:port>
Nov 08 04:00:38 user nova-compute[75014]:       </nova:ports>
Nov 08 04:00:38 user nova-compute[75014]:     </nova:instance>
Nov 08 04:00:38 user nova-compute[75014]:   </metadata>
Nov 08 04:00:38 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:00:38 user nova-compute[75014]:     <system>
Nov 08 04:00:38 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:00:38 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:00:38 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:00:38 user nova-compute[75014]:       <entry name="serial">c23c9e00-b782-4530-bb01-a7a167951c1d</entry>
Nov 08 04:00:38 user nova-compute[75014]:       <entry name="uuid">c23c9e00-b782-4530-bb01-a7a167951c1d</entry>
Nov 08 04:00:38 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:00:38 user nova-compute[75014]:     </system>
Nov 08 04:00:38 user nova-compute[75014]:   </sysinfo>
Nov 08 04:00:38 user nova-compute[75014]:   <os>
Nov 08 04:00:38 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:00:38 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:00:38 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:00:38 user nova-compute[75014]:   </os>
Nov 08 04:00:38 user nova-compute[75014]:   <features>
Nov 08 04:00:38 user nova-compute[75014]:     <acpi/>
Nov 08 04:00:38 user nova-compute[75014]:     <apic/>
Nov 08 04:00:38 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:00:38 user nova-compute[75014]:   </features>
Nov 08 04:00:38 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:00:38 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:00:38 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:00:38 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:00:38 user nova-compute[75014]:   </clock>
Nov 08 04:00:38 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:00:38 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:00:38 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:00:38 user nova-compute[75014]:   </cpu>
Nov 08 04:00:38 user nova-compute[75014]:   <devices>
Nov 08 04:00:38 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 04:00:38 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 04:00:38 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk"/>
Nov 08 04:00:38 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:00:38 user nova-compute[75014]:     </disk>
Nov 08 04:00:38 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:00:38 user nova-compute[75014]:       <mac address="fa:16:3e:70:b6:a1"/>
Nov 08 04:00:38 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:00:38 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:00:38 user nova-compute[75014]:       <target dev="tap4f3b192f-a5"/>
Nov 08 04:00:38 user nova-compute[75014]:     </interface>
Nov 08 04:00:38 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:00:38 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/console.log" append="off"/>
Nov 08 04:00:38 user nova-compute[75014]:     </serial>
Nov 08 04:00:38 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:00:38 user nova-compute[75014]:     <video>
Nov 08 04:00:38 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:00:38 user nova-compute[75014]:     </video>
Nov 08 04:00:38 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:00:38 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:00:38 user nova-compute[75014]:     </rng>
Nov 08 04:00:38 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:00:38 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:00:38 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:00:38 user nova-compute[75014]:     </memballoon>
Nov 08 04:00:38 user nova-compute[75014]:   </devices>
Nov 08 04:00:38 user nova-compute[75014]: </domain>
Nov 08 04:00:38 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:00:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-508777179',display_name='tempest-ServerActionsTestOtherA-server-508777179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-508777179',id=27,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrmtIbZxgIG+Mj0FCPzPyxgkvpjo1RlPcXcxfMKotFzO42Fyp9FxpoU2iamZDPiUFM+ibJrBLSV5KEQ2GBDLuvdHnBp4eyBffs9QFbrBPe1RSRIG54GYFQAZ3CvgZJG1Q==',key_name='tempest-keypair-516992333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b9ecaed30ba4ad1a9d5eaca02633604',ramdisk_id='',reservation_id='r-nt4tf759',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-537496863',owner_user_name='tempest-ServerActionsTestOtherA-537496863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:00:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8398fcf62a014e7f943bff6fcc3f72f3',uuid=c23c9e00-b782-4530-bb01-a7a167951c1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f3b192f-a567-463a-b120-1b328e11feaa", "address": "fa:16:3e:70:b6:a1", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3b192f-a5", "ovs_interfaceid": "4f3b192f-a567-463a-b120-1b328e11feaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Converting VIF {"id": "4f3b192f-a567-463a-b120-1b328e11feaa", "address": "fa:16:3e:70:b6:a1", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3b192f-a5", "ovs_interfaceid": "4f3b192f-a567-463a-b120-1b328e11feaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:b6:a1,bridge_name='br-int',has_traffic_filtering=True,id=4f3b192f-a567-463a-b120-1b328e11feaa,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f3b192f-a5') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG os_vif [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:b6:a1,bridge_name='br-int',has_traffic_filtering=True,id=4f3b192f-a567-463a-b120-1b328e11feaa,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f3b192f-a5') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22374bec-299c-55a9-8252-37cb952af690', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f3b192f-a5, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4f3b192f-a5, col_values=(('qos', UUID('80f3036d-6a80-498e-bd88-35656a26c037')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4f3b192f-a5, col_values=(('external_ids', {'iface-id': '4f3b192f-a567-463a-b120-1b328e11feaa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:b6:a1', 'vm-uuid': 'c23c9e00-b782-4530-bb01-a7a167951c1d'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:00:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:38 user nova-compute[75014]: INFO os_vif [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:b6:a1,bridge_name='br-int',has_traffic_filtering=True,id=4f3b192f-a567-463a-b120-1b328e11feaa,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f3b192f-a5')
Nov 08 04:00:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:00:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] No VIF found with MAC fa:16:3e:70:b6:a1, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:00:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.310s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:39 user nova-compute[75014]: DEBUG nova.network.neutron [req-41ce283c-45d1-4fca-a47b-9d270c62d544 req-532f1daf-d146-440c-a634-07feee90a493 service nova] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Updated VIF entry in instance network info cache for port 4f3b192f-a567-463a-b120-1b328e11feaa. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:00:39 user nova-compute[75014]: DEBUG nova.network.neutron [req-41ce283c-45d1-4fca-a47b-9d270c62d544 req-532f1daf-d146-440c-a634-07feee90a493 service nova] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Updating instance_info_cache with network_info: [{"id": "4f3b192f-a567-463a-b120-1b328e11feaa", "address": "fa:16:3e:70:b6:a1", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3b192f-a5", "ovs_interfaceid": "4f3b192f-a567-463a-b120-1b328e11feaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:00:39 user nova-compute[75014]: DEBUG nova.compute.manager [req-7800f53a-cc8c-43ba-85ee-7d7bfcd31bf3 req-3ebe9f3f-415b-4de5-a165-bcb4c975319c service nova] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Received event network-changed-ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:00:39 user nova-compute[75014]: DEBUG nova.compute.manager [req-7800f53a-cc8c-43ba-85ee-7d7bfcd31bf3 req-3ebe9f3f-415b-4de5-a165-bcb4c975319c service nova] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Refreshing instance network info cache due to event network-changed-ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:00:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-7800f53a-cc8c-43ba-85ee-7d7bfcd31bf3 req-3ebe9f3f-415b-4de5-a165-bcb4c975319c service nova] Acquiring lock "refresh_cache-9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:00:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-7800f53a-cc8c-43ba-85ee-7d7bfcd31bf3 req-3ebe9f3f-415b-4de5-a165-bcb4c975319c service nova] Acquired lock "refresh_cache-9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:00:39 user nova-compute[75014]: DEBUG nova.network.neutron [req-7800f53a-cc8c-43ba-85ee-7d7bfcd31bf3 req-3ebe9f3f-415b-4de5-a165-bcb4c975319c service nova] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Refreshing network info cache for port ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:00:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-41ce283c-45d1-4fca-a47b-9d270c62d544 req-532f1daf-d146-440c-a634-07feee90a493 service nova] Releasing lock "refresh_cache-c23c9e00-b782-4530-bb01-a7a167951c1d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:00:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:39 user nova-compute[75014]: DEBUG nova.network.neutron [req-7800f53a-cc8c-43ba-85ee-7d7bfcd31bf3 req-3ebe9f3f-415b-4de5-a165-bcb4c975319c service nova] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Updated VIF entry in instance network info cache for port ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:00:39 user nova-compute[75014]: DEBUG nova.network.neutron [req-7800f53a-cc8c-43ba-85ee-7d7bfcd31bf3 req-3ebe9f3f-415b-4de5-a165-bcb4c975319c service nova] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Updating instance_info_cache with network_info: [{"id": "ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba", "address": "fa:16:3e:8f:4a:4b", "network": {"id": "6e103f9f-8ed5-4e53-ac4a-85f3151d3e9e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-641600740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deb879b910c742f6a0fbf17bf0909da3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf8cfd7-cb", "ovs_interfaceid": "ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:00:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-7800f53a-cc8c-43ba-85ee-7d7bfcd31bf3 req-3ebe9f3f-415b-4de5-a165-bcb4c975319c service nova] Releasing lock "refresh_cache-9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TecQhnoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:00:40 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:00:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:00:40 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:00:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:00:40 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4a6fd3-1f87-4ade-89a7-0a25c9939119]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:00:40 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e432a710-90cd-4b46-8b49-f6b3ab8480dc/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02fe577-3e3f-4a6c-936b-84624bb60cd9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a] added
Nov 08 04:00:40 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c593a469-ef05-4f89-8c1f-f217df78d4e9]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[77121091-8706-45d2-b1f3-617bf7a670d9]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TecQhnoO {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TecQhnoO" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[81689f80-ee0e-4fe8-83d3-6d9c16772118]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TecQhnoO'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[18860341-067b-4195-b74d-ee3bb52ad2f7]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[72dd72fc-92db-43d2-8827-5bd377ec2632]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:00:40 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:00:40 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:00:40 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:00:40 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:00:40 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:00:40 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e432a710-90cd-4b46-8b49-f6b3ab8480dc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e432a710-90cd-4b46-8b49-f6b3ab8480dc/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91f0a38-3b20-4f1b-873c-316a4bb1ed70]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a, portal: 172.16.0.220,3260]
Nov 08 04:00:40 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a, portal: 172.16.0.220,3260] successful.
Nov 08 04:00:40 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[566e9884-5c0b-4528-8965-c3c81288c06a]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0bbbb9-cc73-41fe-8950-2f4b9d19b42b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:00:40 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:00:40 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:00:40 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:00:40 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:00:40 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:00:40 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:00:40 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:00:40 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a4c594-3c79-4a0a-b35d-5c29c1856076]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TecQhnoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e432a710-90cd-4b46-8b49-f6b3ab8480dc/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG nova.compute.manager [req-0a512b2f-3832-4f0b-a912-b2f8b6cd4429 req-0780eff9-ff52-4d95-b029-3fc68e6661ad service nova] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Received event network-vif-plugged-4f3b192f-a567-463a-b120-1b328e11feaa {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0a512b2f-3832-4f0b-a912-b2f8b6cd4429 req-0780eff9-ff52-4d95-b029-3fc68e6661ad service nova] Acquiring lock "c23c9e00-b782-4530-bb01-a7a167951c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0a512b2f-3832-4f0b-a912-b2f8b6cd4429 req-0780eff9-ff52-4d95-b029-3fc68e6661ad service nova] Lock "c23c9e00-b782-4530-bb01-a7a167951c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0a512b2f-3832-4f0b-a912-b2f8b6cd4429 req-0780eff9-ff52-4d95-b029-3fc68e6661ad service nova] Lock "c23c9e00-b782-4530-bb01-a7a167951c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG nova.compute.manager [req-0a512b2f-3832-4f0b-a912-b2f8b6cd4429 req-0780eff9-ff52-4d95-b029-3fc68e6661ad service nova] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] No waiting events found dispatching network-vif-plugged-4f3b192f-a567-463a-b120-1b328e11feaa {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:00:40 user nova-compute[75014]: WARNING nova.compute.manager [req-0a512b2f-3832-4f0b-a912-b2f8b6cd4429 req-0780eff9-ff52-4d95-b029-3fc68e6661ad service nova] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Received unexpected event network-vif-plugged-4f3b192f-a567-463a-b120-1b328e11feaa for instance with vm_state building and task_state spawning.
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.875s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] <== connect_volume: return (2878ms) {'type': 'block', 'scsi_wwn': '26164333636343635', 'path': '/dev/sdb'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164333636343635', 'path': '/dev/sdb'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-65fd1414-440c-4003-ba42-a75755977c5f req-44840b3e-26de-44b3-9688-7ed067ebfa2d service nova] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Received event network-vif-plugged-4f3b192f-a567-463a-b120-1b328e11feaa {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-65fd1414-440c-4003-ba42-a75755977c5f req-44840b3e-26de-44b3-9688-7ed067ebfa2d service nova] Acquiring lock "c23c9e00-b782-4530-bb01-a7a167951c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-65fd1414-440c-4003-ba42-a75755977c5f req-44840b3e-26de-44b3-9688-7ed067ebfa2d service nova] Lock "c23c9e00-b782-4530-bb01-a7a167951c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-65fd1414-440c-4003-ba42-a75755977c5f req-44840b3e-26de-44b3-9688-7ed067ebfa2d service nova] Lock "c23c9e00-b782-4530-bb01-a7a167951c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-65fd1414-440c-4003-ba42-a75755977c5f req-44840b3e-26de-44b3-9688-7ed067ebfa2d service nova] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] No waiting events found dispatching network-vif-plugged-4f3b192f-a567-463a-b120-1b328e11feaa {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:00:43 user nova-compute[75014]: WARNING nova.compute.manager [req-65fd1414-440c-4003-ba42-a75755977c5f req-44840b3e-26de-44b3-9688-7ed067ebfa2d service nova] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Received unexpected event network-vif-plugged-4f3b192f-a567-463a-b120-1b328e11feaa for instance with vm_state building and task_state spawning.
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.compute.manager [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 04:00:43 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:00:43 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=7159MB free_disk=24.877471923828125GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.objects.instance [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lazy-loading 'flavor' on Instance uuid bd153f84-98cd-4c6d-a7ab-5759b0b5bf55 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:00:43 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Instance spawned successfully.
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 04:00:43 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:00:43 user nova-compute[75014]:   <source dev="/dev/sdb"/>
Nov 08 04:00:43 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:00:43 user nova-compute[75014]:   <serial>65b5a229-3d47-4b3c-bfec-b2ea92cb906a</serial>
Nov 08 04:00:43 user nova-compute[75014]: </disk>
Nov 08 04:00:43 user nova-compute[75014]:  {{(pid=75014) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 04:00:43 user nova-compute[75014]: INFO nova.compute.manager [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Took 6.42 seconds to spawn the instance on the hypervisor.
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.compute.manager [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9f205fe5-576f-4ef0-874b-1544c0307a7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 5bfa6580-e0fe-46b0-b497-8db67806113a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 8527ee40-fb8a-469b-9696-d7bde8cc96f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 655fe5eb-1271-4b9f-a5a6-6342bd012a69 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance bd153f84-98cd-4c6d-a7ab-5759b0b5bf55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 691bf2a3-13b2-466c-90a3-8dd01dfc18cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance d4726cd1-51ea-41e2-ad36-be12b4d4c26b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 44d4794d-91c4-4eb6-a752-37f587f2b420 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 5c23c904-7d83-489c-bb45-04add15c2bf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance d555b6b3-86ec-40ae-aa20-48846b5157d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 94391dc2-758d-483f-a814-a2ab46e8b033 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance e432a710-90cd-4b46-8b49-f6b3ab8480dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance c23c9e00-b782-4530-bb01-a7a167951c1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:00:43 user nova-compute[75014]: INFO nova.compute.manager [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Took 8.11 seconds to build instance.
Nov 08 04:00:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-08809b4d-851a-438a-a504-c711fb09fd61 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "c23c9e00-b782-4530-bb01-a7a167951c1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.230s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] No VIF found with MAC fa:16:3e:d8:7a:3e, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2a3eb123-ea23-477b-99d9-f5cb26365d8d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.789s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.701s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Cleaning up deleted instances {{(pid=75014) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] There are 0 instances to clean {{(pid=75014) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:00:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:44 user nova-compute[75014]: INFO nova.compute.manager [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Rescuing
Nov 08 04:00:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Acquiring lock "refresh_cache-bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:00:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Acquired lock "refresh_cache-bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:00:44 user nova-compute[75014]: DEBUG nova.network.neutron [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:00:45 user nova-compute[75014]: DEBUG nova.network.neutron [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Updating instance_info_cache with network_info: [{"id": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "address": "fa:16:3e:d8:7a:3e", "network": {"id": "64afeb98-3d7d-4d85-a8ac-2deff17e7463", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-737690621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05de04b5317b4257b434019a2db27f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d19a877-95", "ovs_interfaceid": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:00:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Releasing lock "refresh_cache-bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:00:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:45 user nova-compute[75014]: DEBUG nova.compute.manager [req-d5dfa0c9-c27c-493d-b9ff-40f2a6aa6d2c req-43f83ba0-6bdd-41b2-a48a-d777b4da37fd service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Received event network-vif-unplugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:00:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d5dfa0c9-c27c-493d-b9ff-40f2a6aa6d2c req-43f83ba0-6bdd-41b2-a48a-d777b4da37fd service nova] Acquiring lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d5dfa0c9-c27c-493d-b9ff-40f2a6aa6d2c req-43f83ba0-6bdd-41b2-a48a-d777b4da37fd service nova] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d5dfa0c9-c27c-493d-b9ff-40f2a6aa6d2c req-43f83ba0-6bdd-41b2-a48a-d777b4da37fd service nova] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:45 user nova-compute[75014]: DEBUG nova.compute.manager [req-d5dfa0c9-c27c-493d-b9ff-40f2a6aa6d2c req-43f83ba0-6bdd-41b2-a48a-d777b4da37fd service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] No waiting events found dispatching network-vif-unplugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:00:45 user nova-compute[75014]: WARNING nova.compute.manager [req-d5dfa0c9-c27c-493d-b9ff-40f2a6aa6d2c req-43f83ba0-6bdd-41b2-a48a-d777b4da37fd service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Received unexpected event network-vif-unplugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 for instance with vm_state active and task_state rescuing.
Nov 08 04:00:46 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Instance destroyed successfully.
Nov 08 04:00:46 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Attempting a stable device rescue
Nov 08 04:00:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75014) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 04:00:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Instance directory exists: not creating {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 04:00:46 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Creating image(s)
Nov 08 04:00:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "/opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "/opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:46 user nova-compute[75014]: DEBUG nova.objects.instance [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lazy-loading 'trusted_certs' on Instance uuid bd153f84-98cd-4c6d-a7ab-5759b0b5bf55 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:00:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Acquiring lock "70b06594db4f69fb72e7d52bead792bddac47eb6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "70b06594db4f69fb72e7d52bead792bddac47eb6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/70b06594db4f69fb72e7d52bead792bddac47eb6.part --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/70b06594db4f69fb72e7d52bead792bddac47eb6.part --force-share --output=json" returned: 0 in 0.182s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:47 user nova-compute[75014]: DEBUG nova.virt.images [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] 6ba84865-46d6-48b2-a00d-5f900b02253a was qcow2, converting to raw {{(pid=75014) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 04:00:47 user nova-compute[75014]: DEBUG nova.privsep.utils [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75014) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 04:00:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/70b06594db4f69fb72e7d52bead792bddac47eb6.part /opt/stack/data/nova/instances/_base/70b06594db4f69fb72e7d52bead792bddac47eb6.converted {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/70b06594db4f69fb72e7d52bead792bddac47eb6.part /opt/stack/data/nova/instances/_base/70b06594db4f69fb72e7d52bead792bddac47eb6.converted" returned: 0 in 0.244s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/70b06594db4f69fb72e7d52bead792bddac47eb6.converted --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:47 user nova-compute[75014]: DEBUG nova.compute.manager [req-a16baaae-326d-4523-a892-d79bafd9084f req-a9304ae3-12de-4bd9-8a3f-d3a696a4037e service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Received event network-vif-plugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:00:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a16baaae-326d-4523-a892-d79bafd9084f req-a9304ae3-12de-4bd9-8a3f-d3a696a4037e service nova] Acquiring lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a16baaae-326d-4523-a892-d79bafd9084f req-a9304ae3-12de-4bd9-8a3f-d3a696a4037e service nova] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a16baaae-326d-4523-a892-d79bafd9084f req-a9304ae3-12de-4bd9-8a3f-d3a696a4037e service nova] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:47 user nova-compute[75014]: DEBUG nova.compute.manager [req-a16baaae-326d-4523-a892-d79bafd9084f req-a9304ae3-12de-4bd9-8a3f-d3a696a4037e service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] No waiting events found dispatching network-vif-plugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:00:47 user nova-compute[75014]: WARNING nova.compute.manager [req-a16baaae-326d-4523-a892-d79bafd9084f req-a9304ae3-12de-4bd9-8a3f-d3a696a4037e service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Received unexpected event network-vif-plugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 for instance with vm_state active and task_state rescuing.
Nov 08 04:00:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/70b06594db4f69fb72e7d52bead792bddac47eb6.converted --force-share --output=json" returned: 0 in 0.201s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "70b06594db4f69fb72e7d52bead792bddac47eb6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.529s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Acquiring lock "70b06594db4f69fb72e7d52bead792bddac47eb6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "70b06594db4f69fb72e7d52bead792bddac47eb6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/70b06594db4f69fb72e7d52bead792bddac47eb6 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:47 user nova-compute[75014]: DEBUG nova.objects.instance [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lazy-loading 'flavor' on Instance uuid 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:00:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/70b06594db4f69fb72e7d52bead792bddac47eb6 --force-share --output=json" returned: 0 in 0.187s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/70b06594db4f69fb72e7d52bead792bddac47eb6,backing_fmt=raw /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk.rescue {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/70b06594db4f69fb72e7d52bead792bddac47eb6,backing_fmt=raw /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk.rescue" returned: 0 in 0.046s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "70b06594db4f69fb72e7d52bead792bddac47eb6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.objects.instance [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lazy-loading 'migration_context' on Instance uuid bd153f84-98cd-4c6d-a7ab-5759b0b5bf55 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.objects.base [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Object Instance<bd153f84-98cd-4c6d-a7ab-5759b0b5bf55> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Start _get_guest_xml network_info=[{"id": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "address": "fa:16:3e:d8:7a:3e", "network": {"id": "64afeb98-3d7d-4d85-a8ac-2deff17e7463", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-737690621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-737690621-network", "vif_mac": "fa:16:3e:d8:7a:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05de04b5317b4257b434019a2db27f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d19a877-95", "ovs_interfaceid": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6ba84865-46d6-48b2-a00d-5f900b02253a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TecQhnoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'bd153f84-98cd-4c6d-a7ab-5759b0b5bf55', 'attached_at': '', 'detached_at': '', 'volume_id': '65b5a229-3d47-4b3c-bfec-b2ea92cb906a', 'serial': '65b5a229-3d47-4b3c-bfec-b2ea92cb906a'}, 'device_type': 'disk', 'attachment_id': '1b2dd320-6258-4dc8-8c2c-f38ed6733c93', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.objects.instance [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lazy-loading 'resources' on Instance uuid bd153f84-98cd-4c6d-a7ab-5759b0b5bf55 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.objects.base [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Object Instance<bd153f84-98cd-4c6d-a7ab-5759b0b5bf55> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.objects.instance [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lazy-loading 'numa_topology' on Instance uuid bd153f84-98cd-4c6d-a7ab-5759b0b5bf55 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:48 user nova-compute[75014]: INFO nova.compute.manager [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Attaching volume de7b3943-b00c-4fa6-b643-8330e73fb282 to /dev/vdb
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.objects.base [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Object Instance<bd153f84-98cd-4c6d-a7ab-5759b0b5bf55> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:00:48 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:00:48 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.objects.instance [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lazy-loading 'vcpu_model' on Instance uuid bd153f84-98cd-4c6d-a7ab-5759b0b5bf55 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.objects.base [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Object Instance<bd153f84-98cd-4c6d-a7ab-5759b0b5bf55> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TecQhnoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:00:48 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:00:48 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:00:48 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:00:48 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:00:48 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:00:48 user nova-compute[75014]: DEBUG os_brick.utils [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[946e0f27-4bc0-4d5a-b2bd-feb2c8eab65a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = TecQhnoO\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 08 04:00:48 user nova-compute[75014]: node.name = iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a
Nov 08 04:00:48 user nova-compute[75014]: node.tpgt = -1
Nov 08 04:00:48 user nova-compute[75014]: node.startup = automatic
Nov 08 04:00:48 user nova-compute[75014]: node.leading_login = No
Nov 08 04:00:48 user nova-compute[75014]: iface.iscsi_ifacename = default
Nov 08 04:00:48 user nova-compute[75014]: iface.net_ifacename = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.ipaddress = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.prefix_len = 0
Nov 08 04:00:48 user nova-compute[75014]: iface.hwaddress = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.transport_name = tcp
Nov 08 04:00:48 user nova-compute[75014]: iface.initiatorname = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.state = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.vlan_id = 0
Nov 08 04:00:48 user nova-compute[75014]: iface.vlan_priority = 0
Nov 08 04:00:48 user nova-compute[75014]: iface.vlan_state = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.iface_num = 0
Nov 08 04:00:48 user nova-compute[75014]: iface.mtu = 0
Nov 08 04:00:48 user nova-compute[75014]: iface.port = 0
Nov 08 04:00:48 user nova-compute[75014]: iface.bootproto = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.subnet_mask = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.gateway = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.dhcp_alt_client_id_state = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.dhcp_alt_client_id = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.dhcp_dns = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.dhcp_learn_iqn = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.dhcp_req_vendor_id_state = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.dhcp_vendor_id_state = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.dhcp_vendor_id = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.dhcp_slp_da = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.fragmentation = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.gratuitous_arp = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.incoming_forwarding = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.tos_state = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.tos = 0
Nov 08 04:00:48 user nova-compute[75014]: iface.ttl = 0
Nov 08 04:00:48 user nova-compute[75014]: iface.delayed_ack = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.tcp_nagle = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.tcp_wsf_state = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.tcp_wsf = 0
Nov 08 04:00:48 user nova-compute[75014]: iface.tcp_timer_scale = 0
Nov 08 04:00:48 user nova-compute[75014]: iface.tcp_timestamp = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.redirect = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.def_task_mgmt_timeout = 0
Nov 08 04:00:48 user nova-compute[75014]: iface.header_digest = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.data_digest = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.immediate_data = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.initial_r2t = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.data_seq_inorder = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.data_pdu_inorder = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.erl = 0
Nov 08 04:00:48 user nova-compute[75014]: iface.max_receive_data_len = 0
Nov 08 04:00:48 user nova-compute[75014]: iface.first_burst_len = 0
Nov 08 04:00:48 user nova-compute[75014]: iface.max_outstanding_r2t = 0
Nov 08 04:00:48 user nova-compute[75014]: iface.max_burst_len = 0
Nov 08 04:00:48 user nova-compute[75014]: iface.chap_auth = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.bidi_chap = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.strict_login_compliance = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.discovery_auth = <empty>
Nov 08 04:00:48 user nova-compute[75014]: iface.discovery_logout = <empty>
Nov 08 04:00:48 user nova-compute[75014]: node.discovery_address = <empty>
Nov 08 04:00:48 user nova-compute[75014]: node.discovery_port = 0
Nov 08 04:00:48 user nova-compute[75014]: node.discovery_type = static
Nov 08 04:00:48 user nova-compute[75014]: node.session.initial_cmdsn = 0
Nov 08 04:00:48 user nova-compute[75014]: node.session.initial_login_retry_max = 8
Nov 08 04:00:48 user nova-compute[75014]: node.session.xmit_thread_priority = -20
Nov 08 04:00:48 user nova-compute[75014]: node.session.cmds_max = 128
Nov 08 04:00:48 user nova-compute[75014]: node.session.queue_depth = 32
Nov 08 04:00:48 user nova-compute[75014]: node.session.nr_sessions = 1
Nov 08 04:00:48 user nova-compute[75014]: node.session.auth.authmethod = CHAP
Nov 08 04:00:48 user nova-compute[75014]: node.session.auth.username = TecQhnoO
Nov 08 04:00:48 user nova-compute[75014]: node.session.auth.password = ***
Nov 08 04:00:48 user nova-compute[75014]: node.session.auth.username_in = <empty>
Nov 08 04:00:48 user nova-compute[75014]: node.session.auth.password_in = <empty>
Nov 08 04:00:48 user nova-compute[75014]: node.session.auth.chap_algs = MD5
Nov 08 04:00:48 user nova-compute[75014]: node.session.timeo.replacement_timeout = 120
Nov 08 04:00:48 user nova-compute[75014]: node.session.err_timeo.abort_timeout = 15
Nov 08 04:00:48 user nova-compute[75014]: node.session.err_timeo.lu_reset_timeout = 30
Nov 08 04:00:48 user nova-compute[75014]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 08 04:00:48 user nova-compute[75014]: node.session.err_timeo.host_reset_timeout = 60
Nov 08 04:00:48 user nova-compute[75014]: node.session.iscsi.FastAbort = Yes
Nov 08 04:00:48 user nova-compute[75014]: node.session.iscsi.InitialR2T = No
Nov 08 04:00:48 user nova-compute[75014]: node.session.iscsi.ImmediateData = Yes
Nov 08 04:00:48 user nova-compute[75014]: node.session.iscsi.FirstBurstLength = 262144
Nov 08 04:00:48 user nova-compute[75014]: node.session.iscsi.MaxBurstLength = 16776192
Nov 08 04:00:48 user nova-compute[75014]: node.session.iscsi.DefaultTime2Retain = 0
Nov 08 04:00:48 user nova-compute[75014]: node.session.iscsi.DefaultTime2Wait = 2
Nov 08 04:00:48 user nova-compute[75014]: node.session.iscsi.MaxConnections = 1
Nov 08 04:00:48 user nova-compute[75014]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 08 04:00:48 user nova-compute[75014]: node.session.iscsi.ERL = 0
Nov 08 04:00:48 user nova-compute[75014]: node.session.scan = manual
Nov 08 04:00:48 user nova-compute[75014]: node.session.reopen_max = 0
Nov 08 04:00:48 user nova-compute[75014]: node.conn[0].address = 172.16.0.220
Nov 08 04:00:48 user nova-compute[75014]: node.conn[0].port = 3260
Nov 08 04:00:48 user nova-compute[75014]: node.conn[0].startup = manual
Nov 08 04:00:48 user nova-compute[75014]: node.conn[0].tcp.window_size = 524288
Nov 08 04:00:48 user nova-compute[75014]: node.conn[0].tcp.type_of_service = 0
Nov 08 04:00:48 user nova-compute[75014]: node.conn[0].timeo.logout_timeout = 15
Nov 08 04:00:48 user nova-compute[75014]: node.conn[0].timeo.login_timeout = 15
Nov 08 04:00:48 user nova-compute[75014]: node.conn[0].timeo.auth_timeout = 45
Nov 08 04:00:48 user nova-compute[75014]: node.conn[0].timeo.noop_out_interval = 5
Nov 08 04:00:48 user nova-compute[75014]: node.conn[0].timeo.noop_out_timeout = 5
Nov 08 04:00:48 user nova-compute[75014]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 08 04:00:48 user nova-compute[75014]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 08 04:00:48 user nova-compute[75014]: node.conn[0].iscsi.HeaderDigest = None
Nov 08 04:00:48 user nova-compute[75014]: node.conn[0].iscsi.DataDigest = None
Nov 08 04:00:48 user nova-compute[75014]: node.conn[0].iscsi.IFMarker = No
Nov 08 04:00:48 user nova-compute[75014]: node.conn[0].iscsi.OFMarker = No
Nov 08 04:00:48 user nova-compute[75014]: # END RECORD
Nov 08 04:00:48 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[22aa9039-209e-4ee8-b360-33c60efdf6a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c64975-6a8b-41ab-90d2-dac2c02d5359]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c88592-3e34-4a2c-bfe6-653b15eeac99]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48cf38b-0fa0-494e-ac5c-4d0dcd43a8c3]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TecQhnoO {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a8d9a1-6c47-43be-a664-31434a6bdbf0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca791bc-f84e-4aab-b6ae-473c5554ebf3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TecQhnoO" returned: 0 in 0.035s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5ec900-e193-43e6-875b-4ce855d4c8c9]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TecQhnoO'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:00:48 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[352d4d06-0d5e-4f89-8368-92a4f40c5f02]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG os_brick.utils [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Updating existing volume attachment record: 3722b132-db74-4794-8b1d-8442dfb4affe {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbb38ed-b258-4b9b-a708-da61e121f6a6]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf5fb7b-1b44-4f83-a35d-8feae7374152]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:00:48 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:00:48 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:00:48 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:00:48 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:00:48 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:00:48 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:00:48 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:00:48 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.214s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] HCTL ('33', '0', '0', 0) found on session 16 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fc4e50-d22e-46a3-ba05-11b4c6305aa3]: (4, ('0 0 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Searching for a device in session 16 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TecQhnoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.241s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] <== connect_volume: return (243ms) {'type': 'block', 'scsi_wwn': '26164333636343635', 'path': '/dev/sdb'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164333636343635', 'path': '/dev/sdb'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-514356008',display_name='tempest-ServerStableDeviceRescueTest-server-514356008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-514356008',id=16,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdDQJUVzJSfwf8EGORwnY5XfvHz/nPlQSVwKWVNMxL13SpO76KX4Hqf7Y0N0SVtjIZCj3Tmkh993LwJ0b5WvZMVqXeJWMWUVI/ttUuEC5MJ6286g6JwsMIVJtb/liLMRQ==',key_name='tempest-keypair-466253599',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:56:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05de04b5317b4257b434019a2db27f18',ramdisk_id='',reservation_id='r-h300xedb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-981631959',owner_user_name='tempest-ServerStableDeviceRescueTest-981631959-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:58:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fe8ccd73ce4d66938868007c49f4a1',uuid=bd153f84-98cd-4c6d-a7ab-5759b0b5bf55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "address": "fa:16:3e:d8:7a:3e", "network": {"id": "64afeb98-3d7d-4d85-a8ac-2deff17e7463", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-737690621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-737690621-network", "vif_mac": "fa:16:3e:d8:7a:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05de04b5317b4257b434019a2db27f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d19a877-95", "ovs_interfaceid": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Converting VIF {"id": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "address": "fa:16:3e:d8:7a:3e", "network": {"id": "64afeb98-3d7d-4d85-a8ac-2deff17e7463", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-737690621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-737690621-network", "vif_mac": "fa:16:3e:d8:7a:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05de04b5317b4257b434019a2db27f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d19a877-95", "ovs_interfaceid": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:7a:3e,bridge_name='br-int',has_traffic_filtering=True,id=2d19a877-95a3-4cc5-b98f-c5a097a01304,network=Network(64afeb98-3d7d-4d85-a8ac-2deff17e7463),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d19a877-95') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.objects.instance [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lazy-loading 'pci_devices' on Instance uuid bd153f84-98cd-4c6d-a7ab-5759b0b5bf55 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.objects.base [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Object Instance<bd153f84-98cd-4c6d-a7ab-5759b0b5bf55> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:00:48 user nova-compute[75014]:   <uuid>bd153f84-98cd-4c6d-a7ab-5759b0b5bf55</uuid>
Nov 08 04:00:48 user nova-compute[75014]:   <name>instance-00000010</name>
Nov 08 04:00:48 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:00:48 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:00:48 user nova-compute[75014]:   <metadata>
Nov 08 04:00:48 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:00:48 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:00:48 user nova-compute[75014]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-514356008</nova:name>
Nov 08 04:00:48 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:00:48</nova:creationTime>
Nov 08 04:00:48 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:00:48 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:00:48 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:00:48 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:00:48 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:00:48 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:00:48 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:00:48 user nova-compute[75014]:       <nova:owner>
Nov 08 04:00:48 user nova-compute[75014]:         <nova:user uuid="75fe8ccd73ce4d66938868007c49f4a1">tempest-ServerStableDeviceRescueTest-981631959-project-member</nova:user>
Nov 08 04:00:48 user nova-compute[75014]:         <nova:project uuid="05de04b5317b4257b434019a2db27f18">tempest-ServerStableDeviceRescueTest-981631959</nova:project>
Nov 08 04:00:48 user nova-compute[75014]:       </nova:owner>
Nov 08 04:00:48 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:00:48 user nova-compute[75014]:       <nova:ports>
Nov 08 04:00:48 user nova-compute[75014]:         <nova:port uuid="2d19a877-95a3-4cc5-b98f-c5a097a01304">
Nov 08 04:00:48 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 04:00:48 user nova-compute[75014]:         </nova:port>
Nov 08 04:00:48 user nova-compute[75014]:       </nova:ports>
Nov 08 04:00:48 user nova-compute[75014]:     </nova:instance>
Nov 08 04:00:48 user nova-compute[75014]:   </metadata>
Nov 08 04:00:48 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:00:48 user nova-compute[75014]:     <system>
Nov 08 04:00:48 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:00:48 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:00:48 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:00:48 user nova-compute[75014]:       <entry name="serial">bd153f84-98cd-4c6d-a7ab-5759b0b5bf55</entry>
Nov 08 04:00:48 user nova-compute[75014]:       <entry name="uuid">bd153f84-98cd-4c6d-a7ab-5759b0b5bf55</entry>
Nov 08 04:00:48 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:00:48 user nova-compute[75014]:     </system>
Nov 08 04:00:48 user nova-compute[75014]:   </sysinfo>
Nov 08 04:00:48 user nova-compute[75014]:   <os>
Nov 08 04:00:48 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:00:48 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:00:48 user nova-compute[75014]:   </os>
Nov 08 04:00:48 user nova-compute[75014]:   <features>
Nov 08 04:00:48 user nova-compute[75014]:     <acpi/>
Nov 08 04:00:48 user nova-compute[75014]:     <apic/>
Nov 08 04:00:48 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:00:48 user nova-compute[75014]:   </features>
Nov 08 04:00:48 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:00:48 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:00:48 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:00:48 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:00:48 user nova-compute[75014]:   </clock>
Nov 08 04:00:48 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:00:48 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:00:48 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:00:48 user nova-compute[75014]:   </cpu>
Nov 08 04:00:48 user nova-compute[75014]:   <devices>
Nov 08 04:00:48 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 04:00:48 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 04:00:48 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk"/>
Nov 08 04:00:48 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:00:48 user nova-compute[75014]:     </disk>
Nov 08 04:00:48 user nova-compute[75014]:     <disk type="block" device="disk">
Nov 08 04:00:48 user nova-compute[75014]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:00:48 user nova-compute[75014]:       <source dev="/dev/sdb"/>
Nov 08 04:00:48 user nova-compute[75014]:       <target dev="vdb" bus="virtio"/>
Nov 08 04:00:48 user nova-compute[75014]:       <serial>65b5a229-3d47-4b3c-bfec-b2ea92cb906a</serial>
Nov 08 04:00:48 user nova-compute[75014]:     </disk>
Nov 08 04:00:48 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 04:00:48 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 04:00:48 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk.rescue"/>
Nov 08 04:00:48 user nova-compute[75014]:       <target dev="vdc" bus="virtio"/>
Nov 08 04:00:48 user nova-compute[75014]:       <boot order="1"/>
Nov 08 04:00:48 user nova-compute[75014]:     </disk>
Nov 08 04:00:48 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:00:48 user nova-compute[75014]:       <mac address="fa:16:3e:d8:7a:3e"/>
Nov 08 04:00:48 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:00:48 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:00:48 user nova-compute[75014]:       <target dev="tap2d19a877-95"/>
Nov 08 04:00:48 user nova-compute[75014]:     </interface>
Nov 08 04:00:48 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:00:48 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/console.log" append="off"/>
Nov 08 04:00:48 user nova-compute[75014]:     </serial>
Nov 08 04:00:48 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:00:48 user nova-compute[75014]:     <video>
Nov 08 04:00:48 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:00:48 user nova-compute[75014]:     </video>
Nov 08 04:00:48 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:00:48 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:00:48 user nova-compute[75014]:     </rng>
Nov 08 04:00:48 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:00:48 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:00:48 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:00:48 user nova-compute[75014]:     </memballoon>
Nov 08 04:00:48 user nova-compute[75014]:   </devices>
Nov 08 04:00:48 user nova-compute[75014]: </domain>
Nov 08 04:00:48 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:00:48 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Instance destroyed successfully.
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] No VIF found with MAC fa:16:3e:d8:7a:3e, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:00:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:50 user nova-compute[75014]: DEBUG nova.compute.manager [req-464e0872-cb9d-4538-be76-d7059c1c4652 req-bc40a7d8-5b0b-4d2d-9009-0dce7c2c6d78 service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Received event network-vif-plugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:00:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-464e0872-cb9d-4538-be76-d7059c1c4652 req-bc40a7d8-5b0b-4d2d-9009-0dce7c2c6d78 service nova] Acquiring lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-464e0872-cb9d-4538-be76-d7059c1c4652 req-bc40a7d8-5b0b-4d2d-9009-0dce7c2c6d78 service nova] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-464e0872-cb9d-4538-be76-d7059c1c4652 req-bc40a7d8-5b0b-4d2d-9009-0dce7c2c6d78 service nova] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:50 user nova-compute[75014]: DEBUG nova.compute.manager [req-464e0872-cb9d-4538-be76-d7059c1c4652 req-bc40a7d8-5b0b-4d2d-9009-0dce7c2c6d78 service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] No waiting events found dispatching network-vif-plugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:00:50 user nova-compute[75014]: WARNING nova.compute.manager [req-464e0872-cb9d-4538-be76-d7059c1c4652 req-bc40a7d8-5b0b-4d2d-9009-0dce7c2c6d78 service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Received unexpected event network-vif-plugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 for instance with vm_state active and task_state rescuing.
Nov 08 04:00:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:52 user nova-compute[75014]: DEBUG nova.compute.manager [req-349caf02-75fa-4199-96ba-b54ccfd4accd req-7b89d31f-c4ad-4998-9ade-ec14e3b85c36 service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Received event network-vif-plugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:00:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-349caf02-75fa-4199-96ba-b54ccfd4accd req-7b89d31f-c4ad-4998-9ade-ec14e3b85c36 service nova] Acquiring lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-349caf02-75fa-4199-96ba-b54ccfd4accd req-7b89d31f-c4ad-4998-9ade-ec14e3b85c36 service nova] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-349caf02-75fa-4199-96ba-b54ccfd4accd req-7b89d31f-c4ad-4998-9ade-ec14e3b85c36 service nova] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:52 user nova-compute[75014]: DEBUG nova.compute.manager [req-349caf02-75fa-4199-96ba-b54ccfd4accd req-7b89d31f-c4ad-4998-9ade-ec14e3b85c36 service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] No waiting events found dispatching network-vif-plugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:00:52 user nova-compute[75014]: WARNING nova.compute.manager [req-349caf02-75fa-4199-96ba-b54ccfd4accd req-7b89d31f-c4ad-4998-9ade-ec14e3b85c36 service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Received unexpected event network-vif-plugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 for instance with vm_state active and task_state rescuing.
Nov 08 04:00:52 user nova-compute[75014]: DEBUG nova.compute.manager [None req-483a7653-7de6-49e1-87b0-3fd2f5799f5d tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:00:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:56 user nova-compute[75014]: DEBUG nova.compute.manager [req-1efcd951-9191-4999-b904-692df2b046ab req-f87195a9-0f72-4e14-a4f0-f49da8d220e1 service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Received event network-changed-564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:00:56 user nova-compute[75014]: DEBUG nova.compute.manager [req-1efcd951-9191-4999-b904-692df2b046ab req-f87195a9-0f72-4e14-a4f0-f49da8d220e1 service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Refreshing instance network info cache due to event network-changed-564c15b6-eb02-4a0c-8b00-d611297ac247. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:00:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1efcd951-9191-4999-b904-692df2b046ab req-f87195a9-0f72-4e14-a4f0-f49da8d220e1 service nova] Acquiring lock "refresh_cache-d4726cd1-51ea-41e2-ad36-be12b4d4c26b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:00:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1efcd951-9191-4999-b904-692df2b046ab req-f87195a9-0f72-4e14-a4f0-f49da8d220e1 service nova] Acquired lock "refresh_cache-d4726cd1-51ea-41e2-ad36-be12b4d4c26b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:00:56 user nova-compute[75014]: DEBUG nova.network.neutron [req-1efcd951-9191-4999-b904-692df2b046ab req-f87195a9-0f72-4e14-a4f0-f49da8d220e1 service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Refreshing network info cache for port 564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:00:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:00:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:57 user nova-compute[75014]: DEBUG nova.objects.instance [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lazy-loading 'flavor' on Instance uuid d4726cd1-51ea-41e2-ad36-be12b4d4c26b {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:00:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:00:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:00:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:00:57 user nova-compute[75014]: INFO nova.compute.manager [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Attaching volume c4874793-2dda-4382-8193-78c9540c5908 to /dev/vdb
Nov 08 04:00:57 user nova-compute[75014]: DEBUG os_brick.utils [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:00:57 user nova-compute[75014]: DEBUG nova.network.neutron [req-1efcd951-9191-4999-b904-692df2b046ab req-f87195a9-0f72-4e14-a4f0-f49da8d220e1 service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Updated VIF entry in instance network info cache for port 564c15b6-eb02-4a0c-8b00-d611297ac247. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:00:57 user nova-compute[75014]: DEBUG nova.network.neutron [req-1efcd951-9191-4999-b904-692df2b046ab req-f87195a9-0f72-4e14-a4f0-f49da8d220e1 service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Updating instance_info_cache with network_info: [{"id": "564c15b6-eb02-4a0c-8b00-d611297ac247", "address": "fa:16:3e:60:c7:25", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap564c15b6-eb", "ovs_interfaceid": "564c15b6-eb02-4a0c-8b00-d611297ac247", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:00:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:57 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[778341cf-7f02-4906-a1ab-66b5cd6efbe8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1efcd951-9191-4999-b904-692df2b046ab req-f87195a9-0f72-4e14-a4f0-f49da8d220e1 service nova] Releasing lock "refresh_cache-d4726cd1-51ea-41e2-ad36-be12b4d4c26b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:00:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:57 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8f0a03-7e20-4285-96a1-ada8f3a3ae68]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:00:57 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4b3666-3bc5-4fe1-a6c9-08e0bb65b409]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:57 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[55470bc4-11e6-4d0f-a76a-e5fb4bc0d02c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:00:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:00:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:00:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:00:57 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:00:57 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cd8518-5257-41e9-91ce-23d368fbc96d]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:00:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:00:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:00:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:00:57 user nova-compute[75014]: DEBUG os_brick.utils [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:00:57 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Updating existing volume attachment record: 4865a33a-525a-4498-af5c-961f14133438 {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:00:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "44d4794d-91c4-4eb6-a752-37f587f2b420" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:01:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "44d4794d-91c4-4eb6-a752-37f587f2b420" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:01:10 user nova-compute[75014]: DEBUG nova.objects.instance [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lazy-loading 'flavor' on Instance uuid 44d4794d-91c4-4eb6-a752-37f587f2b420 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:01:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "44d4794d-91c4-4eb6-a752-37f587f2b420" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG nova.compute.manager [req-b960d815-3fc3-40eb-915d-7ab1b9ea78a7 req-b582af22-f180-4590-8b0c-37e8e994fb2d service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Received event network-changed-eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG nova.compute.manager [req-b960d815-3fc3-40eb-915d-7ab1b9ea78a7 req-b582af22-f180-4590-8b0c-37e8e994fb2d service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Refreshing instance network info cache due to event network-changed-eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b960d815-3fc3-40eb-915d-7ab1b9ea78a7 req-b582af22-f180-4590-8b0c-37e8e994fb2d service nova] Acquiring lock "refresh_cache-5c23c904-7d83-489c-bb45-04add15c2bf6" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b960d815-3fc3-40eb-915d-7ab1b9ea78a7 req-b582af22-f180-4590-8b0c-37e8e994fb2d service nova] Acquired lock "refresh_cache-5c23c904-7d83-489c-bb45-04add15c2bf6" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG nova.network.neutron [req-b960d815-3fc3-40eb-915d-7ab1b9ea78a7 req-b582af22-f180-4590-8b0c-37e8e994fb2d service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Refreshing network info cache for port eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9b19e9b9-8230-4623-8f67-d4c5cc967dfb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Acquiring lock "interface-5c23c904-7d83-489c-bb45-04add15c2bf6-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9b19e9b9-8230-4623-8f67-d4c5cc967dfb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lock "interface-5c23c904-7d83-489c-bb45-04add15c2bf6-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG nova.objects.instance [None req-9b19e9b9-8230-4623-8f67-d4c5cc967dfb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lazy-loading 'flavor' on Instance uuid 5c23c904-7d83-489c-bb45-04add15c2bf6 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "44d4794d-91c4-4eb6-a752-37f587f2b420" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "44d4794d-91c4-4eb6-a752-37f587f2b420" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:01:11 user nova-compute[75014]: INFO nova.compute.manager [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Attaching volume 24d32672-c667-4adb-84b1-0dece53e7d7b to /dev/vdb
Nov 08 04:01:11 user nova-compute[75014]: DEBUG os_brick.utils [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d1b995-0437-4a7f-89ab-0683472395fa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c013d001-f528-4bfd-8cd1-b54c7f3098f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b5e38a-500f-4c7e-a2ab-4caa7281e383]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea7a215-5d51-488c-b3d1-0c8b8829c6f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:01:11 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:01:11 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53bf2ca-98a6-409a-813b-5595270964ce]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG os_brick.utils [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Updating existing volume attachment record: 5b64cc42-e7c5-442d-8607-de4d46fac4f3 {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG nova.network.neutron [req-b960d815-3fc3-40eb-915d-7ab1b9ea78a7 req-b582af22-f180-4590-8b0c-37e8e994fb2d service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Updated VIF entry in instance network info cache for port eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG nova.network.neutron [req-b960d815-3fc3-40eb-915d-7ab1b9ea78a7 req-b582af22-f180-4590-8b0c-37e8e994fb2d service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Updating instance_info_cache with network_info: [{"id": "eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f", "address": "fa:16:3e:e1:e9:27", "network": {"id": "aec98e5a-5443-47fc-80ec-7aeaafb548c5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2062049335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e1d4a398f55459aaa5526ef57b816ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb7a20ed-c5", "ovs_interfaceid": "eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b960d815-3fc3-40eb-915d-7ab1b9ea78a7 req-b582af22-f180-4590-8b0c-37e8e994fb2d service nova] Releasing lock "refresh_cache-5c23c904-7d83-489c-bb45-04add15c2bf6" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG nova.objects.instance [None req-9b19e9b9-8230-4623-8f67-d4c5cc967dfb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lazy-loading 'pci_requests' on Instance uuid 5c23c904-7d83-489c-bb45-04add15c2bf6 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG nova.objects.base [None req-9b19e9b9-8230-4623-8f67-d4c5cc967dfb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Object Instance<5c23c904-7d83-489c-bb45-04add15c2bf6> lazy-loaded attributes: flavor,pci_requests {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG nova.network.neutron [None req-9b19e9b9-8230-4623-8f67-d4c5cc967dfb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 04:01:11 user nova-compute[75014]: DEBUG nova.policy [None req-9b19e9b9-8230-4623-8f67-d4c5cc967dfb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '685cdd725739412982a0d768ca78b325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1d4a398f55459aaa5526ef57b816ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 04:01:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:12 user nova-compute[75014]: DEBUG nova.network.neutron [None req-9b19e9b9-8230-4623-8f67-d4c5cc967dfb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Successfully created port: 5a2c52cf-1fbe-4c48-b782-e221e1251c45 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 04:01:12 user nova-compute[75014]: DEBUG nova.network.neutron [None req-9b19e9b9-8230-4623-8f67-d4c5cc967dfb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Successfully updated port: 5a2c52cf-1fbe-4c48-b782-e221e1251c45 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 04:01:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9b19e9b9-8230-4623-8f67-d4c5cc967dfb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Acquiring lock "refresh_cache-5c23c904-7d83-489c-bb45-04add15c2bf6" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:01:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9b19e9b9-8230-4623-8f67-d4c5cc967dfb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Acquired lock "refresh_cache-5c23c904-7d83-489c-bb45-04add15c2bf6" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:01:12 user nova-compute[75014]: DEBUG nova.network.neutron [None req-9b19e9b9-8230-4623-8f67-d4c5cc967dfb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:01:12 user nova-compute[75014]: DEBUG nova.compute.manager [req-f1c55fe0-3a6d-40be-9afd-dc7b4ae1b574 req-cb2cfc83-1561-4c4b-bc8d-d3ee0e5f0a55 service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Received event network-changed-5a2c52cf-1fbe-4c48-b782-e221e1251c45 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:01:12 user nova-compute[75014]: DEBUG nova.compute.manager [req-f1c55fe0-3a6d-40be-9afd-dc7b4ae1b574 req-cb2cfc83-1561-4c4b-bc8d-d3ee0e5f0a55 service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Refreshing instance network info cache due to event network-changed-5a2c52cf-1fbe-4c48-b782-e221e1251c45. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:01:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f1c55fe0-3a6d-40be-9afd-dc7b4ae1b574 req-cb2cfc83-1561-4c4b-bc8d-d3ee0e5f0a55 service nova] Acquiring lock "refresh_cache-5c23c904-7d83-489c-bb45-04add15c2bf6" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MExPpRDs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:01:13 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:01:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:01:13 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:01:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:01:13 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4da4d7-2860-448e-900f-ed68392558e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:01:13 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6589c8-cf0e-4afb-962c-c10b4c06ee92]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282] added
Nov 08 04:01:13 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[724a5ebd-b3ba-44d4-89eb-c1b383146027]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7529172-b1dd-4ca8-afb7-fb254854c205]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MExPpRDs {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MExPpRDs" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b095cdeb-f0ed-4d5d-b016-659393f71c47]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MExPpRDs'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6afa685-08cd-47c3-9ed6-e43e07a1f225]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG nova.network.neutron [None req-9b19e9b9-8230-4623-8f67-d4c5cc967dfb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Updating instance_info_cache with network_info: [{"id": "eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f", "address": "fa:16:3e:e1:e9:27", "network": {"id": "aec98e5a-5443-47fc-80ec-7aeaafb548c5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2062049335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e1d4a398f55459aaa5526ef57b816ab", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb7a20ed-c5", "ovs_interfaceid": "eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a2c52cf-1fbe-4c48-b782-e221e1251c45", "address": "fa:16:3e:3f:dc:9e", "network": {"id": "fb818c50-19ce-4bc5-bdb5-bfdc8410c008", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-947199703", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9e1d4a398f55459aaa5526ef57b816ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2c52cf-1f", "ovs_interfaceid": "5a2c52cf-1fbe-4c48-b782-e221e1251c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4f95ba-6b72-4f4c-9caf-75f52898c493]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:01:13 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:01:13 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:01:13 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:01:13 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:01:13 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:01:13 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:01:13 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:01:13 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9b19e9b9-8230-4623-8f67-d4c5cc967dfb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Releasing lock "refresh_cache-5c23c904-7d83-489c-bb45-04add15c2bf6" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f1c55fe0-3a6d-40be-9afd-dc7b4ae1b574 req-cb2cfc83-1561-4c4b-bc8d-d3ee0e5f0a55 service nova] Acquired lock "refresh_cache-5c23c904-7d83-489c-bb45-04add15c2bf6" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG nova.network.neutron [req-f1c55fe0-3a6d-40be-9afd-dc7b4ae1b574 req-cb2cfc83-1561-4c4b-bc8d-d3ee0e5f0a55 service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Refreshing network info cache for port 5a2c52cf-1fbe-4c48-b782-e221e1251c45 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-9b19e9b9-8230-4623-8f67-d4c5cc967dfb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-974517943',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-974517943',id=23,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdPXIOA7/TBoq0/votl12iKLEhI7NRfXy6j2NIlXxKNWayc0DBpjQWW2qoeBSHfSuOgOB6ZxxP+O5TEB48eK0wLHpB0ujWsQOr2xATZarqhcb9XmT1u6oZJjB9db9Gzpw==',key_name='tempest-keypair-275261075',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:59:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9e1d4a398f55459aaa5526ef57b816ab',ramdisk_id='',reservation_id='r-nodg7g02',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1223504486',owner_user_name='tempest-TaggedAttachmentsTest-1223504486-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T03:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='685cdd725739412982a0d768ca78b325',uuid=5c23c904-7d83-489c-bb45-04add15c2bf6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a2c52cf-1fbe-4c48-b782-e221e1251c45", "address": "fa:16:3e:3f:dc:9e", "network": {"id": "fb818c50-19ce-4bc5-bdb5-bfdc8410c008", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-947199703", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9e1d4a398f55459aaa5526ef57b816ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2c52cf-1f", "ovs_interfaceid": "5a2c52cf-1fbe-4c48-b782-e221e1251c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-9b19e9b9-8230-4623-8f67-d4c5cc967dfb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Converting VIF {"id": "5a2c52cf-1fbe-4c48-b782-e221e1251c45", "address": "fa:16:3e:3f:dc:9e", "network": {"id": "fb818c50-19ce-4bc5-bdb5-bfdc8410c008", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-947199703", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9e1d4a398f55459aaa5526ef57b816ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2c52cf-1f", "ovs_interfaceid": "5a2c52cf-1fbe-4c48-b782-e221e1251c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-9b19e9b9-8230-4623-8f67-d4c5cc967dfb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:dc:9e,bridge_name='br-int',has_traffic_filtering=True,id=5a2c52cf-1fbe-4c48-b782-e221e1251c45,network=Network(fb818c50-19ce-4bc5-bdb5-bfdc8410c008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2c52cf-1f') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG os_vif [None req-9b19e9b9-8230-4623-8f67-d4c5cc967dfb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:dc:9e,bridge_name='br-int',has_traffic_filtering=True,id=5a2c52cf-1fbe-4c48-b782-e221e1251c45,network=Network(fb818c50-19ce-4bc5-bdb5-bfdc8410c008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2c52cf-1f') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3455ba8a-5ea0-54bd-ae21-8eba16599071', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a2c52cf-1f, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a2c52cf-1f, col_values=(('qos', UUID('364abd1e-ee41-4bf1-8504-88fbf3cd48c2')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a2c52cf-1f, col_values=(('external_ids', {'iface-id': '5a2c52cf-1fbe-4c48-b782-e221e1251c45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:dc:9e', 'vm-uuid': '5c23c904-7d83-489c-bb45-04add15c2bf6'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:13 user nova-compute[75014]: INFO os_vif [None req-9b19e9b9-8230-4623-8f67-d4c5cc967dfb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:dc:9e,bridge_name='br-int',has_traffic_filtering=True,id=5a2c52cf-1fbe-4c48-b782-e221e1251c45,network=Network(fb818c50-19ce-4bc5-bdb5-bfdc8410c008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2c52cf-1f')
Nov 08 04:01:13 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-9b19e9b9-8230-4623-8f67-d4c5cc967dfb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-974517943',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-974517943',id=23,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdPXIOA7/TBoq0/votl12iKLEhI7NRfXy6j2NIlXxKNWayc0DBpjQWW2qoeBSHfSuOgOB6ZxxP+O5TEB48eK0wLHpB0ujWsQOr2xATZarqhcb9XmT1u6oZJjB9db9Gzpw==',key_name='tempest-keypair-275261075',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:59:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9e1d4a398f55459aaa5526ef57b816ab',ramdisk_id='',reservation_id='r-nodg7g02',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1223504486',owner_user_name='tempest-TaggedAttachmentsTest-1223504486-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T03:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='685cdd725739412982a0d768ca78b325',uuid=5c23c904-7d83-489c-bb45-04add15c2bf6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a2c52cf-1fbe-4c48-b782-e221e1251c45", "address": "fa:16:3e:3f:dc:9e", "network": {"id": "fb818c50-19ce-4bc5-bdb5-bfdc8410c008", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-947199703", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9e1d4a398f55459aaa5526ef57b816ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2c52cf-1f", "ovs_interfaceid": "5a2c52cf-1fbe-4c48-b782-e221e1251c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-9b19e9b9-8230-4623-8f67-d4c5cc967dfb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Converting VIF {"id": "5a2c52cf-1fbe-4c48-b782-e221e1251c45", "address": "fa:16:3e:3f:dc:9e", "network": {"id": "fb818c50-19ce-4bc5-bdb5-bfdc8410c008", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-947199703", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9e1d4a398f55459aaa5526ef57b816ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2c52cf-1f", "ovs_interfaceid": "5a2c52cf-1fbe-4c48-b782-e221e1251c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-9b19e9b9-8230-4623-8f67-d4c5cc967dfb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:dc:9e,bridge_name='br-int',has_traffic_filtering=True,id=5a2c52cf-1fbe-4c48-b782-e221e1251c45,network=Network(fb818c50-19ce-4bc5-bdb5-bfdc8410c008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2c52cf-1f') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-9b19e9b9-8230-4623-8f67-d4c5cc967dfb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] attach device xml: <interface type="ethernet">
Nov 08 04:01:13 user nova-compute[75014]:   <mac address="fa:16:3e:3f:dc:9e"/>
Nov 08 04:01:13 user nova-compute[75014]:   <model type="virtio"/>
Nov 08 04:01:13 user nova-compute[75014]:   <mtu size="1442"/>
Nov 08 04:01:13 user nova-compute[75014]:   <target dev="tap5a2c52cf-1f"/>
Nov 08 04:01:13 user nova-compute[75014]: </interface>
Nov 08 04:01:13 user nova-compute[75014]:  {{(pid=75014) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b3a40a-7649-42a5-ade7-8ae71185db70]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282, portal: 172.16.0.220,3260]
Nov 08 04:01:13 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282, portal: 172.16.0.220,3260] successful.
Nov 08 04:01:13 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b653b96-1e73-4c5c-81a4-f7fbf15cca0e]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28620bd-14e6-45f9-964a-5b4aab50a255]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:01:13 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:01:13 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:01:13 user nova-compute[75014]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)
Nov 08 04:01:13 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:01:13 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:01:13 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:01:13 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:01:13 user nova-compute[75014]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)
Nov 08 04:01:13 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:01:13 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[53aa67d8-cf02-4612-b0e7-64e88d17b29a]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MExPpRDs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG nova.network.neutron [req-f1c55fe0-3a6d-40be-9afd-dc7b4ae1b574 req-cb2cfc83-1561-4c4b-bc8d-d3ee0e5f0a55 service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Updated VIF entry in instance network info cache for port 5a2c52cf-1fbe-4c48-b782-e221e1251c45. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG nova.network.neutron [req-f1c55fe0-3a6d-40be-9afd-dc7b4ae1b574 req-cb2cfc83-1561-4c4b-bc8d-d3ee0e5f0a55 service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Updating instance_info_cache with network_info: [{"id": "eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f", "address": "fa:16:3e:e1:e9:27", "network": {"id": "aec98e5a-5443-47fc-80ec-7aeaafb548c5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2062049335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e1d4a398f55459aaa5526ef57b816ab", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb7a20ed-c5", "ovs_interfaceid": "eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a2c52cf-1fbe-4c48-b782-e221e1251c45", "address": "fa:16:3e:3f:dc:9e", "network": {"id": "fb818c50-19ce-4bc5-bdb5-bfdc8410c008", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-947199703", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9e1d4a398f55459aaa5526ef57b816ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2c52cf-1f", "ovs_interfaceid": "5a2c52cf-1fbe-4c48-b782-e221e1251c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f1c55fe0-3a6d-40be-9afd-dc7b4ae1b574 req-cb2cfc83-1561-4c4b-bc8d-d3ee0e5f0a55 service nova] Releasing lock "refresh_cache-5c23c904-7d83-489c-bb45-04add15c2bf6" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG nova.compute.manager [req-83c436a8-d1a8-486e-a323-fae48ede3e18 req-80343afa-9db2-4ff3-b9b8-09df1530e466 service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Received event network-vif-plugged-5a2c52cf-1fbe-4c48-b782-e221e1251c45 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-83c436a8-d1a8-486e-a323-fae48ede3e18 req-80343afa-9db2-4ff3-b9b8-09df1530e466 service nova] Acquiring lock "5c23c904-7d83-489c-bb45-04add15c2bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-83c436a8-d1a8-486e-a323-fae48ede3e18 req-80343afa-9db2-4ff3-b9b8-09df1530e466 service nova] Lock "5c23c904-7d83-489c-bb45-04add15c2bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-83c436a8-d1a8-486e-a323-fae48ede3e18 req-80343afa-9db2-4ff3-b9b8-09df1530e466 service nova] Lock "5c23c904-7d83-489c-bb45-04add15c2bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG nova.compute.manager [req-83c436a8-d1a8-486e-a323-fae48ede3e18 req-80343afa-9db2-4ff3-b9b8-09df1530e466 service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] No waiting events found dispatching network-vif-plugged-5a2c52cf-1fbe-4c48-b782-e221e1251c45 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:01:13 user nova-compute[75014]: WARNING nova.compute.manager [req-83c436a8-d1a8-486e-a323-fae48ede3e18 req-80343afa-9db2-4ff3-b9b8-09df1530e466 service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Received unexpected event network-vif-plugged-5a2c52cf-1fbe-4c48-b782-e221e1251c45 for instance with vm_state active and task_state None.
Nov 08 04:01:13 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9b19e9b9-8230-4623-8f67-d4c5cc967dfb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9b19e9b9-8230-4623-8f67-d4c5cc967dfb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] No BDM found with device name hda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9b19e9b9-8230-4623-8f67-d4c5cc967dfb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] No VIF found with MAC fa:16:3e:e1:e9:27, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:01:13 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-9b19e9b9-8230-4623-8f67-d4c5cc967dfb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:01:13 user nova-compute[75014]:   <nova:package version="0.0.0"/>
Nov 08 04:01:13 user nova-compute[75014]:   <nova:name>tempest-device-tagging-server-974517943</nova:name>
Nov 08 04:01:13 user nova-compute[75014]:   <nova:creationTime>2023-11-08 04:01:13</nova:creationTime>
Nov 08 04:01:13 user nova-compute[75014]:   <nova:flavor name="m1.tiny">
Nov 08 04:01:13 user nova-compute[75014]:     <nova:memory>512</nova:memory>
Nov 08 04:01:13 user nova-compute[75014]:     <nova:disk>1</nova:disk>
Nov 08 04:01:13 user nova-compute[75014]:     <nova:swap>0</nova:swap>
Nov 08 04:01:13 user nova-compute[75014]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:01:13 user nova-compute[75014]:     <nova:vcpus>1</nova:vcpus>
Nov 08 04:01:13 user nova-compute[75014]:   </nova:flavor>
Nov 08 04:01:13 user nova-compute[75014]:   <nova:owner>
Nov 08 04:01:13 user nova-compute[75014]:     <nova:user uuid="685cdd725739412982a0d768ca78b325">tempest-TaggedAttachmentsTest-1223504486-project-member</nova:user>
Nov 08 04:01:13 user nova-compute[75014]:     <nova:project uuid="9e1d4a398f55459aaa5526ef57b816ab">tempest-TaggedAttachmentsTest-1223504486</nova:project>
Nov 08 04:01:13 user nova-compute[75014]:   </nova:owner>
Nov 08 04:01:13 user nova-compute[75014]:   <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:01:13 user nova-compute[75014]:   <nova:ports>
Nov 08 04:01:13 user nova-compute[75014]:     <nova:port uuid="eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f">
Nov 08 04:01:13 user nova-compute[75014]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 04:01:13 user nova-compute[75014]:     </nova:port>
Nov 08 04:01:13 user nova-compute[75014]:     <nova:port uuid="5a2c52cf-1fbe-4c48-b782-e221e1251c45">
Nov 08 04:01:13 user nova-compute[75014]:       <nova:ip type="fixed" address="10.10.10.119" ipVersion="4"/>
Nov 08 04:01:13 user nova-compute[75014]:     </nova:port>
Nov 08 04:01:13 user nova-compute[75014]:   </nova:ports>
Nov 08 04:01:13 user nova-compute[75014]: </nova:instance>
Nov 08 04:01:13 user nova-compute[75014]:  {{(pid=75014) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9b19e9b9-8230-4623-8f67-d4c5cc967dfb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lock "interface-5c23c904-7d83-489c-bb45-04add15c2bf6-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.960s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Acquiring lock "5c23c904-7d83-489c-bb45-04add15c2bf6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lock "5c23c904-7d83-489c-bb45-04add15c2bf6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG nova.objects.instance [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lazy-loading 'flavor' on Instance uuid 5c23c904-7d83-489c-bb45-04add15c2bf6 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lock "5c23c904-7d83-489c-bb45-04add15c2bf6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23933336234303132', 'path': '/dev/sde'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933336234303132', 'path': '/dev/sde'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG nova.objects.instance [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lazy-loading 'flavor' on Instance uuid 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 04:01:14 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:01:14 user nova-compute[75014]:   <source dev="/dev/sde"/>
Nov 08 04:01:14 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:01:14 user nova-compute[75014]:   <serial>de7b3943-b00c-4fa6-b643-8330e73fb282</serial>
Nov 08 04:01:14 user nova-compute[75014]: </disk>
Nov 08 04:01:14 user nova-compute[75014]:  {{(pid=75014) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Acquiring lock "5c23c904-7d83-489c-bb45-04add15c2bf6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lock "5c23c904-7d83-489c-bb45-04add15c2bf6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:01:14 user nova-compute[75014]: INFO nova.compute.manager [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Attaching volume 985ed37e-19be-485d-acf2-943c3f13327f to /dev/vdb
Nov 08 04:01:14 user nova-compute[75014]: DEBUG os_brick.utils [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab7e6b2-5030-45aa-9836-b120efa2293f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[69735fc1-f6c4-41b9-990e-d885e2e6b773]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4805e3ea-9c12-4277-bc33-d79311a7c87c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ff5e82-56b2-4c14-b27b-fb761adcf441]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:01:14 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:01:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec969baa-21b2-40e0-a467-728317d2fafe]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG os_brick.utils [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:01:14 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Updating existing volume attachment record: ddf7be33-5a84-4456-8fb6-3197fc4d22a1 {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:01:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:01:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:01:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] No VIF found with MAC fa:16:3e:8f:4a:4b, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:01:15 user nova-compute[75014]: DEBUG nova.compute.manager [req-2df8ef7b-70f7-4b48-ba71-5eb860efff9a req-4ae1f4fe-a129-4acf-be77-bdf3f150715c service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Received event network-vif-plugged-5a2c52cf-1fbe-4c48-b782-e221e1251c45 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:01:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2df8ef7b-70f7-4b48-ba71-5eb860efff9a req-4ae1f4fe-a129-4acf-be77-bdf3f150715c service nova] Acquiring lock "5c23c904-7d83-489c-bb45-04add15c2bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:01:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2df8ef7b-70f7-4b48-ba71-5eb860efff9a req-4ae1f4fe-a129-4acf-be77-bdf3f150715c service nova] Lock "5c23c904-7d83-489c-bb45-04add15c2bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:01:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2df8ef7b-70f7-4b48-ba71-5eb860efff9a req-4ae1f4fe-a129-4acf-be77-bdf3f150715c service nova] Lock "5c23c904-7d83-489c-bb45-04add15c2bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:01:15 user nova-compute[75014]: DEBUG nova.compute.manager [req-2df8ef7b-70f7-4b48-ba71-5eb860efff9a req-4ae1f4fe-a129-4acf-be77-bdf3f150715c service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] No waiting events found dispatching network-vif-plugged-5a2c52cf-1fbe-4c48-b782-e221e1251c45 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:01:15 user nova-compute[75014]: WARNING nova.compute.manager [req-2df8ef7b-70f7-4b48-ba71-5eb860efff9a req-4ae1f4fe-a129-4acf-be77-bdf3f150715c service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Received unexpected event network-vif-plugged-5a2c52cf-1fbe-4c48-b782-e221e1251c45 for instance with vm_state active and task_state None.
Nov 08 04:01:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TlRmnGCu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:01:21 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:01:21 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:01:21 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:01:21 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:01:21 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:01:21 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67eb36c-a623-41b0-8e00-fa484fe3739e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:01:21 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a0f6e9-ee06-43eb-beea-e46ab430bde2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908] added
Nov 08 04:01:21 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[53071830-ce3e-4fa5-8287-90738dd71789]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d5758a09-9105-42cb-a0ae-3e5e61c7fd3b tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.734s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6fbede-186f-456d-847f-e3ea4d1a26ef]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TlRmnGCu {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TlRmnGCu" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c39532f-3470-49bf-ad00-f3d1a5c54f33]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TlRmnGCu'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb87988f-f2a2-4d3c-a87a-bcfb90f88a7c]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed107cda-f9cc-458c-b355-47ac4e486f8f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:01:21 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:01:21 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:01:21 user nova-compute[75014]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)
Nov 08 04:01:21 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:01:21 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:01:21 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:01:21 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:01:21 user nova-compute[75014]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)
Nov 08 04:01:21 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:01:21 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:01:21 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:22 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8417c5-b586-4f69-9d7c-a1f1f102927b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908, portal: 172.16.0.220,3260]
Nov 08 04:01:22 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908, portal: 172.16.0.220,3260] successful.
Nov 08 04:01:22 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:01:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:22 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d8b0fa-692e-4863-896f-7cd778967ec7]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:01:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:22 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e891625-deb2-46d1-9bdd-cfe31ef831eb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:01:22 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:01:22 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:01:22 user nova-compute[75014]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)
Nov 08 04:01:22 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:01:22 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:01:22 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:01:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:01:22 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:01:22 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:01:22 user nova-compute[75014]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)
Nov 08 04:01:22 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:01:22 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:01:22 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:01:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:01:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:01:22 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] HCTL ('37', '-', '-', 0) found on session 18 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:01:22 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:01:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:22 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ea82a6-1e45-44d6-9791-6c99fca30431]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:22 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:01:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TlRmnGCu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:01:23 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:01:23 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '26662316364663331', 'path': '/dev/sdf'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:01:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662316364663331', 'path': '/dev/sdf'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:01:23 user nova-compute[75014]: DEBUG nova.objects.instance [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lazy-loading 'flavor' on Instance uuid d4726cd1-51ea-41e2-ad36-be12b4d4c26b {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:01:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 04:01:23 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:01:23 user nova-compute[75014]:   <source dev="/dev/sdf"/>
Nov 08 04:01:23 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:01:23 user nova-compute[75014]:   <serial>c4874793-2dda-4382-8193-78c9540c5908</serial>
Nov 08 04:01:23 user nova-compute[75014]: </disk>
Nov 08 04:01:23 user nova-compute[75014]:  {{(pid=75014) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 04:01:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:01:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:01:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] No VIF found with MAC fa:16:3e:60:c7:25, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:01:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-25242261-5102-4a09-9527-7882b3dc42e6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.394s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:01:24 user nova-compute[75014]: INFO nova.compute.manager [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Rescuing
Nov 08 04:01:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "refresh_cache-d4726cd1-51ea-41e2-ad36-be12b4d4c26b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:01:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquired lock "refresh_cache-d4726cd1-51ea-41e2-ad36-be12b4d4c26b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:01:24 user nova-compute[75014]: DEBUG nova.network.neutron [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:01:24 user nova-compute[75014]: DEBUG nova.compute.manager [None req-b3a81585-3b91-42ef-9433-77da2e09cd11 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:01:24 user nova-compute[75014]: INFO nova.compute.manager [None req-b3a81585-3b91-42ef-9433-77da2e09cd11 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] instance snapshotting
Nov 08 04:01:24 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-b3a81585-3b91-42ef-9433-77da2e09cd11 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Beginning live snapshot process
Nov 08 04:01:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b3a81585-3b91-42ef-9433-77da2e09cd11 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json -f qcow2 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:25 user nova-compute[75014]: DEBUG nova.network.neutron [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Updating instance_info_cache with network_info: [{"id": "564c15b6-eb02-4a0c-8b00-d611297ac247", "address": "fa:16:3e:60:c7:25", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap564c15b6-eb", "ovs_interfaceid": "564c15b6-eb02-4a0c-8b00-d611297ac247", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:01:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Releasing lock "refresh_cache-d4726cd1-51ea-41e2-ad36-be12b4d4c26b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:01:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b3a81585-3b91-42ef-9433-77da2e09cd11 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json -f qcow2" returned: 0 in 0.233s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b3a81585-3b91-42ef-9433-77da2e09cd11 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json -f qcow2 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b3a81585-3b91-42ef-9433-77da2e09cd11 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json -f qcow2" returned: 0 in 0.220s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b3a81585-3b91-42ef-9433-77da2e09cd11 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:25 user nova-compute[75014]: DEBUG nova.compute.manager [req-98d13988-5ffc-4233-b745-90dc4d17d1af req-2310acff-d87c-4204-8493-4eeb06ba7259 service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Received event network-vif-unplugged-564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:01:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-98d13988-5ffc-4233-b745-90dc4d17d1af req-2310acff-d87c-4204-8493-4eeb06ba7259 service nova] Acquiring lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:01:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-98d13988-5ffc-4233-b745-90dc4d17d1af req-2310acff-d87c-4204-8493-4eeb06ba7259 service nova] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:01:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-98d13988-5ffc-4233-b745-90dc4d17d1af req-2310acff-d87c-4204-8493-4eeb06ba7259 service nova] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:01:25 user nova-compute[75014]: DEBUG nova.compute.manager [req-98d13988-5ffc-4233-b745-90dc4d17d1af req-2310acff-d87c-4204-8493-4eeb06ba7259 service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] No waiting events found dispatching network-vif-unplugged-564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:01:25 user nova-compute[75014]: WARNING nova.compute.manager [req-98d13988-5ffc-4233-b745-90dc4d17d1af req-2310acff-d87c-4204-8493-4eeb06ba7259 service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Received unexpected event network-vif-unplugged-564c15b6-eb02-4a0c-8b00-d611297ac247 for instance with vm_state active and task_state rescuing.
Nov 08 04:01:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b3a81585-3b91-42ef-9433-77da2e09cd11 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.237s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b3a81585-3b91-42ef-9433-77da2e09cd11 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5y__3uq9/ab6932dde6ed40a89c29bddbc3ff28bb.delta 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b3a81585-3b91-42ef-9433-77da2e09cd11 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5y__3uq9/ab6932dde6ed40a89c29bddbc3ff28bb.delta 1073741824" returned: 0 in 0.048s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:25 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-b3a81585-3b91-42ef-9433-77da2e09cd11 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 04:01:26 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Instance destroyed successfully.
Nov 08 04:01:26 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Attempting rescue
Nov 08 04:01:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75014) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Instance directory exists: not creating {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 04:01:26 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Creating image(s)
Nov 08 04:01:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "/opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "/opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG nova.objects.instance [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lazy-loading 'trusted_certs' on Instance uuid d4726cd1-51ea-41e2-ad36-be12b4d4c26b {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-b3a81585-3b91-42ef-9433-77da2e09cd11 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] COPY block job progress, current cursor: 196608 final cursor: 75497472 {{(pid=75014) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.201s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk.rescue {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk.rescue" returned: 0 in 0.066s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG nova.objects.instance [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lazy-loading 'migration_context' on Instance uuid d4726cd1-51ea-41e2-ad36-be12b4d4c26b {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG nova.objects.base [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Object Instance<d4726cd1-51ea-41e2-ad36-be12b4d4c26b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Start _get_guest_xml network_info=[{"id": "564c15b6-eb02-4a0c-8b00-d611297ac247", "address": "fa:16:3e:60:c7:25", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "vif_mac": "fa:16:3e:60:c7:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap564c15b6-eb", "ovs_interfaceid": "564c15b6-eb02-4a0c-8b00-d611297ac247", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '877f8699-2084-427a-babd-cf4f98c3b417', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG nova.objects.instance [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lazy-loading 'resources' on Instance uuid d4726cd1-51ea-41e2-ad36-be12b4d4c26b {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG nova.objects.base [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Object Instance<d4726cd1-51ea-41e2-ad36-be12b4d4c26b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG nova.objects.instance [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lazy-loading 'numa_topology' on Instance uuid d4726cd1-51ea-41e2-ad36-be12b4d4c26b {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG nova.objects.base [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Object Instance<d4726cd1-51ea-41e2-ad36-be12b4d4c26b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:01:26 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:01:26 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:01:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG nova.objects.instance [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lazy-loading 'vcpu_model' on Instance uuid d4726cd1-51ea-41e2-ad36-be12b4d4c26b {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:01:26 user nova-compute[75014]: DEBUG nova.objects.base [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Object Instance<d4726cd1-51ea-41e2-ad36-be12b4d4c26b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:01:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:59:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1421912526',display_name='tempest-ServerRescueNegativeTestJSON-server-1421912526',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1421912526',id=21,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFwBuDYKBVjyeJogLynZj8+TTisND9lq7izW1C75IPBZUw7A+Avd65fAZEkhYC2Vp028fHOOpOV5PXI6M6n1Bu6VpxGhH8gCkRhrS+3+7bXxUQLK7wqKxJNtOzyYg+8dw==',key_name='tempest-keypair-721990497',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:59:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b48713cc3a8e4082b76fc0408088c607',ramdisk_id='',reservation_id='r-gnos5l9u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1450625183',owner_user_name='tempest-ServerRescueNegativeTestJSON-1450625183-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T03:59:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffadb91b73464e559344658dd11bf60d',uuid=d4726cd1-51ea-41e2-ad36-be12b4d4c26b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "564c15b6-eb02-4a0c-8b00-d611297ac247", "address": "fa:16:3e:60:c7:25", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "vif_mac": "fa:16:3e:60:c7:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap564c15b6-eb", "ovs_interfaceid": "564c15b6-eb02-4a0c-8b00-d611297ac247", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:01:27 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Converting VIF {"id": "564c15b6-eb02-4a0c-8b00-d611297ac247", "address": "fa:16:3e:60:c7:25", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "vif_mac": "fa:16:3e:60:c7:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap564c15b6-eb", "ovs_interfaceid": "564c15b6-eb02-4a0c-8b00-d611297ac247", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:01:27 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:c7:25,bridge_name='br-int',has_traffic_filtering=True,id=564c15b6-eb02-4a0c-8b00-d611297ac247,network=Network(982531ca-8a2f-41de-b62e-5b43b6a45a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap564c15b6-eb') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:01:27 user nova-compute[75014]: DEBUG nova.objects.instance [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lazy-loading 'pci_devices' on Instance uuid d4726cd1-51ea-41e2-ad36-be12b4d4c26b {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:01:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:27 user nova-compute[75014]: DEBUG nova.objects.base [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Object Instance<d4726cd1-51ea-41e2-ad36-be12b4d4c26b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:01:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:01:27 user nova-compute[75014]:   <uuid>d4726cd1-51ea-41e2-ad36-be12b4d4c26b</uuid>
Nov 08 04:01:27 user nova-compute[75014]:   <name>instance-00000015</name>
Nov 08 04:01:27 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:01:27 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:01:27 user nova-compute[75014]:   <metadata>
Nov 08 04:01:27 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:01:27 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:01:27 user nova-compute[75014]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1421912526</nova:name>
Nov 08 04:01:27 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:01:26</nova:creationTime>
Nov 08 04:01:27 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:01:27 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:01:27 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:01:27 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:01:27 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:01:27 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:01:27 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:01:27 user nova-compute[75014]:       <nova:owner>
Nov 08 04:01:27 user nova-compute[75014]:         <nova:user uuid="ffadb91b73464e559344658dd11bf60d">tempest-ServerRescueNegativeTestJSON-1450625183-project-member</nova:user>
Nov 08 04:01:27 user nova-compute[75014]:         <nova:project uuid="b48713cc3a8e4082b76fc0408088c607">tempest-ServerRescueNegativeTestJSON-1450625183</nova:project>
Nov 08 04:01:27 user nova-compute[75014]:       </nova:owner>
Nov 08 04:01:27 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:01:27 user nova-compute[75014]:       <nova:ports>
Nov 08 04:01:27 user nova-compute[75014]:         <nova:port uuid="564c15b6-eb02-4a0c-8b00-d611297ac247">
Nov 08 04:01:27 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 04:01:27 user nova-compute[75014]:         </nova:port>
Nov 08 04:01:27 user nova-compute[75014]:       </nova:ports>
Nov 08 04:01:27 user nova-compute[75014]:     </nova:instance>
Nov 08 04:01:27 user nova-compute[75014]:   </metadata>
Nov 08 04:01:27 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:01:27 user nova-compute[75014]:     <system>
Nov 08 04:01:27 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:01:27 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:01:27 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:01:27 user nova-compute[75014]:       <entry name="serial">d4726cd1-51ea-41e2-ad36-be12b4d4c26b</entry>
Nov 08 04:01:27 user nova-compute[75014]:       <entry name="uuid">d4726cd1-51ea-41e2-ad36-be12b4d4c26b</entry>
Nov 08 04:01:27 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:01:27 user nova-compute[75014]:     </system>
Nov 08 04:01:27 user nova-compute[75014]:   </sysinfo>
Nov 08 04:01:27 user nova-compute[75014]:   <os>
Nov 08 04:01:27 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:01:27 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:01:27 user nova-compute[75014]:   </os>
Nov 08 04:01:27 user nova-compute[75014]:   <features>
Nov 08 04:01:27 user nova-compute[75014]:     <acpi/>
Nov 08 04:01:27 user nova-compute[75014]:     <apic/>
Nov 08 04:01:27 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:01:27 user nova-compute[75014]:   </features>
Nov 08 04:01:27 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:01:27 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:01:27 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:01:27 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:01:27 user nova-compute[75014]:   </clock>
Nov 08 04:01:27 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:01:27 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:01:27 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:01:27 user nova-compute[75014]:   </cpu>
Nov 08 04:01:27 user nova-compute[75014]:   <devices>
Nov 08 04:01:27 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 04:01:27 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 04:01:27 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk.rescue"/>
Nov 08 04:01:27 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:01:27 user nova-compute[75014]:     </disk>
Nov 08 04:01:27 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 04:01:27 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 04:01:27 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk"/>
Nov 08 04:01:27 user nova-compute[75014]:       <target dev="vdb" bus="virtio"/>
Nov 08 04:01:27 user nova-compute[75014]:     </disk>
Nov 08 04:01:27 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:01:27 user nova-compute[75014]:       <mac address="fa:16:3e:60:c7:25"/>
Nov 08 04:01:27 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:01:27 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:01:27 user nova-compute[75014]:       <target dev="tap564c15b6-eb"/>
Nov 08 04:01:27 user nova-compute[75014]:     </interface>
Nov 08 04:01:27 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:01:27 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/console.log" append="off"/>
Nov 08 04:01:27 user nova-compute[75014]:     </serial>
Nov 08 04:01:27 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:01:27 user nova-compute[75014]:     <video>
Nov 08 04:01:27 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:01:27 user nova-compute[75014]:     </video>
Nov 08 04:01:27 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:01:27 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:01:27 user nova-compute[75014]:     </rng>
Nov 08 04:01:27 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:01:27 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:01:27 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:01:27 user nova-compute[75014]:     </memballoon>
Nov 08 04:01:27 user nova-compute[75014]:   </devices>
Nov 08 04:01:27 user nova-compute[75014]: </domain>
Nov 08 04:01:27 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:01:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-b3a81585-3b91-42ef-9433-77da2e09cd11 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75014) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 04:01:27 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-b3a81585-3b91-42ef-9433-77da2e09cd11 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 04:01:27 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Instance destroyed successfully.
Nov 08 04:01:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:01:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:01:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] No VIF found with MAC fa:16:3e:60:c7:25, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:01:27 user nova-compute[75014]: DEBUG nova.privsep.utils [None req-b3a81585-3b91-42ef-9433-77da2e09cd11 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75014) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 04:01:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b3a81585-3b91-42ef-9433-77da2e09cd11 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5y__3uq9/ab6932dde6ed40a89c29bddbc3ff28bb.delta /opt/stack/data/nova/instances/snapshots/tmp5y__3uq9/ab6932dde6ed40a89c29bddbc3ff28bb {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:27 user nova-compute[75014]: DEBUG nova.compute.manager [req-0ce74126-d782-4dd3-a077-36e55241ee03 req-b36fdddf-9ad5-4636-a054-41ffdc826290 service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Received event network-vif-plugged-564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:01:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0ce74126-d782-4dd3-a077-36e55241ee03 req-b36fdddf-9ad5-4636-a054-41ffdc826290 service nova] Acquiring lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:01:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0ce74126-d782-4dd3-a077-36e55241ee03 req-b36fdddf-9ad5-4636-a054-41ffdc826290 service nova] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:01:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0ce74126-d782-4dd3-a077-36e55241ee03 req-b36fdddf-9ad5-4636-a054-41ffdc826290 service nova] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:01:27 user nova-compute[75014]: DEBUG nova.compute.manager [req-0ce74126-d782-4dd3-a077-36e55241ee03 req-b36fdddf-9ad5-4636-a054-41ffdc826290 service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] No waiting events found dispatching network-vif-plugged-564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:01:27 user nova-compute[75014]: WARNING nova.compute.manager [req-0ce74126-d782-4dd3-a077-36e55241ee03 req-b36fdddf-9ad5-4636-a054-41ffdc826290 service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Received unexpected event network-vif-plugged-564c15b6-eb02-4a0c-8b00-d611297ac247 for instance with vm_state active and task_state rescuing.
Nov 08 04:01:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b3a81585-3b91-42ef-9433-77da2e09cd11 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5y__3uq9/ab6932dde6ed40a89c29bddbc3ff28bb.delta /opt/stack/data/nova/instances/snapshots/tmp5y__3uq9/ab6932dde6ed40a89c29bddbc3ff28bb" returned: 0 in 0.321s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:27 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-b3a81585-3b91-42ef-9433-77da2e09cd11 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Snapshot extracted, beginning image upload
Nov 08 04:01:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:29 user nova-compute[75014]: DEBUG nova.compute.manager [req-447ba5b3-36b5-4453-a823-7814ae3a63c0 req-ab39fe41-438d-42be-9bd7-1afecbc5c9f4 service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Received event network-vif-plugged-564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:01:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-447ba5b3-36b5-4453-a823-7814ae3a63c0 req-ab39fe41-438d-42be-9bd7-1afecbc5c9f4 service nova] Acquiring lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:01:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-447ba5b3-36b5-4453-a823-7814ae3a63c0 req-ab39fe41-438d-42be-9bd7-1afecbc5c9f4 service nova] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:01:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-447ba5b3-36b5-4453-a823-7814ae3a63c0 req-ab39fe41-438d-42be-9bd7-1afecbc5c9f4 service nova] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:01:29 user nova-compute[75014]: DEBUG nova.compute.manager [req-447ba5b3-36b5-4453-a823-7814ae3a63c0 req-ab39fe41-438d-42be-9bd7-1afecbc5c9f4 service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] No waiting events found dispatching network-vif-plugged-564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:01:29 user nova-compute[75014]: WARNING nova.compute.manager [req-447ba5b3-36b5-4453-a823-7814ae3a63c0 req-ab39fe41-438d-42be-9bd7-1afecbc5c9f4 service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Received unexpected event network-vif-plugged-564c15b6-eb02-4a0c-8b00-d611297ac247 for instance with vm_state active and task_state rescuing.
Nov 08 04:01:29 user nova-compute[75014]: DEBUG nova.compute.manager [req-447ba5b3-36b5-4453-a823-7814ae3a63c0 req-ab39fe41-438d-42be-9bd7-1afecbc5c9f4 service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Received event network-vif-plugged-564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:01:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-447ba5b3-36b5-4453-a823-7814ae3a63c0 req-ab39fe41-438d-42be-9bd7-1afecbc5c9f4 service nova] Acquiring lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:01:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-447ba5b3-36b5-4453-a823-7814ae3a63c0 req-ab39fe41-438d-42be-9bd7-1afecbc5c9f4 service nova] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:01:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-447ba5b3-36b5-4453-a823-7814ae3a63c0 req-ab39fe41-438d-42be-9bd7-1afecbc5c9f4 service nova] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:01:29 user nova-compute[75014]: DEBUG nova.compute.manager [req-447ba5b3-36b5-4453-a823-7814ae3a63c0 req-ab39fe41-438d-42be-9bd7-1afecbc5c9f4 service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] No waiting events found dispatching network-vif-plugged-564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:01:29 user nova-compute[75014]: WARNING nova.compute.manager [req-447ba5b3-36b5-4453-a823-7814ae3a63c0 req-ab39fe41-438d-42be-9bd7-1afecbc5c9f4 service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Received unexpected event network-vif-plugged-564c15b6-eb02-4a0c-8b00-d611297ac247 for instance with vm_state active and task_state rescuing.
Nov 08 04:01:30 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-b3a81585-3b91-42ef-9433-77da2e09cd11 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Snapshot image upload complete
Nov 08 04:01:30 user nova-compute[75014]: INFO nova.compute.manager [None req-b3a81585-3b91-42ef-9433-77da2e09cd11 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Took 5.89 seconds to snapshot the instance on the hypervisor.
Nov 08 04:01:30 user nova-compute[75014]: DEBUG nova.compute.manager [None req-3adf9538-87f4-48dc-9432-b9c95fcc8e06 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:01:31 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:01:31 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:01:31 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:01:31 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:01:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:32 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:01:32 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:01:32 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Rebuilding the list of instances to heal {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 04:01:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-9f205fe5-576f-4ef0-874b-1544c0307a7e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:01:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-9f205fe5-576f-4ef0-874b-1544c0307a7e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:01:32 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 04:01:32 user nova-compute[75014]: DEBUG nova.objects.instance [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lazy-loading 'info_cache' on Instance uuid 9f205fe5-576f-4ef0-874b-1544c0307a7e {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:01:33 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Updating instance_info_cache with network_info: [{"id": "4979eddc-54c6-46e4-987a-640c4ccade99", "address": "fa:16:3e:4c:b6:69", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4979eddc-54", "ovs_interfaceid": "4979eddc-54c6-46e4-987a-640c4ccade99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:01:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-9f205fe5-576f-4ef0-874b-1544c0307a7e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:01:33 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 04:01:33 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:01:33 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:01:33 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:01:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:34 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:01:34 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZwFESguO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:01:37 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:01:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:01:37 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:01:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:01:37 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b56a8c8-0c90-4825-9a9a-c9c3872997f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:01:37 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d12aafb-4059-4ecf-95b1-e4f4f52449cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b] added
Nov 08 04:01:37 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06f02c7-273c-4cc4-aa86-9697f7f8c96a]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5774d8-1e4d-40a3-9c88-7918b184d64a]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZwFESguO {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZwFESguO" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[953782dd-03cc-4fb4-bfe1-c5bd2b0d5acb]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZwFESguO'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e33db84-3552-407e-90df-52a9a6202521]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c3d019-0c9e-4b3d-9f79-b4fe499c98d8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:01:37 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:01:37 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:01:37 user nova-compute[75014]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)
Nov 08 04:01:37 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:01:37 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:01:37 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:01:37 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:01:37 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:01:37 user nova-compute[75014]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)
Nov 08 04:01:37 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:01:37 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:01:37 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2101cc-32d4-4f89-8be3-493f78d49364]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b, portal: 172.16.0.220,3260]
Nov 08 04:01:37 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b, portal: 172.16.0.220,3260] successful.
Nov 08 04:01:37 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[631798e4-d1e2-49f0-915d-b658eadd166c]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55c6781-81a8-4519-affb-9f7ca144461f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:01:37 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:01:37 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:01:37 user nova-compute[75014]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)
Nov 08 04:01:37 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:01:37 user nova-compute[75014]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)
Nov 08 04:01:37 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:01:37 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:01:37 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:01:37 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:01:37 user nova-compute[75014]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)
Nov 08 04:01:37 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:01:37 user nova-compute[75014]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)
Nov 08 04:01:37 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:01:37 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.391s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] HCTL ('39', '-', '-', 0) found on session 19 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b165f4-a21c-4f21-8893-95f91c8fa900]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Searching for a device in session 19 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZwFESguO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:37 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:01:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.430s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:01:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] <== connect_volume: return (1433ms) {'type': 'block', 'scsi_wwn': '26131376466623163', 'path': '/dev/sdh'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:01:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131376466623163', 'path': '/dev/sdh'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:01:38 user nova-compute[75014]: DEBUG nova.objects.instance [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lazy-loading 'flavor' on Instance uuid 44d4794d-91c4-4eb6-a752-37f587f2b420 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:01:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 04:01:38 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:01:38 user nova-compute[75014]:   <source dev="/dev/sdh"/>
Nov 08 04:01:38 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:01:38 user nova-compute[75014]:   <serial>24d32672-c667-4adb-84b1-0dece53e7d7b</serial>
Nov 08 04:01:38 user nova-compute[75014]: </disk>
Nov 08 04:01:38 user nova-compute[75014]:  {{(pid=75014) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 04:01:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:01:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:01:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:01:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] No VIF found with MAC fa:16:3e:43:25:9f, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:01:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json" returned: 0 in 0.273s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-829573ce-b6a8-449e-bfba-4a6b69939f19 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "44d4794d-91c4-4eb6-a752-37f587f2b420" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.366s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:01:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94391dc2-758d-483f-a814-a2ab46e8b033/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94391dc2-758d-483f-a814-a2ab46e8b033/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94391dc2-758d-483f-a814-a2ab46e8b033/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94391dc2-758d-483f-a814-a2ab46e8b033/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XzcGIlpy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:01:41 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:01:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:01:41 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:01:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:01:41 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62c5139-8126-4fde-834e-a05c58b72022]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:01:41 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd65be52-322e-47bf-b42f-286dcb0285d6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f] added
Nov 08 04:01:41 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1d352d-19c3-46a9-a1ad-570d02e08c2e]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6d6d9f-f44d-4490-8849-62ef5eb44b7b]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XzcGIlpy {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XzcGIlpy" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd5ea33-c602-4f01-811d-c93b2bcefda1]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XzcGIlpy'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ce2200-d104-400a-828f-89597cb6c4a3]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff576c19-ff3d-4cd2-b435-9e338c00cfe8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:01:41 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:01:41 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:01:41 user nova-compute[75014]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)
Nov 08 04:01:41 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:01:41 user nova-compute[75014]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)
Nov 08 04:01:41 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:01:41 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:01:41 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:01:41 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:01:41 user nova-compute[75014]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)
Nov 08 04:01:41 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:01:41 user nova-compute[75014]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)
Nov 08 04:01:41 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:01:41 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f32eee-6989-4bd4-b7a2-4a0aa2550168]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f, portal: 172.16.0.220,3260]
Nov 08 04:01:41 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f, portal: 172.16.0.220,3260] successful.
Nov 08 04:01:41 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b61acbe-b6d9-4fa8-9117-e777ae11cb6f]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d59d9d-1b76-4f87-975f-152f87d41eaa]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:01:41 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:01:41 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:01:41 user nova-compute[75014]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)
Nov 08 04:01:41 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:01:41 user nova-compute[75014]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)
Nov 08 04:01:41 user nova-compute[75014]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f (non-flash)
Nov 08 04:01:41 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:01:41 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:01:41 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:01:41 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:01:41 user nova-compute[75014]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)
Nov 08 04:01:41 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:01:41 user nova-compute[75014]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)
Nov 08 04:01:41 user nova-compute[75014]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f (non-flash)
Nov 08 04:01:41 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:01:41 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.457s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] HCTL ('40', '-', '-', 0) found on session 20 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1699a39-30ad-48f6-97b5-648c4f2ee777]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Searching for a device in session 20 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XzcGIlpy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:01:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.510s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:01:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] <== connect_volume: return (1515ms) {'type': 'block', 'scsi_wwn': '23039313430336336', 'path': '/dev/sdi'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:01:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039313430336336', 'path': '/dev/sdi'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:01:42 user nova-compute[75014]: DEBUG nova.objects.instance [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lazy-loading 'flavor' on Instance uuid 5c23c904-7d83-489c-bb45-04add15c2bf6 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:01:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 04:01:42 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:01:42 user nova-compute[75014]:   <source dev="/dev/sdi"/>
Nov 08 04:01:42 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:01:42 user nova-compute[75014]:   <serial>985ed37e-19be-485d-acf2-943c3f13327f</serial>
Nov 08 04:01:42 user nova-compute[75014]: </disk>
Nov 08 04:01:42 user nova-compute[75014]:  {{(pid=75014) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 04:01:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:01:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:01:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e432a710-90cd-4b46-8b49-f6b3ab8480dc/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e432a710-90cd-4b46-8b49-f6b3ab8480dc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e432a710-90cd-4b46-8b49-f6b3ab8480dc/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e432a710-90cd-4b46-8b49-f6b3ab8480dc/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:01:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] No BDM found with device name hda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:01:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] No VIF found with MAC fa:16:3e:e1:e9:27, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:01:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ab01c6bc-d3b1-4efe-95e8-e9f793eb41fb tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lock "5c23c904-7d83-489c-bb45-04add15c2bf6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.954s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:01:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:01:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:01:44 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:01:44 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:01:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=7072MB free_disk=24.66191864013672GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:01:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:01:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:01:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Acquiring lock "5c23c904-7d83-489c-bb45-04add15c2bf6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:01:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lock "5c23c904-7d83-489c-bb45-04add15c2bf6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:01:44 user nova-compute[75014]: INFO nova.compute.manager [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Detaching volume 985ed37e-19be-485d-acf2-943c3f13327f
Nov 08 04:01:44 user nova-compute[75014]: INFO nova.virt.block_device [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Attempting to driver detach volume 985ed37e-19be-485d-acf2-943c3f13327f from mountpoint /dev/vdb
Nov 08 04:01:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Attempting to detach device vdb from instance 5c23c904-7d83-489c-bb45-04add15c2bf6 from the persistent domain config. {{(pid=75014) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 04:01:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:01:44 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:01:44 user nova-compute[75014]:   <source dev="/dev/sdi"/>
Nov 08 04:01:44 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:01:44 user nova-compute[75014]:   <serial>985ed37e-19be-485d-acf2-943c3f13327f</serial>
Nov 08 04:01:44 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 04:01:44 user nova-compute[75014]: </disk>
Nov 08 04:01:44 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:01:44 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Successfully detached device vdb from instance 5c23c904-7d83-489c-bb45-04add15c2bf6 from the persistent domain config.
Nov 08 04:01:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5c23c904-7d83-489c-bb45-04add15c2bf6 from the live domain config. {{(pid=75014) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 04:01:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:01:44 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:01:44 user nova-compute[75014]:   <source dev="/dev/sdi"/>
Nov 08 04:01:44 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:01:44 user nova-compute[75014]:   <serial>985ed37e-19be-485d-acf2-943c3f13327f</serial>
Nov 08 04:01:44 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 04:01:44 user nova-compute[75014]: </disk>
Nov 08 04:01:44 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:01:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9f205fe5-576f-4ef0-874b-1544c0307a7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:01:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 5bfa6580-e0fe-46b0-b497-8db67806113a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:01:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 8527ee40-fb8a-469b-9696-d7bde8cc96f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:01:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 655fe5eb-1271-4b9f-a5a6-6342bd012a69 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:01:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance bd153f84-98cd-4c6d-a7ab-5759b0b5bf55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:01:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 691bf2a3-13b2-466c-90a3-8dd01dfc18cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:01:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:01:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance d4726cd1-51ea-41e2-ad36-be12b4d4c26b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:01:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 44d4794d-91c4-4eb6-a752-37f587f2b420 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:01:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 5c23c904-7d83-489c-bb45-04add15c2bf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:01:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance d555b6b3-86ec-40ae-aa20-48846b5157d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:01:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 94391dc2-758d-483f-a814-a2ab46e8b033 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:01:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance e432a710-90cd-4b46-8b49-f6b3ab8480dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:01:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance c23c9e00-b782-4530-bb01-a7a167951c1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:01:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:01:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:01:45 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:01:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5c23c904-7d83-489c-bb45-04add15c2bf6 {{(pid=75014) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 04:01:45 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:01:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:01:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.707s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:01:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:54 user nova-compute[75014]: DEBUG nova.compute.manager [req-114b75f6-45b8-48e9-8d4e-e18562cff1c6 req-2314f399-d5fe-4e1f-b717-dedc6664f4a8 service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Received event network-changed-37918aae-d92b-43c0-8477-1355ac936ab0 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:01:54 user nova-compute[75014]: DEBUG nova.compute.manager [req-114b75f6-45b8-48e9-8d4e-e18562cff1c6 req-2314f399-d5fe-4e1f-b717-dedc6664f4a8 service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Refreshing instance network info cache due to event network-changed-37918aae-d92b-43c0-8477-1355ac936ab0. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:01:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-114b75f6-45b8-48e9-8d4e-e18562cff1c6 req-2314f399-d5fe-4e1f-b717-dedc6664f4a8 service nova] Acquiring lock "refresh_cache-44d4794d-91c4-4eb6-a752-37f587f2b420" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:01:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-114b75f6-45b8-48e9-8d4e-e18562cff1c6 req-2314f399-d5fe-4e1f-b717-dedc6664f4a8 service nova] Acquired lock "refresh_cache-44d4794d-91c4-4eb6-a752-37f587f2b420" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:01:54 user nova-compute[75014]: DEBUG nova.network.neutron [req-114b75f6-45b8-48e9-8d4e-e18562cff1c6 req-2314f399-d5fe-4e1f-b717-dedc6664f4a8 service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Refreshing network info cache for port 37918aae-d92b-43c0-8477-1355ac936ab0 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:01:55 user nova-compute[75014]: DEBUG nova.network.neutron [req-114b75f6-45b8-48e9-8d4e-e18562cff1c6 req-2314f399-d5fe-4e1f-b717-dedc6664f4a8 service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Updated VIF entry in instance network info cache for port 37918aae-d92b-43c0-8477-1355ac936ab0. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:01:55 user nova-compute[75014]: DEBUG nova.network.neutron [req-114b75f6-45b8-48e9-8d4e-e18562cff1c6 req-2314f399-d5fe-4e1f-b717-dedc6664f4a8 service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Updating instance_info_cache with network_info: [{"id": "37918aae-d92b-43c0-8477-1355ac936ab0", "address": "fa:16:3e:43:25:9f", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37918aae-d9", "ovs_interfaceid": "37918aae-d92b-43c0-8477-1355ac936ab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:01:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-114b75f6-45b8-48e9-8d4e-e18562cff1c6 req-2314f399-d5fe-4e1f-b717-dedc6664f4a8 service nova] Releasing lock "refresh_cache-44d4794d-91c4-4eb6-a752-37f587f2b420" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:01:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:01:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:01:57 user nova-compute[75014]: INFO nova.compute.manager [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Unshelving
Nov 08 04:01:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:01:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:01:57 user nova-compute[75014]: DEBUG nova.objects.instance [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lazy-loading 'pci_requests' on Instance uuid 79dea88d-f5cd-4e8b-a98b-01af128f35ed {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:01:57 user nova-compute[75014]: DEBUG nova.objects.instance [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lazy-loading 'numa_topology' on Instance uuid 79dea88d-f5cd-4e8b-a98b-01af128f35ed {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:01:57 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 04:01:57 user nova-compute[75014]: INFO nova.compute.claims [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Claim successful on node user
Nov 08 04:01:57 user nova-compute[75014]: DEBUG nova.compute.manager [req-8dce14b7-7d43-43e7-8b9f-ad629299afdc req-ceb878bb-90ab-46f3-8cde-82a978686777 service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Received event network-changed-37918aae-d92b-43c0-8477-1355ac936ab0 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:01:57 user nova-compute[75014]: DEBUG nova.compute.manager [req-8dce14b7-7d43-43e7-8b9f-ad629299afdc req-ceb878bb-90ab-46f3-8cde-82a978686777 service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Refreshing instance network info cache due to event network-changed-37918aae-d92b-43c0-8477-1355ac936ab0. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:01:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8dce14b7-7d43-43e7-8b9f-ad629299afdc req-ceb878bb-90ab-46f3-8cde-82a978686777 service nova] Acquiring lock "refresh_cache-44d4794d-91c4-4eb6-a752-37f587f2b420" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:01:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8dce14b7-7d43-43e7-8b9f-ad629299afdc req-ceb878bb-90ab-46f3-8cde-82a978686777 service nova] Acquired lock "refresh_cache-44d4794d-91c4-4eb6-a752-37f587f2b420" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:01:57 user nova-compute[75014]: DEBUG nova.network.neutron [req-8dce14b7-7d43-43e7-8b9f-ad629299afdc req-ceb878bb-90ab-46f3-8cde-82a978686777 service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Refreshing network info cache for port 37918aae-d92b-43c0-8477-1355ac936ab0 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:01:57 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:01:57 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:01:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.604s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:01:57 user nova-compute[75014]: DEBUG nova.network.neutron [req-8dce14b7-7d43-43e7-8b9f-ad629299afdc req-ceb878bb-90ab-46f3-8cde-82a978686777 service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Updated VIF entry in instance network info cache for port 37918aae-d92b-43c0-8477-1355ac936ab0. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:01:57 user nova-compute[75014]: DEBUG nova.network.neutron [req-8dce14b7-7d43-43e7-8b9f-ad629299afdc req-ceb878bb-90ab-46f3-8cde-82a978686777 service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Updating instance_info_cache with network_info: [{"id": "37918aae-d92b-43c0-8477-1355ac936ab0", "address": "fa:16:3e:43:25:9f", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37918aae-d9", "ovs_interfaceid": "37918aae-d92b-43c0-8477-1355ac936ab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:01:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8dce14b7-7d43-43e7-8b9f-ad629299afdc req-ceb878bb-90ab-46f3-8cde-82a978686777 service nova] Releasing lock "refresh_cache-44d4794d-91c4-4eb6-a752-37f587f2b420" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:01:57 user nova-compute[75014]: INFO nova.network.neutron [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Updating port 0ce8dc6f-2116-4163-8c05-2e3519724ee7 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 08 04:01:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:01:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "refresh_cache-79dea88d-f5cd-4e8b-a98b-01af128f35ed" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:01:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquired lock "refresh_cache-79dea88d-f5cd-4e8b-a98b-01af128f35ed" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:01:58 user nova-compute[75014]: DEBUG nova.network.neutron [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:01:59 user nova-compute[75014]: DEBUG nova.network.neutron [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Updating instance_info_cache with network_info: [{"id": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "address": "fa:16:3e:e4:5b:42", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce8dc6f-21", "ovs_interfaceid": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:01:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Releasing lock "refresh_cache-79dea88d-f5cd-4e8b-a98b-01af128f35ed" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:01:59 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 04:01:59 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Creating image(s)
Nov 08 04:01:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "/opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:01:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "/opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:01:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "/opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:01:59 user nova-compute[75014]: DEBUG nova.objects.instance [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lazy-loading 'trusted_certs' on Instance uuid 79dea88d-f5cd-4e8b-a98b-01af128f35ed {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:01:59 user nova-compute[75014]: DEBUG nova.objects.base [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Object Instance<79dea88d-f5cd-4e8b-a98b-01af128f35ed> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:01:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "3c9d8b16e7808d883edad3b51cf4a2f0cac724b0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:01:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "3c9d8b16e7808d883edad3b51cf4a2f0cac724b0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c9d8b16e7808d883edad3b51cf4a2f0cac724b0.part --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:00 user nova-compute[75014]: DEBUG nova.compute.manager [req-2e7e336d-9f02-44cf-b5f9-3d64daf132ea req-a70a7722-3a00-41f9-ae9d-16d07577a78c service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Received event network-changed-0ce8dc6f-2116-4163-8c05-2e3519724ee7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:02:00 user nova-compute[75014]: DEBUG nova.compute.manager [req-2e7e336d-9f02-44cf-b5f9-3d64daf132ea req-a70a7722-3a00-41f9-ae9d-16d07577a78c service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Refreshing instance network info cache due to event network-changed-0ce8dc6f-2116-4163-8c05-2e3519724ee7. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:02:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2e7e336d-9f02-44cf-b5f9-3d64daf132ea req-a70a7722-3a00-41f9-ae9d-16d07577a78c service nova] Acquiring lock "refresh_cache-79dea88d-f5cd-4e8b-a98b-01af128f35ed" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:02:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2e7e336d-9f02-44cf-b5f9-3d64daf132ea req-a70a7722-3a00-41f9-ae9d-16d07577a78c service nova] Acquired lock "refresh_cache-79dea88d-f5cd-4e8b-a98b-01af128f35ed" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:02:00 user nova-compute[75014]: DEBUG nova.network.neutron [req-2e7e336d-9f02-44cf-b5f9-3d64daf132ea req-a70a7722-3a00-41f9-ae9d-16d07577a78c service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Refreshing network info cache for port 0ce8dc6f-2116-4163-8c05-2e3519724ee7 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:02:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c9d8b16e7808d883edad3b51cf4a2f0cac724b0.part --force-share --output=json" returned: 0 in 0.234s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:00 user nova-compute[75014]: DEBUG nova.virt.images [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] ae3a2ff1-fca0-4480-b352-446152854834 was qcow2, converting to raw {{(pid=75014) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 04:02:00 user nova-compute[75014]: DEBUG nova.privsep.utils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75014) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 04:02:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3c9d8b16e7808d883edad3b51cf4a2f0cac724b0.part /opt/stack/data/nova/instances/_base/3c9d8b16e7808d883edad3b51cf4a2f0cac724b0.converted {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:00 user nova-compute[75014]: DEBUG nova.network.neutron [req-2e7e336d-9f02-44cf-b5f9-3d64daf132ea req-a70a7722-3a00-41f9-ae9d-16d07577a78c service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Updated VIF entry in instance network info cache for port 0ce8dc6f-2116-4163-8c05-2e3519724ee7. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:02:00 user nova-compute[75014]: DEBUG nova.network.neutron [req-2e7e336d-9f02-44cf-b5f9-3d64daf132ea req-a70a7722-3a00-41f9-ae9d-16d07577a78c service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Updating instance_info_cache with network_info: [{"id": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "address": "fa:16:3e:e4:5b:42", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce8dc6f-21", "ovs_interfaceid": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:02:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2e7e336d-9f02-44cf-b5f9-3d64daf132ea req-a70a7722-3a00-41f9-ae9d-16d07577a78c service nova] Releasing lock "refresh_cache-79dea88d-f5cd-4e8b-a98b-01af128f35ed" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8c1c88c7-9e96-400c-b18d-741da1efea90 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "94391dc2-758d-483f-a814-a2ab46e8b033" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8c1c88c7-9e96-400c-b18d-741da1efea90 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "94391dc2-758d-483f-a814-a2ab46e8b033" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8c1c88c7-9e96-400c-b18d-741da1efea90 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "94391dc2-758d-483f-a814-a2ab46e8b033-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8c1c88c7-9e96-400c-b18d-741da1efea90 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "94391dc2-758d-483f-a814-a2ab46e8b033-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8c1c88c7-9e96-400c-b18d-741da1efea90 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "94391dc2-758d-483f-a814-a2ab46e8b033-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3c9d8b16e7808d883edad3b51cf4a2f0cac724b0.part /opt/stack/data/nova/instances/_base/3c9d8b16e7808d883edad3b51cf4a2f0cac724b0.converted" returned: 0 in 0.439s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c9d8b16e7808d883edad3b51cf4a2f0cac724b0.converted --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:01 user nova-compute[75014]: INFO nova.compute.manager [None req-8c1c88c7-9e96-400c-b18d-741da1efea90 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Terminating instance
Nov 08 04:02:01 user nova-compute[75014]: DEBUG nova.compute.manager [None req-8c1c88c7-9e96-400c-b18d-741da1efea90 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c9d8b16e7808d883edad3b51cf4a2f0cac724b0.converted --force-share --output=json" returned: 0 in 0.194s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "3c9d8b16e7808d883edad3b51cf4a2f0cac724b0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.189s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c9d8b16e7808d883edad3b51cf4a2f0cac724b0 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG nova.compute.manager [req-bdf7264e-50a6-4750-b80f-af8993f8ea54 req-20102544-1243-48a9-964c-16392a4e78f5 service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Received event network-vif-unplugged-4d671092-8e1a-4c12-b91d-934efc96f495 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-bdf7264e-50a6-4750-b80f-af8993f8ea54 req-20102544-1243-48a9-964c-16392a4e78f5 service nova] Acquiring lock "94391dc2-758d-483f-a814-a2ab46e8b033-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-bdf7264e-50a6-4750-b80f-af8993f8ea54 req-20102544-1243-48a9-964c-16392a4e78f5 service nova] Lock "94391dc2-758d-483f-a814-a2ab46e8b033-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-bdf7264e-50a6-4750-b80f-af8993f8ea54 req-20102544-1243-48a9-964c-16392a4e78f5 service nova] Lock "94391dc2-758d-483f-a814-a2ab46e8b033-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG nova.compute.manager [req-bdf7264e-50a6-4750-b80f-af8993f8ea54 req-20102544-1243-48a9-964c-16392a4e78f5 service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] No waiting events found dispatching network-vif-unplugged-4d671092-8e1a-4c12-b91d-934efc96f495 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG nova.compute.manager [req-bdf7264e-50a6-4750-b80f-af8993f8ea54 req-20102544-1243-48a9-964c-16392a4e78f5 service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Received event network-vif-unplugged-4d671092-8e1a-4c12-b91d-934efc96f495 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c9d8b16e7808d883edad3b51cf4a2f0cac724b0 --force-share --output=json" returned: 0 in 0.222s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "3c9d8b16e7808d883edad3b51cf4a2f0cac724b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "3c9d8b16e7808d883edad3b51cf4a2f0cac724b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c9d8b16e7808d883edad3b51cf4a2f0cac724b0 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:01 user nova-compute[75014]: INFO nova.compute.manager [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Detaching volume de7b3943-b00c-4fa6-b643-8330e73fb282
Nov 08 04:02:01 user nova-compute[75014]: DEBUG nova.compute.manager [req-56b91b8c-5209-4f69-aa99-abb02582312e req-d75626ef-4410-42cd-a19e-f30cb68446b4 service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Received event network-changed-4d671092-8e1a-4c12-b91d-934efc96f495 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG nova.compute.manager [req-56b91b8c-5209-4f69-aa99-abb02582312e req-d75626ef-4410-42cd-a19e-f30cb68446b4 service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Refreshing instance network info cache due to event network-changed-4d671092-8e1a-4c12-b91d-934efc96f495. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-56b91b8c-5209-4f69-aa99-abb02582312e req-d75626ef-4410-42cd-a19e-f30cb68446b4 service nova] Acquiring lock "refresh_cache-94391dc2-758d-483f-a814-a2ab46e8b033" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-56b91b8c-5209-4f69-aa99-abb02582312e req-d75626ef-4410-42cd-a19e-f30cb68446b4 service nova] Acquired lock "refresh_cache-94391dc2-758d-483f-a814-a2ab46e8b033" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG nova.network.neutron [req-56b91b8c-5209-4f69-aa99-abb02582312e req-d75626ef-4410-42cd-a19e-f30cb68446b4 service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Refreshing network info cache for port 4d671092-8e1a-4c12-b91d-934efc96f495 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:01 user nova-compute[75014]: INFO nova.virt.block_device [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Attempting to driver detach volume de7b3943-b00c-4fa6-b643-8330e73fb282 from mountpoint /dev/vdb
Nov 08 04:02:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:01 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Instance destroyed successfully.
Nov 08 04:02:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c9d8b16e7808d883edad3b51cf4a2f0cac724b0 --force-share --output=json" returned: 0 in 0.224s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG nova.objects.instance [None req-8c1c88c7-9e96-400c-b18d-741da1efea90 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lazy-loading 'resources' on Instance uuid 94391dc2-758d-483f-a814-a2ab46e8b033 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3c9d8b16e7808d883edad3b51cf4a2f0cac724b0,backing_fmt=raw /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-8c1c88c7-9e96-400c-b18d-741da1efea90 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-273439371',display_name='tempest-AttachVolumeNegativeTest-server-273439371',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-273439371',id=25,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIB2vqM9zzsPD5JVptNY+zGx2xOQbeZ5bjeUuD7fkNFpMLZrUf+EM3QCvxYZee38qw8oF7kZh01LFvMx/LEbLiOVuhQKRTgr2jp2T61shTnwL8/TP9KviPhAdk7pxOd2yw==',key_name='tempest-keypair-744292143',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:00:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1c9753cb588478a8a93182be3256674',ramdisk_id='',reservation_id='r-filw2ji5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1215701914',owner_user_name='tempest-AttachVolumeNegativeTest-1215701914-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:00:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8c674d8b2cf49c08cf254a8095ef8ea',uuid=94391dc2-758d-483f-a814-a2ab46e8b033,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d671092-8e1a-4c12-b91d-934efc96f495", "address": "fa:16:3e:29:8d:b6", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d671092-8e", "ovs_interfaceid": "4d671092-8e1a-4c12-b91d-934efc96f495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-8c1c88c7-9e96-400c-b18d-741da1efea90 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Converting VIF {"id": "4d671092-8e1a-4c12-b91d-934efc96f495", "address": "fa:16:3e:29:8d:b6", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d671092-8e", "ovs_interfaceid": "4d671092-8e1a-4c12-b91d-934efc96f495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-8c1c88c7-9e96-400c-b18d-741da1efea90 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:8d:b6,bridge_name='br-int',has_traffic_filtering=True,id=4d671092-8e1a-4c12-b91d-934efc96f495,network=Network(f3d67270-d525-45d9-958c-a901d121d510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d671092-8e') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG os_vif [None req-8c1c88c7-9e96-400c-b18d-741da1efea90 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:8d:b6,bridge_name='br-int',has_traffic_filtering=True,id=4d671092-8e1a-4c12-b91d-934efc96f495,network=Network(f3d67270-d525-45d9-958c-a901d121d510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d671092-8e') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d671092-8e, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3c9d8b16e7808d883edad3b51cf4a2f0cac724b0,backing_fmt=raw /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk 1073741824" returned: 0 in 0.083s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "3c9d8b16e7808d883edad3b51cf4a2f0cac724b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c9d8b16e7808d883edad3b51cf4a2f0cac724b0 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd9e6a88-ef4d-4113-9de3-1ff608c7a9a0) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Attempting to detach device vdb from instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d from the persistent domain config. {{(pid=75014) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:02:01 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:02:01 user nova-compute[75014]:   <source dev="/dev/sde"/>
Nov 08 04:02:01 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:02:01 user nova-compute[75014]:   <serial>de7b3943-b00c-4fa6-b643-8330e73fb282</serial>
Nov 08 04:02:01 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:02:01 user nova-compute[75014]: </disk>
Nov 08 04:02:01 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:02:01 user nova-compute[75014]: INFO os_vif [None req-8c1c88c7-9e96-400c-b18d-741da1efea90 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:8d:b6,bridge_name='br-int',has_traffic_filtering=True,id=4d671092-8e1a-4c12-b91d-934efc96f495,network=Network(f3d67270-d525-45d9-958c-a901d121d510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d671092-8e')
Nov 08 04:02:01 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-8c1c88c7-9e96-400c-b18d-741da1efea90 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Deleting instance files /opt/stack/data/nova/instances/94391dc2-758d-483f-a814-a2ab46e8b033_del
Nov 08 04:02:01 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-8c1c88c7-9e96-400c-b18d-741da1efea90 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Deletion of /opt/stack/data/nova/instances/94391dc2-758d-483f-a814-a2ab46e8b033_del complete
Nov 08 04:02:02 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Successfully detached device vdb from instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d from the persistent domain config.
Nov 08 04:02:02 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d from the live domain config. {{(pid=75014) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 04:02:02 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:02:02 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:02:02 user nova-compute[75014]:   <source dev="/dev/sde"/>
Nov 08 04:02:02 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:02:02 user nova-compute[75014]:   <serial>de7b3943-b00c-4fa6-b643-8330e73fb282</serial>
Nov 08 04:02:02 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:02:02 user nova-compute[75014]: </disk>
Nov 08 04:02:02 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:02:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:02 user nova-compute[75014]: INFO nova.compute.manager [None req-8c1c88c7-9e96-400c-b18d-741da1efea90 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 08 04:02:02 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-8c1c88c7-9e96-400c-b18d-741da1efea90 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:02:02 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:02:02 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:02:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c9d8b16e7808d883edad3b51cf4a2f0cac724b0 --force-share --output=json" returned: 0 in 0.219s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:02 user nova-compute[75014]: DEBUG nova.objects.instance [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lazy-loading 'migration_context' on Instance uuid 79dea88d-f5cd-4e8b-a98b-01af128f35ed {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:02:02 user nova-compute[75014]: DEBUG nova.objects.base [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Object Instance<79dea88d-f5cd-4e8b-a98b-01af128f35ed> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:02:02 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Rebasing disk image.
Nov 08 04:02:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:02 user nova-compute[75014]: DEBUG nova.network.neutron [req-56b91b8c-5209-4f69-aa99-abb02582312e req-d75626ef-4410-42cd-a19e-f30cb68446b4 service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Updated VIF entry in instance network info cache for port 4d671092-8e1a-4c12-b91d-934efc96f495. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:02:02 user nova-compute[75014]: DEBUG nova.network.neutron [req-56b91b8c-5209-4f69-aa99-abb02582312e req-d75626ef-4410-42cd-a19e-f30cb68446b4 service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Updating instance_info_cache with network_info: [{"id": "4d671092-8e1a-4c12-b91d-934efc96f495", "address": "fa:16:3e:29:8d:b6", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d671092-8e", "ovs_interfaceid": "4d671092-8e1a-4c12-b91d-934efc96f495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:02:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:02 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-56b91b8c-5209-4f69-aa99-abb02582312e req-d75626ef-4410-42cd-a19e-f30cb68446b4 service nova] Releasing lock "refresh_cache-94391dc2-758d-483f-a814-a2ab46e8b033" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:02:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.219s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 -F raw /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:02 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d {{(pid=75014) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 04:02:03 user nova-compute[75014]: DEBUG nova.compute.manager [req-8a11fc09-ad1d-4ea3-a819-763106e519cb req-fdb8162d-857e-424d-96fd-22c44f2fbd8f service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Received event network-vif-plugged-4d671092-8e1a-4c12-b91d-934efc96f495 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:02:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8a11fc09-ad1d-4ea3-a819-763106e519cb req-fdb8162d-857e-424d-96fd-22c44f2fbd8f service nova] Acquiring lock "94391dc2-758d-483f-a814-a2ab46e8b033-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8a11fc09-ad1d-4ea3-a819-763106e519cb req-fdb8162d-857e-424d-96fd-22c44f2fbd8f service nova] Lock "94391dc2-758d-483f-a814-a2ab46e8b033-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8a11fc09-ad1d-4ea3-a819-763106e519cb req-fdb8162d-857e-424d-96fd-22c44f2fbd8f service nova] Lock "94391dc2-758d-483f-a814-a2ab46e8b033-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:03 user nova-compute[75014]: DEBUG nova.compute.manager [req-8a11fc09-ad1d-4ea3-a819-763106e519cb req-fdb8162d-857e-424d-96fd-22c44f2fbd8f service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] No waiting events found dispatching network-vif-plugged-4d671092-8e1a-4c12-b91d-934efc96f495 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:02:03 user nova-compute[75014]: WARNING nova.compute.manager [req-8a11fc09-ad1d-4ea3-a819-763106e519cb req-fdb8162d-857e-424d-96fd-22c44f2fbd8f service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Received unexpected event network-vif-plugged-4d671092-8e1a-4c12-b91d-934efc96f495 for instance with vm_state active and task_state deleting.
Nov 08 04:02:03 user nova-compute[75014]: DEBUG nova.compute.manager [req-8a11fc09-ad1d-4ea3-a819-763106e519cb req-fdb8162d-857e-424d-96fd-22c44f2fbd8f service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Received event network-vif-plugged-4d671092-8e1a-4c12-b91d-934efc96f495 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:02:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8a11fc09-ad1d-4ea3-a819-763106e519cb req-fdb8162d-857e-424d-96fd-22c44f2fbd8f service nova] Acquiring lock "94391dc2-758d-483f-a814-a2ab46e8b033-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8a11fc09-ad1d-4ea3-a819-763106e519cb req-fdb8162d-857e-424d-96fd-22c44f2fbd8f service nova] Lock "94391dc2-758d-483f-a814-a2ab46e8b033-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8a11fc09-ad1d-4ea3-a819-763106e519cb req-fdb8162d-857e-424d-96fd-22c44f2fbd8f service nova] Lock "94391dc2-758d-483f-a814-a2ab46e8b033-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:03 user nova-compute[75014]: DEBUG nova.compute.manager [req-8a11fc09-ad1d-4ea3-a819-763106e519cb req-fdb8162d-857e-424d-96fd-22c44f2fbd8f service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] No waiting events found dispatching network-vif-plugged-4d671092-8e1a-4c12-b91d-934efc96f495 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:02:03 user nova-compute[75014]: WARNING nova.compute.manager [req-8a11fc09-ad1d-4ea3-a819-763106e519cb req-fdb8162d-857e-424d-96fd-22c44f2fbd8f service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Received unexpected event network-vif-plugged-4d671092-8e1a-4c12-b91d-934efc96f495 for instance with vm_state active and task_state deleting.
Nov 08 04:02:03 user nova-compute[75014]: DEBUG nova.compute.manager [req-8a11fc09-ad1d-4ea3-a819-763106e519cb req-fdb8162d-857e-424d-96fd-22c44f2fbd8f service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Received event network-vif-plugged-4d671092-8e1a-4c12-b91d-934efc96f495 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:02:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8a11fc09-ad1d-4ea3-a819-763106e519cb req-fdb8162d-857e-424d-96fd-22c44f2fbd8f service nova] Acquiring lock "94391dc2-758d-483f-a814-a2ab46e8b033-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8a11fc09-ad1d-4ea3-a819-763106e519cb req-fdb8162d-857e-424d-96fd-22c44f2fbd8f service nova] Lock "94391dc2-758d-483f-a814-a2ab46e8b033-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8a11fc09-ad1d-4ea3-a819-763106e519cb req-fdb8162d-857e-424d-96fd-22c44f2fbd8f service nova] Lock "94391dc2-758d-483f-a814-a2ab46e8b033-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:03 user nova-compute[75014]: DEBUG nova.compute.manager [req-8a11fc09-ad1d-4ea3-a819-763106e519cb req-fdb8162d-857e-424d-96fd-22c44f2fbd8f service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] No waiting events found dispatching network-vif-plugged-4d671092-8e1a-4c12-b91d-934efc96f495 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:02:03 user nova-compute[75014]: WARNING nova.compute.manager [req-8a11fc09-ad1d-4ea3-a819-763106e519cb req-fdb8162d-857e-424d-96fd-22c44f2fbd8f service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Received unexpected event network-vif-plugged-4d671092-8e1a-4c12-b91d-934efc96f495 for instance with vm_state active and task_state deleting.
Nov 08 04:02:03 user nova-compute[75014]: DEBUG nova.compute.manager [req-8a11fc09-ad1d-4ea3-a819-763106e519cb req-fdb8162d-857e-424d-96fd-22c44f2fbd8f service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Received event network-vif-unplugged-4d671092-8e1a-4c12-b91d-934efc96f495 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:02:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8a11fc09-ad1d-4ea3-a819-763106e519cb req-fdb8162d-857e-424d-96fd-22c44f2fbd8f service nova] Acquiring lock "94391dc2-758d-483f-a814-a2ab46e8b033-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8a11fc09-ad1d-4ea3-a819-763106e519cb req-fdb8162d-857e-424d-96fd-22c44f2fbd8f service nova] Lock "94391dc2-758d-483f-a814-a2ab46e8b033-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8a11fc09-ad1d-4ea3-a819-763106e519cb req-fdb8162d-857e-424d-96fd-22c44f2fbd8f service nova] Lock "94391dc2-758d-483f-a814-a2ab46e8b033-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:03 user nova-compute[75014]: DEBUG nova.compute.manager [req-8a11fc09-ad1d-4ea3-a819-763106e519cb req-fdb8162d-857e-424d-96fd-22c44f2fbd8f service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] No waiting events found dispatching network-vif-unplugged-4d671092-8e1a-4c12-b91d-934efc96f495 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:02:03 user nova-compute[75014]: DEBUG nova.compute.manager [req-8a11fc09-ad1d-4ea3-a819-763106e519cb req-fdb8162d-857e-424d-96fd-22c44f2fbd8f service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Received event network-vif-unplugged-4d671092-8e1a-4c12-b91d-934efc96f495 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:02:03 user nova-compute[75014]: DEBUG nova.compute.manager [req-8a11fc09-ad1d-4ea3-a819-763106e519cb req-fdb8162d-857e-424d-96fd-22c44f2fbd8f service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Received event network-vif-plugged-4d671092-8e1a-4c12-b91d-934efc96f495 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:02:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8a11fc09-ad1d-4ea3-a819-763106e519cb req-fdb8162d-857e-424d-96fd-22c44f2fbd8f service nova] Acquiring lock "94391dc2-758d-483f-a814-a2ab46e8b033-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8a11fc09-ad1d-4ea3-a819-763106e519cb req-fdb8162d-857e-424d-96fd-22c44f2fbd8f service nova] Lock "94391dc2-758d-483f-a814-a2ab46e8b033-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8a11fc09-ad1d-4ea3-a819-763106e519cb req-fdb8162d-857e-424d-96fd-22c44f2fbd8f service nova] Lock "94391dc2-758d-483f-a814-a2ab46e8b033-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:03 user nova-compute[75014]: DEBUG nova.compute.manager [req-8a11fc09-ad1d-4ea3-a819-763106e519cb req-fdb8162d-857e-424d-96fd-22c44f2fbd8f service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] No waiting events found dispatching network-vif-plugged-4d671092-8e1a-4c12-b91d-934efc96f495 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:02:03 user nova-compute[75014]: WARNING nova.compute.manager [req-8a11fc09-ad1d-4ea3-a819-763106e519cb req-fdb8162d-857e-424d-96fd-22c44f2fbd8f service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Received unexpected event network-vif-plugged-4d671092-8e1a-4c12-b91d-934efc96f495 for instance with vm_state active and task_state deleting.
Nov 08 04:02:04 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:02:04 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Took 2.04 seconds to deallocate network for instance.
Nov 08 04:02:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8c1c88c7-9e96-400c-b18d-741da1efea90 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8c1c88c7-9e96-400c-b18d-741da1efea90 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:04 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-8c1c88c7-9e96-400c-b18d-741da1efea90 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:02:04 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-8c1c88c7-9e96-400c-b18d-741da1efea90 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:02:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8c1c88c7-9e96-400c-b18d-741da1efea90 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.542s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:04 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-8c1c88c7-9e96-400c-b18d-741da1efea90 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Deleted allocations for instance 94391dc2-758d-483f-a814-a2ab46e8b033
Nov 08 04:02:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8c1c88c7-9e96-400c-b18d-741da1efea90 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "94391dc2-758d-483f-a814-a2ab46e8b033" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.807s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 -F raw /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk" returned: 0 in 2.598s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:04 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 04:02:04 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Ensure instance console log exists: /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:02:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:04 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Start _get_guest_xml network_info=[{"id": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "address": "fa:16:3e:e4:5b:42", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce8dc6f-21", "ovs_interfaceid": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='a055b7019d648ad96a68818ffb9441e1',container_format='bare',created_at=2023-11-08T04:00:04Z,direct_url=<?>,disk_format='qcow2',id=ae3a2ff1-fca0-4480-b352-446152854834,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-126106463-shelved',owner='a1d70b55f2bb42e5b7123acfcd621b2f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T04:00:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:02:04 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:02:04 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:02:04 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:02:04 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:02:04 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:02:04 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:02:04 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:02:04 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='a055b7019d648ad96a68818ffb9441e1',container_format='bare',created_at=2023-11-08T04:00:04Z,direct_url=<?>,disk_format='qcow2',id=ae3a2ff1-fca0-4480-b352-446152854834,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-126106463-shelved',owner='a1d70b55f2bb42e5b7123acfcd621b2f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T04:00:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:02:04 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:02:04 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:02:04 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:02:04 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:02:04 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:02:04 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:02:04 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:02:04 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:02:04 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:02:04 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:02:04 user nova-compute[75014]: DEBUG nova.objects.instance [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lazy-loading 'vcpu_model' on Instance uuid 79dea88d-f5cd-4e8b-a98b-01af128f35ed {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG nova.objects.base [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Object Instance<79dea88d-f5cd-4e8b-a98b-01af128f35ed> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T03:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-126106463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-126106463',id=19,image_ref='ae3a2ff1-fca0-4480-b352-446152854834',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1769201340',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:57:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a1d70b55f2bb42e5b7123acfcd621b2f',ramdisk_id='',reservation_id='r-n2lnrofd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-650261566',owner_user_name='tempest-AttachVolumeShelveTestJSON-650261566-project-member',shelved_at='2023-11-08T04:00:09.569695',shelved_host='user',shelved_image_id='ae3a2ff1-fca0-4480-b352-446152854834'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:01:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74a49a9155064771bd4e8a179f9111ac',uuid=79dea88d-f5cd-4e8b-a98b-01af128f35ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "address": "fa:16:3e:e4:5b:42", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce8dc6f-21", "ovs_interfaceid": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Converting VIF {"id": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "address": "fa:16:3e:e4:5b:42", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce8dc6f-21", "ovs_interfaceid": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5b:42,bridge_name='br-int',has_traffic_filtering=True,id=0ce8dc6f-2116-4163-8c05-2e3519724ee7,network=Network(6ebf42ac-ab65-4622-8529-4c508f9d563c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce8dc6f-21') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG nova.objects.instance [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lazy-loading 'pci_devices' on Instance uuid 79dea88d-f5cd-4e8b-a98b-01af128f35ed {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG nova.objects.base [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Object Instance<79dea88d-f5cd-4e8b-a98b-01af128f35ed> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:02:05 user nova-compute[75014]:   <uuid>79dea88d-f5cd-4e8b-a98b-01af128f35ed</uuid>
Nov 08 04:02:05 user nova-compute[75014]:   <name>instance-00000013</name>
Nov 08 04:02:05 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:02:05 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:02:05 user nova-compute[75014]:   <metadata>
Nov 08 04:02:05 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:02:05 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:02:05 user nova-compute[75014]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-126106463</nova:name>
Nov 08 04:02:05 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:02:04</nova:creationTime>
Nov 08 04:02:05 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:02:05 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:02:05 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:02:05 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:02:05 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:02:05 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:02:05 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:02:05 user nova-compute[75014]:       <nova:owner>
Nov 08 04:02:05 user nova-compute[75014]:         <nova:user uuid="74a49a9155064771bd4e8a179f9111ac">tempest-AttachVolumeShelveTestJSON-650261566-project-member</nova:user>
Nov 08 04:02:05 user nova-compute[75014]:         <nova:project uuid="a1d70b55f2bb42e5b7123acfcd621b2f">tempest-AttachVolumeShelveTestJSON-650261566</nova:project>
Nov 08 04:02:05 user nova-compute[75014]:       </nova:owner>
Nov 08 04:02:05 user nova-compute[75014]:       <nova:root type="image" uuid="ae3a2ff1-fca0-4480-b352-446152854834"/>
Nov 08 04:02:05 user nova-compute[75014]:       <nova:ports>
Nov 08 04:02:05 user nova-compute[75014]:         <nova:port uuid="0ce8dc6f-2116-4163-8c05-2e3519724ee7">
Nov 08 04:02:05 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 04:02:05 user nova-compute[75014]:         </nova:port>
Nov 08 04:02:05 user nova-compute[75014]:       </nova:ports>
Nov 08 04:02:05 user nova-compute[75014]:     </nova:instance>
Nov 08 04:02:05 user nova-compute[75014]:   </metadata>
Nov 08 04:02:05 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:02:05 user nova-compute[75014]:     <system>
Nov 08 04:02:05 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:02:05 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:02:05 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:02:05 user nova-compute[75014]:       <entry name="serial">79dea88d-f5cd-4e8b-a98b-01af128f35ed</entry>
Nov 08 04:02:05 user nova-compute[75014]:       <entry name="uuid">79dea88d-f5cd-4e8b-a98b-01af128f35ed</entry>
Nov 08 04:02:05 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:02:05 user nova-compute[75014]:     </system>
Nov 08 04:02:05 user nova-compute[75014]:   </sysinfo>
Nov 08 04:02:05 user nova-compute[75014]:   <os>
Nov 08 04:02:05 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:02:05 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:02:05 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:02:05 user nova-compute[75014]:   </os>
Nov 08 04:02:05 user nova-compute[75014]:   <features>
Nov 08 04:02:05 user nova-compute[75014]:     <acpi/>
Nov 08 04:02:05 user nova-compute[75014]:     <apic/>
Nov 08 04:02:05 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:02:05 user nova-compute[75014]:   </features>
Nov 08 04:02:05 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:02:05 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:02:05 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:02:05 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:02:05 user nova-compute[75014]:   </clock>
Nov 08 04:02:05 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:02:05 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:02:05 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:02:05 user nova-compute[75014]:   </cpu>
Nov 08 04:02:05 user nova-compute[75014]:   <devices>
Nov 08 04:02:05 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 04:02:05 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 04:02:05 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk"/>
Nov 08 04:02:05 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:02:05 user nova-compute[75014]:     </disk>
Nov 08 04:02:05 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:02:05 user nova-compute[75014]:       <mac address="fa:16:3e:e4:5b:42"/>
Nov 08 04:02:05 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:02:05 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:02:05 user nova-compute[75014]:       <target dev="tap0ce8dc6f-21"/>
Nov 08 04:02:05 user nova-compute[75014]:     </interface>
Nov 08 04:02:05 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:02:05 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/console.log" append="off"/>
Nov 08 04:02:05 user nova-compute[75014]:     </serial>
Nov 08 04:02:05 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:02:05 user nova-compute[75014]:     <video>
Nov 08 04:02:05 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:02:05 user nova-compute[75014]:     </video>
Nov 08 04:02:05 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:02:05 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:02:05 user nova-compute[75014]:     </rng>
Nov 08 04:02:05 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:02:05 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:02:05 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:02:05 user nova-compute[75014]:     </memballoon>
Nov 08 04:02:05 user nova-compute[75014]:   </devices>
Nov 08 04:02:05 user nova-compute[75014]: </domain>
Nov 08 04:02:05 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T03:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-126106463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-126106463',id=19,image_ref='ae3a2ff1-fca0-4480-b352-446152854834',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1769201340',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:57:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a1d70b55f2bb42e5b7123acfcd621b2f',ramdisk_id='',reservation_id='r-n2lnrofd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-650261566',owner_user_name='tempest-AttachVolumeShelveTestJSON-650261566-project-member',shelved_at='2023-11-08T04:00:09.569695',shelved_host='user',shelved_image_id='ae3a2ff1-fca0-4480-b352-446152854834'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:01:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74a49a9155064771bd4e8a179f9111ac',uuid=79dea88d-f5cd-4e8b-a98b-01af128f35ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "address": "fa:16:3e:e4:5b:42", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce8dc6f-21", "ovs_interfaceid": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Converting VIF {"id": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "address": "fa:16:3e:e4:5b:42", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce8dc6f-21", "ovs_interfaceid": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5b:42,bridge_name='br-int',has_traffic_filtering=True,id=0ce8dc6f-2116-4163-8c05-2e3519724ee7,network=Network(6ebf42ac-ab65-4622-8529-4c508f9d563c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce8dc6f-21') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG os_vif [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5b:42,bridge_name='br-int',has_traffic_filtering=True,id=0ce8dc6f-2116-4163-8c05-2e3519724ee7,network=Network(6ebf42ac-ab65-4622-8529-4c508f9d563c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce8dc6f-21') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '42966e1d-34e3-565d-af38-eeaa779a1e22', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ce8dc6f-21, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ce8dc6f-21, col_values=(('qos', UUID('5119251c-b60a-418a-9d60-b4c143d47f92')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ce8dc6f-21, col_values=(('external_ids', {'iface-id': '0ce8dc6f-2116-4163-8c05-2e3519724ee7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:5b:42', 'vm-uuid': '79dea88d-f5cd-4e8b-a98b-01af128f35ed'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:05 user nova-compute[75014]: INFO os_vif [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5b:42,bridge_name='br-int',has_traffic_filtering=True,id=0ce8dc6f-2116-4163-8c05-2e3519724ee7,network=Network(6ebf42ac-ab65-4622-8529-4c508f9d563c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce8dc6f-21')
Nov 08 04:02:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] No VIF found with MAC fa:16:3e:e4:5b:42, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:02:05 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5c23c904-7d83-489c-bb45-04add15c2bf6 is timed out.
Nov 08 04:02:05 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Successfully detached device vdb from instance 5c23c904-7d83-489c-bb45-04add15c2bf6 from the live domain config.
Nov 08 04:02:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XzcGIlpy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:02:05 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:02:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3fb5ff-b25e-4d0c-b06d-b8ebded4c775]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:02:05 user nova-compute[75014]: No targets found.
Nov 08 04:02:05 user nova-compute[75014]: iSNS:
Nov 08 04:02:05 user nova-compute[75014]: No targets found.
Nov 08 04:02:05 user nova-compute[75014]: STATIC:
Nov 08 04:02:05 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f
Nov 08 04:02:05 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:02:05 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:02:05 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908
Nov 08 04:02:05 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:02:05 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:02:05 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec
Nov 08 04:02:05 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:02:05 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:02:05 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282
Nov 08 04:02:05 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:02:05 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:02:05 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:02:05 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:02:05 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:02:05 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a
Nov 08 04:02:05 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:02:05 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:02:05 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37
Nov 08 04:02:05 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:02:05 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:02:05 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b
Nov 08 04:02:05 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:02:05 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:02:05 user nova-compute[75014]: FIRMWARE:
Nov 08 04:02:05 user nova-compute[75014]: No targets found.
Nov 08 04:02:05 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:02:05 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:02:05 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[319dbecf-1b36-4a4f-a55f-c94bb3bbb891]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[73804557-a010-4415-bd1c-578c21298890]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:02:05 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:02:05 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:02:05 user nova-compute[75014]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)
Nov 08 04:02:05 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:02:05 user nova-compute[75014]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)
Nov 08 04:02:05 user nova-compute[75014]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f (non-flash)
Nov 08 04:02:05 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:02:05 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:02:05 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:02:05 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:02:05 user nova-compute[75014]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)
Nov 08 04:02:05 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:02:05 user nova-compute[75014]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)
Nov 08 04:02:05 user nova-compute[75014]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f (non-flash)
Nov 08 04:02:05 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:02:05 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0400784820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f'): ({'sdi'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Removing single pathed devices sdi {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[89dd0133-6b68-4de8-bbec-7fbdecd94344]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d9d752-6053-4675-a753-5dda26142999]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Flushing IO for device /dev/sdi {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e471db6a-4ce9-4c5c-9f70-44c74fbb81a1]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.054s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c269e3-3dab-400a-8f03-9613ff5a99e7]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] SCSI volumes sdi have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd063092-f5b5-49b4-82d8-1f74ad8a1969]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6102160c-1a1c-4f92-a00d-726d4782ded3]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f, portal: 172.16.0.220,3260]
Nov 08 04:02:05 user nova-compute[75014]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f, portal: 172.16.0.220,3260] successful.
Nov 08 04:02:05 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985ed37e-19be-485d-acf2-943c3f13327f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[167dea16-c3f7-4047-b14a-a57d9f3ac263]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] <== disconnect_volume: return (345ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:02:05 user nova-compute[75014]: DEBUG nova.compute.manager [req-3005a607-ebd9-48fa-84fb-b59c03a24520 req-7cdd9051-9dfa-4a21-bd5e-ec9bc084f3f9 service nova] [instance: 94391dc2-758d-483f-a814-a2ab46e8b033] Received event network-vif-deleted-4d671092-8e1a-4c12-b91d-934efc96f495 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:02:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:06 user nova-compute[75014]: DEBUG nova.objects.instance [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lazy-loading 'flavor' on Instance uuid 5c23c904-7d83-489c-bb45-04add15c2bf6 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:02:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e751c8b4-b311-4eed-ab08-a805420fb218 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lock "5c23c904-7d83-489c-bb45-04add15c2bf6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.125s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:06 user nova-compute[75014]: DEBUG nova.compute.manager [req-d266a6ff-737b-456d-9c21-7575cbde7963 req-483438d1-6e93-4a1e-8d53-3faf7e4cd665 service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Received event network-vif-plugged-0ce8dc6f-2116-4163-8c05-2e3519724ee7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:02:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d266a6ff-737b-456d-9c21-7575cbde7963 req-483438d1-6e93-4a1e-8d53-3faf7e4cd665 service nova] Acquiring lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d266a6ff-737b-456d-9c21-7575cbde7963 req-483438d1-6e93-4a1e-8d53-3faf7e4cd665 service nova] Lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d266a6ff-737b-456d-9c21-7575cbde7963 req-483438d1-6e93-4a1e-8d53-3faf7e4cd665 service nova] Lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:06 user nova-compute[75014]: DEBUG nova.compute.manager [req-d266a6ff-737b-456d-9c21-7575cbde7963 req-483438d1-6e93-4a1e-8d53-3faf7e4cd665 service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] No waiting events found dispatching network-vif-plugged-0ce8dc6f-2116-4163-8c05-2e3519724ee7 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:02:06 user nova-compute[75014]: WARNING nova.compute.manager [req-d266a6ff-737b-456d-9c21-7575cbde7963 req-483438d1-6e93-4a1e-8d53-3faf7e4cd665 service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Received unexpected event network-vif-plugged-0ce8dc6f-2116-4163-8c05-2e3519724ee7 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 04:02:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Acquiring lock "interface-5c23c904-7d83-489c-bb45-04add15c2bf6-5a2c52cf-1fbe-4c48-b782-e221e1251c45" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lock "interface-5c23c904-7d83-489c-bb45-04add15c2bf6-5a2c52cf-1fbe-4c48-b782-e221e1251c45" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:07 user nova-compute[75014]: DEBUG nova.objects.instance [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lazy-loading 'flavor' on Instance uuid 5c23c904-7d83-489c-bb45-04add15c2bf6 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:02:07 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-974517943',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-974517943',id=23,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdPXIOA7/TBoq0/votl12iKLEhI7NRfXy6j2NIlXxKNWayc0DBpjQWW2qoeBSHfSuOgOB6ZxxP+O5TEB48eK0wLHpB0ujWsQOr2xATZarqhcb9XmT1u6oZJjB9db9Gzpw==',key_name='tempest-keypair-275261075',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:59:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e1d4a398f55459aaa5526ef57b816ab',ramdisk_id='',reservation_id='r-nodg7g02',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1223504486',owner_user_name='tempest-TaggedAttachmentsTest-1223504486-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T03:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='685cdd725739412982a0d768ca78b325',uuid=5c23c904-7d83-489c-bb45-04add15c2bf6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a2c52cf-1fbe-4c48-b782-e221e1251c45", "address": "fa:16:3e:3f:dc:9e", "network": {"id": "fb818c50-19ce-4bc5-bdb5-bfdc8410c008", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-947199703", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9e1d4a398f55459aaa5526ef57b816ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2c52cf-1f", "ovs_interfaceid": "5a2c52cf-1fbe-4c48-b782-e221e1251c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:02:07 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Converting VIF {"id": "5a2c52cf-1fbe-4c48-b782-e221e1251c45", "address": "fa:16:3e:3f:dc:9e", "network": {"id": "fb818c50-19ce-4bc5-bdb5-bfdc8410c008", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-947199703", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9e1d4a398f55459aaa5526ef57b816ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2c52cf-1f", "ovs_interfaceid": "5a2c52cf-1fbe-4c48-b782-e221e1251c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:02:07 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:dc:9e,bridge_name='br-int',has_traffic_filtering=True,id=5a2c52cf-1fbe-4c48-b782-e221e1251c45,network=Network(fb818c50-19ce-4bc5-bdb5-bfdc8410c008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2c52cf-1f') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:02:07 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3f:dc:9e"/><model type="virtio"/><mtu size="1442"/><target dev="tap5a2c52cf-1f"/></interface> {{(pid=75014) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 04:02:07 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3f:dc:9e"/><model type="virtio"/><mtu size="1442"/><target dev="tap5a2c52cf-1f"/></interface> {{(pid=75014) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 04:02:07 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Attempting to detach device tap5a2c52cf-1f from instance 5c23c904-7d83-489c-bb45-04add15c2bf6 from the persistent domain config. {{(pid=75014) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 04:02:07 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] detach device xml: <interface type="ethernet">
Nov 08 04:02:07 user nova-compute[75014]:   <mac address="fa:16:3e:3f:dc:9e"/>
Nov 08 04:02:07 user nova-compute[75014]:   <model type="virtio"/>
Nov 08 04:02:07 user nova-compute[75014]:   <mtu size="1442"/>
Nov 08 04:02:07 user nova-compute[75014]:   <target dev="tap5a2c52cf-1f"/>
Nov 08 04:02:07 user nova-compute[75014]: </interface>
Nov 08 04:02:07 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:02:07 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3f:dc:9e"/><model type="virtio"/><mtu size="1442"/><target dev="tap5a2c52cf-1f"/></interface> {{(pid=75014) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 04:02:07 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:3f:dc:9e"/><model type="virtio"/><mtu size="1442"/><target dev="tap5a2c52cf-1f"/></interface>not found in domain: <domain type='kvm' id='29'>
Nov 08 04:02:07 user nova-compute[75014]:   <name>instance-00000017</name>
Nov 08 04:02:07 user nova-compute[75014]:   <uuid>5c23c904-7d83-489c-bb45-04add15c2bf6</uuid>
Nov 08 04:02:07 user nova-compute[75014]:   <metadata>
Nov 08 04:02:07 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:02:07 user nova-compute[75014]:   <nova:package version="0.0.0"/>
Nov 08 04:02:07 user nova-compute[75014]:   <nova:name>tempest-device-tagging-server-974517943</nova:name>
Nov 08 04:02:07 user nova-compute[75014]:   <nova:creationTime>2023-11-08 04:01:13</nova:creationTime>
Nov 08 04:02:07 user nova-compute[75014]:   <nova:flavor name="m1.tiny">
Nov 08 04:02:07 user nova-compute[75014]:     <nova:memory>512</nova:memory>
Nov 08 04:02:07 user nova-compute[75014]:     <nova:disk>1</nova:disk>
Nov 08 04:02:07 user nova-compute[75014]:     <nova:swap>0</nova:swap>
Nov 08 04:02:07 user nova-compute[75014]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:02:07 user nova-compute[75014]:     <nova:vcpus>1</nova:vcpus>
Nov 08 04:02:07 user nova-compute[75014]:   </nova:flavor>
Nov 08 04:02:07 user nova-compute[75014]:   <nova:owner>
Nov 08 04:02:07 user nova-compute[75014]:     <nova:user uuid="685cdd725739412982a0d768ca78b325">tempest-TaggedAttachmentsTest-1223504486-project-member</nova:user>
Nov 08 04:02:07 user nova-compute[75014]:     <nova:project uuid="9e1d4a398f55459aaa5526ef57b816ab">tempest-TaggedAttachmentsTest-1223504486</nova:project>
Nov 08 04:02:07 user nova-compute[75014]:   </nova:owner>
Nov 08 04:02:07 user nova-compute[75014]:   <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:02:07 user nova-compute[75014]:   <nova:ports>
Nov 08 04:02:07 user nova-compute[75014]:     <nova:port uuid="eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f">
Nov 08 04:02:07 user nova-compute[75014]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 04:02:07 user nova-compute[75014]:     </nova:port>
Nov 08 04:02:07 user nova-compute[75014]:     <nova:port uuid="5a2c52cf-1fbe-4c48-b782-e221e1251c45">
Nov 08 04:02:07 user nova-compute[75014]:       <nova:ip type="fixed" address="10.10.10.119" ipVersion="4"/>
Nov 08 04:02:07 user nova-compute[75014]:     </nova:port>
Nov 08 04:02:07 user nova-compute[75014]:   </nova:ports>
Nov 08 04:02:07 user nova-compute[75014]: </nova:instance>
Nov 08 04:02:07 user nova-compute[75014]:   </metadata>
Nov 08 04:02:07 user nova-compute[75014]:   <memory unit='KiB'>524288</memory>
Nov 08 04:02:07 user nova-compute[75014]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 04:02:07 user nova-compute[75014]:   <vcpu placement='static'>1</vcpu>
Nov 08 04:02:07 user nova-compute[75014]:   <resource>
Nov 08 04:02:07 user nova-compute[75014]:     <partition>/machine</partition>
Nov 08 04:02:07 user nova-compute[75014]:   </resource>
Nov 08 04:02:07 user nova-compute[75014]:   <sysinfo type='smbios'>
Nov 08 04:02:07 user nova-compute[75014]:     <system>
Nov 08 04:02:07 user nova-compute[75014]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 04:02:07 user nova-compute[75014]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 04:02:07 user nova-compute[75014]:       <entry name='version'>0.0.0</entry>
Nov 08 04:02:07 user nova-compute[75014]:       <entry name='serial'>5c23c904-7d83-489c-bb45-04add15c2bf6</entry>
Nov 08 04:02:07 user nova-compute[75014]:       <entry name='uuid'>5c23c904-7d83-489c-bb45-04add15c2bf6</entry>
Nov 08 04:02:07 user nova-compute[75014]:       <entry name='family'>Virtual Machine</entry>
Nov 08 04:02:07 user nova-compute[75014]:     </system>
Nov 08 04:02:07 user nova-compute[75014]:   </sysinfo>
Nov 08 04:02:07 user nova-compute[75014]:   <os>
Nov 08 04:02:07 user nova-compute[75014]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 04:02:07 user nova-compute[75014]:     <boot dev='hd'/>
Nov 08 04:02:07 user nova-compute[75014]:     <smbios mode='sysinfo'/>
Nov 08 04:02:07 user nova-compute[75014]:   </os>
Nov 08 04:02:07 user nova-compute[75014]:   <features>
Nov 08 04:02:07 user nova-compute[75014]:     <acpi/>
Nov 08 04:02:07 user nova-compute[75014]:     <apic/>
Nov 08 04:02:07 user nova-compute[75014]:     <vmcoreinfo state='on'/>
Nov 08 04:02:07 user nova-compute[75014]:   </features>
Nov 08 04:02:07 user nova-compute[75014]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 04:02:07 user nova-compute[75014]:     <model fallback='forbid'>Nehalem</model>
Nov 08 04:02:07 user nova-compute[75014]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 04:02:07 user nova-compute[75014]:     <feature policy='require' name='vme'/>
Nov 08 04:02:07 user nova-compute[75014]:     <feature policy='require' name='x2apic'/>
Nov 08 04:02:07 user nova-compute[75014]:     <feature policy='require' name='hypervisor'/>
Nov 08 04:02:07 user nova-compute[75014]:   </cpu>
Nov 08 04:02:07 user nova-compute[75014]:   <clock offset='utc'>
Nov 08 04:02:07 user nova-compute[75014]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 04:02:07 user nova-compute[75014]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 04:02:07 user nova-compute[75014]:     <timer name='hpet' present='no'/>
Nov 08 04:02:07 user nova-compute[75014]:   </clock>
Nov 08 04:02:07 user nova-compute[75014]:   <on_poweroff>destroy</on_poweroff>
Nov 08 04:02:07 user nova-compute[75014]:   <on_reboot>restart</on_reboot>
Nov 08 04:02:07 user nova-compute[75014]:   <on_crash>destroy</on_crash>
Nov 08 04:02:07 user nova-compute[75014]:   <devices>
Nov 08 04:02:07 user nova-compute[75014]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 04:02:07 user nova-compute[75014]:     <disk type='file' device='disk'>
Nov 08 04:02:07 user nova-compute[75014]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 04:02:07 user nova-compute[75014]:       <source file='/opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk' index='2'/>
Nov 08 04:02:07 user nova-compute[75014]:       <backingStore type='file' index='3'>
Nov 08 04:02:07 user nova-compute[75014]:         <format type='raw'/>
Nov 08 04:02:07 user nova-compute[75014]:         <source file='/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9'/>
Nov 08 04:02:07 user nova-compute[75014]:         <backingStore/>
Nov 08 04:02:07 user nova-compute[75014]:       </backingStore>
Nov 08 04:02:07 user nova-compute[75014]:       <target dev='vda' bus='virtio'/>
Nov 08 04:02:07 user nova-compute[75014]:       <alias name='virtio-disk0'/>
Nov 08 04:02:07 user nova-compute[75014]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 04:02:07 user nova-compute[75014]:     </disk>
Nov 08 04:02:07 user nova-compute[75014]:     <disk type='file' device='cdrom'>
Nov 08 04:02:07 user nova-compute[75014]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 04:02:07 user nova-compute[75014]:       <source file='/opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk.config' index='1'/>
Nov 08 04:02:07 user nova-compute[75014]:       <backingStore/>
Nov 08 04:02:07 user nova-compute[75014]:       <target dev='hda' bus='ide'/>
Nov 08 04:02:07 user nova-compute[75014]:       <readonly/>
Nov 08 04:02:07 user nova-compute[75014]:       <alias name='ide0-0-0'/>
Nov 08 04:02:07 user nova-compute[75014]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 04:02:07 user nova-compute[75014]:     </disk>
Nov 08 04:02:07 user nova-compute[75014]:     <controller type='usb' index='0' model='none'>
Nov 08 04:02:07 user nova-compute[75014]:       <alias name='usb'/>
Nov 08 04:02:07 user nova-compute[75014]:     </controller>
Nov 08 04:02:07 user nova-compute[75014]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 04:02:07 user nova-compute[75014]:       <alias name='pci.0'/>
Nov 08 04:02:07 user nova-compute[75014]:     </controller>
Nov 08 04:02:07 user nova-compute[75014]:     <controller type='ide' index='0'>
Nov 08 04:02:07 user nova-compute[75014]:       <alias name='ide'/>
Nov 08 04:02:07 user nova-compute[75014]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 04:02:07 user nova-compute[75014]:     </controller>
Nov 08 04:02:07 user nova-compute[75014]:     <interface type='ethernet'>
Nov 08 04:02:07 user nova-compute[75014]:       <mac address='fa:16:3e:e1:e9:27'/>
Nov 08 04:02:07 user nova-compute[75014]:       <target dev='tapeb7a20ed-c5'/>
Nov 08 04:02:07 user nova-compute[75014]:       <model type='virtio'/>
Nov 08 04:02:07 user nova-compute[75014]:       <mtu size='1442'/>
Nov 08 04:02:07 user nova-compute[75014]:       <alias name='net0'/>
Nov 08 04:02:07 user nova-compute[75014]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 04:02:07 user nova-compute[75014]:     </interface>
Nov 08 04:02:07 user nova-compute[75014]:     <interface type='ethernet'>
Nov 08 04:02:07 user nova-compute[75014]:       <mac address='fa:16:3e:3f:dc:9e'/>
Nov 08 04:02:07 user nova-compute[75014]:       <target dev='tap5a2c52cf-1f'/>
Nov 08 04:02:07 user nova-compute[75014]:       <model type='virtio'/>
Nov 08 04:02:07 user nova-compute[75014]:       <mtu size='1442'/>
Nov 08 04:02:07 user nova-compute[75014]:       <alias name='net1'/>
Nov 08 04:02:07 user nova-compute[75014]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 08 04:02:07 user nova-compute[75014]:     </interface>
Nov 08 04:02:07 user nova-compute[75014]:     <serial type='pty'>
Nov 08 04:02:07 user nova-compute[75014]:       <source path='/dev/pts/12'/>
Nov 08 04:02:07 user nova-compute[75014]:       <log file='/opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/console.log' append='off'/>
Nov 08 04:02:07 user nova-compute[75014]:       <target type='isa-serial' port='0'>
Nov 08 04:02:07 user nova-compute[75014]:         <model name='isa-serial'/>
Nov 08 04:02:07 user nova-compute[75014]:       </target>
Nov 08 04:02:07 user nova-compute[75014]:       <alias name='serial0'/>
Nov 08 04:02:07 user nova-compute[75014]:     </serial>
Nov 08 04:02:07 user nova-compute[75014]:     <console type='pty' tty='/dev/pts/12'>
Nov 08 04:02:07 user nova-compute[75014]:       <source path='/dev/pts/12'/>
Nov 08 04:02:07 user nova-compute[75014]:       <log file='/opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/console.log' append='off'/>
Nov 08 04:02:07 user nova-compute[75014]:       <target type='serial' port='0'/>
Nov 08 04:02:07 user nova-compute[75014]:       <alias name='serial0'/>
Nov 08 04:02:07 user nova-compute[75014]:     </console>
Nov 08 04:02:07 user nova-compute[75014]:     <input type='mouse' bus='ps2'>
Nov 08 04:02:07 user nova-compute[75014]:       <alias name='input0'/>
Nov 08 04:02:07 user nova-compute[75014]:     </input>
Nov 08 04:02:07 user nova-compute[75014]:     <input type='keyboard' bus='ps2'>
Nov 08 04:02:07 user nova-compute[75014]:       <alias name='input1'/>
Nov 08 04:02:07 user nova-compute[75014]:     </input>
Nov 08 04:02:07 user nova-compute[75014]:     <graphics type='vnc' port='5912' autoport='yes' listen='0.0.0.0'>
Nov 08 04:02:07 user nova-compute[75014]:       <listen type='address' address='0.0.0.0'/>
Nov 08 04:02:07 user nova-compute[75014]:     </graphics>
Nov 08 04:02:07 user nova-compute[75014]:     <audio id='1' type='none'/>
Nov 08 04:02:07 user nova-compute[75014]:     <video>
Nov 08 04:02:07 user nova-compute[75014]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 04:02:07 user nova-compute[75014]:       <alias name='video0'/>
Nov 08 04:02:07 user nova-compute[75014]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 04:02:07 user nova-compute[75014]:     </video>
Nov 08 04:02:07 user nova-compute[75014]:     <memballoon model='virtio'>
Nov 08 04:02:07 user nova-compute[75014]:       <stats period='10'/>
Nov 08 04:02:07 user nova-compute[75014]:       <alias name='balloon0'/>
Nov 08 04:02:07 user nova-compute[75014]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 04:02:07 user nova-compute[75014]:     </memballoon>
Nov 08 04:02:07 user nova-compute[75014]:     <rng model='virtio'>
Nov 08 04:02:07 user nova-compute[75014]:       <backend model='random'>/dev/urandom</backend>
Nov 08 04:02:07 user nova-compute[75014]:       <alias name='rng0'/>
Nov 08 04:02:07 user nova-compute[75014]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 04:02:07 user nova-compute[75014]:     </rng>
Nov 08 04:02:07 user nova-compute[75014]:   </devices>
Nov 08 04:02:07 user nova-compute[75014]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 04:02:07 user nova-compute[75014]:     <label>libvirt-5c23c904-7d83-489c-bb45-04add15c2bf6</label>
Nov 08 04:02:07 user nova-compute[75014]:     <imagelabel>libvirt-5c23c904-7d83-489c-bb45-04add15c2bf6</imagelabel>
Nov 08 04:02:07 user nova-compute[75014]:   </seclabel>
Nov 08 04:02:07 user nova-compute[75014]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 04:02:07 user nova-compute[75014]:     <label>+64055:+108</label>
Nov 08 04:02:07 user nova-compute[75014]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 04:02:07 user nova-compute[75014]:   </seclabel>
Nov 08 04:02:07 user nova-compute[75014]: </domain>
Nov 08 04:02:07 user nova-compute[75014]:  {{(pid=75014) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 04:02:07 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Successfully detached device tap5a2c52cf-1f from instance 5c23c904-7d83-489c-bb45-04add15c2bf6 from the persistent domain config.
Nov 08 04:02:07 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] (1/8): Attempting to detach device tap5a2c52cf-1f with device alias net1 from instance 5c23c904-7d83-489c-bb45-04add15c2bf6 from the live domain config. {{(pid=75014) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 04:02:07 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] detach device xml: <interface type="ethernet">
Nov 08 04:02:07 user nova-compute[75014]:   <mac address="fa:16:3e:3f:dc:9e"/>
Nov 08 04:02:07 user nova-compute[75014]:   <model type="virtio"/>
Nov 08 04:02:07 user nova-compute[75014]:   <mtu size="1442"/>
Nov 08 04:02:07 user nova-compute[75014]:   <target dev="tap5a2c52cf-1f"/>
Nov 08 04:02:07 user nova-compute[75014]: </interface>
Nov 08 04:02:07 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:02:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:07 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Start waiting for the detach event from libvirt for device tap5a2c52cf-1f with device alias net1 for instance 5c23c904-7d83-489c-bb45-04add15c2bf6 {{(pid=75014) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 04:02:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:07 user nova-compute[75014]: DEBUG nova.compute.manager [req-38550885-d59f-4796-9e0e-392774ea238f req-784cef68-24a3-4b9f-a0ee-169ed119e7ee service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Received event network-vif-unplugged-5a2c52cf-1fbe-4c48-b782-e221e1251c45 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:02:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-38550885-d59f-4796-9e0e-392774ea238f req-784cef68-24a3-4b9f-a0ee-169ed119e7ee service nova] Acquiring lock "5c23c904-7d83-489c-bb45-04add15c2bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-38550885-d59f-4796-9e0e-392774ea238f req-784cef68-24a3-4b9f-a0ee-169ed119e7ee service nova] Lock "5c23c904-7d83-489c-bb45-04add15c2bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-38550885-d59f-4796-9e0e-392774ea238f req-784cef68-24a3-4b9f-a0ee-169ed119e7ee service nova] Lock "5c23c904-7d83-489c-bb45-04add15c2bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:07 user nova-compute[75014]: DEBUG nova.compute.manager [req-38550885-d59f-4796-9e0e-392774ea238f req-784cef68-24a3-4b9f-a0ee-169ed119e7ee service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] No waiting events found dispatching network-vif-unplugged-5a2c52cf-1fbe-4c48-b782-e221e1251c45 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:02:07 user nova-compute[75014]: WARNING nova.compute.manager [req-38550885-d59f-4796-9e0e-392774ea238f req-784cef68-24a3-4b9f-a0ee-169ed119e7ee service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Received unexpected event network-vif-unplugged-5a2c52cf-1fbe-4c48-b782-e221e1251c45 for instance with vm_state active and task_state None.
Nov 08 04:02:08 user nova-compute[75014]: DEBUG nova.compute.manager [req-0405cc9b-cfa0-431f-9c39-c0c909ccc5e3 req-e59a746a-699e-44e5-a105-203d4e4c39aa service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Received event network-vif-plugged-0ce8dc6f-2116-4163-8c05-2e3519724ee7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:02:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0405cc9b-cfa0-431f-9c39-c0c909ccc5e3 req-e59a746a-699e-44e5-a105-203d4e4c39aa service nova] Acquiring lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0405cc9b-cfa0-431f-9c39-c0c909ccc5e3 req-e59a746a-699e-44e5-a105-203d4e4c39aa service nova] Lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0405cc9b-cfa0-431f-9c39-c0c909ccc5e3 req-e59a746a-699e-44e5-a105-203d4e4c39aa service nova] Lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:08 user nova-compute[75014]: DEBUG nova.compute.manager [req-0405cc9b-cfa0-431f-9c39-c0c909ccc5e3 req-e59a746a-699e-44e5-a105-203d4e4c39aa service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] No waiting events found dispatching network-vif-plugged-0ce8dc6f-2116-4163-8c05-2e3519724ee7 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:02:08 user nova-compute[75014]: WARNING nova.compute.manager [req-0405cc9b-cfa0-431f-9c39-c0c909ccc5e3 req-e59a746a-699e-44e5-a105-203d4e4c39aa service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Received unexpected event network-vif-plugged-0ce8dc6f-2116-4163-8c05-2e3519724ee7 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 04:02:09 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:02:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 04:02:09 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Instance spawned successfully.
Nov 08 04:02:09 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:02:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7238711c-1e4e-4adb-8587-526dc1a78763 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.190s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:09 user nova-compute[75014]: DEBUG nova.compute.manager [req-892ae44b-7976-4ae9-b661-c74197b95c8b req-57cbbb1a-ecc3-4abe-bb4a-66373e5e7622 service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Received event network-vif-plugged-5a2c52cf-1fbe-4c48-b782-e221e1251c45 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:02:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-892ae44b-7976-4ae9-b661-c74197b95c8b req-57cbbb1a-ecc3-4abe-bb4a-66373e5e7622 service nova] Acquiring lock "5c23c904-7d83-489c-bb45-04add15c2bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-892ae44b-7976-4ae9-b661-c74197b95c8b req-57cbbb1a-ecc3-4abe-bb4a-66373e5e7622 service nova] Lock "5c23c904-7d83-489c-bb45-04add15c2bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-892ae44b-7976-4ae9-b661-c74197b95c8b req-57cbbb1a-ecc3-4abe-bb4a-66373e5e7622 service nova] Lock "5c23c904-7d83-489c-bb45-04add15c2bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:09 user nova-compute[75014]: DEBUG nova.compute.manager [req-892ae44b-7976-4ae9-b661-c74197b95c8b req-57cbbb1a-ecc3-4abe-bb4a-66373e5e7622 service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] No waiting events found dispatching network-vif-plugged-5a2c52cf-1fbe-4c48-b782-e221e1251c45 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:02:09 user nova-compute[75014]: WARNING nova.compute.manager [req-892ae44b-7976-4ae9-b661-c74197b95c8b req-57cbbb1a-ecc3-4abe-bb4a-66373e5e7622 service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Received unexpected event network-vif-plugged-5a2c52cf-1fbe-4c48-b782-e221e1251c45 for instance with vm_state active and task_state None.
Nov 08 04:02:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "44d4794d-91c4-4eb6-a752-37f587f2b420" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "44d4794d-91c4-4eb6-a752-37f587f2b420" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:11 user nova-compute[75014]: INFO nova.compute.manager [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Rebooting instance
Nov 08 04:02:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "refresh_cache-44d4794d-91c4-4eb6-a752-37f587f2b420" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:02:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquired lock "refresh_cache-44d4794d-91c4-4eb6-a752-37f587f2b420" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:02:11 user nova-compute[75014]: DEBUG nova.network.neutron [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:02:11 user nova-compute[75014]: DEBUG nova.network.neutron [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Updating instance_info_cache with network_info: [{"id": "37918aae-d92b-43c0-8477-1355ac936ab0", "address": "fa:16:3e:43:25:9f", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37918aae-d9", "ovs_interfaceid": "37918aae-d92b-43c0-8477-1355ac936ab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:02:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Releasing lock "refresh_cache-44d4794d-91c4-4eb6-a752-37f587f2b420" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:02:11 user nova-compute[75014]: DEBUG nova.compute.manager [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:02:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG nova.compute.manager [req-03509fe0-1025-4c7d-a5b0-e874f37fc6b4 req-c1916727-33d5-4597-9673-6c87dfba08fc service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Received event network-vif-unplugged-37918aae-d92b-43c0-8477-1355ac936ab0 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-03509fe0-1025-4c7d-a5b0-e874f37fc6b4 req-c1916727-33d5-4597-9673-6c87dfba08fc service nova] Acquiring lock "44d4794d-91c4-4eb6-a752-37f587f2b420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-03509fe0-1025-4c7d-a5b0-e874f37fc6b4 req-c1916727-33d5-4597-9673-6c87dfba08fc service nova] Lock "44d4794d-91c4-4eb6-a752-37f587f2b420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-03509fe0-1025-4c7d-a5b0-e874f37fc6b4 req-c1916727-33d5-4597-9673-6c87dfba08fc service nova] Lock "44d4794d-91c4-4eb6-a752-37f587f2b420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG nova.compute.manager [req-03509fe0-1025-4c7d-a5b0-e874f37fc6b4 req-c1916727-33d5-4597-9673-6c87dfba08fc service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] No waiting events found dispatching network-vif-unplugged-37918aae-d92b-43c0-8477-1355ac936ab0 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:02:12 user nova-compute[75014]: WARNING nova.compute.manager [req-03509fe0-1025-4c7d-a5b0-e874f37fc6b4 req-c1916727-33d5-4597-9673-6c87dfba08fc service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Received unexpected event network-vif-unplugged-37918aae-d92b-43c0-8477-1355ac936ab0 for instance with vm_state active and task_state reboot_started_hard.
Nov 08 04:02:12 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Instance destroyed successfully.
Nov 08 04:02:12 user nova-compute[75014]: DEBUG nova.objects.instance [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lazy-loading 'resources' on Instance uuid 44d4794d-91c4-4eb6-a752-37f587f2b420 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:59:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1283389400',display_name='tempest-TestMinimumBasicScenario-server-1283389400',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1283389400',id=22,image_ref='fc883799-3917-4eb3-ad7b-aec0fef4495b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd4W/27RUr/jFVGcD2SSXjFI9PeHAFU2/fUSyG/RGRc5V0x95Y0r91VEtl6T8buh3ZpbGPW38t75T1O0iy+2Qg623tDMYN5y6qvwp2gWJUmqQS0VB/6/qYXbUlezOiduA==',key_name='tempest-TestMinimumBasicScenario-309319752',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:59:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60831c0130424415a7bcf071bba28ab0',ramdisk_id='',reservation_id='r-ykj7rhm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fc883799-3917-4eb3-ad7b-aec0fef4495b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-696617302',owner_user_name='tempest-TestMinimumBasicScenario-696617302-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:02:12Z,user_data=None,user_id='377368f8d9a540aebd8b8760b7130fb5',uuid=44d4794d-91c4-4eb6-a752-37f587f2b420,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37918aae-d92b-43c0-8477-1355ac936ab0", "address": "fa:16:3e:43:25:9f", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37918aae-d9", "ovs_interfaceid": "37918aae-d92b-43c0-8477-1355ac936ab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Converting VIF {"id": "37918aae-d92b-43c0-8477-1355ac936ab0", "address": "fa:16:3e:43:25:9f", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37918aae-d9", "ovs_interfaceid": "37918aae-d92b-43c0-8477-1355ac936ab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:25:9f,bridge_name='br-int',has_traffic_filtering=True,id=37918aae-d92b-43c0-8477-1355ac936ab0,network=Network(b36b65ee-1443-4741-946a-096b65a4e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37918aae-d9') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG os_vif [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:25:9f,bridge_name='br-int',has_traffic_filtering=True,id=37918aae-d92b-43c0-8477-1355ac936ab0,network=Network(b36b65ee-1443-4741-946a-096b65a4e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37918aae-d9') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37918aae-d9, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b5cf42c0-7dc2-48cb-a263-27cba65fc993) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:12 user nova-compute[75014]: INFO os_vif [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:25:9f,bridge_name='br-int',has_traffic_filtering=True,id=37918aae-d92b-43c0-8477-1355ac936ab0,network=Network(b36b65ee-1443-4741-946a-096b65a4e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37918aae-d9')
Nov 08 04:02:12 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZwFESguO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:02:12 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:02:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a27e837-9810-4d75-8017-d683470f76a6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:02:12 user nova-compute[75014]: No targets found.
Nov 08 04:02:12 user nova-compute[75014]: iSNS:
Nov 08 04:02:12 user nova-compute[75014]: No targets found.
Nov 08 04:02:12 user nova-compute[75014]: STATIC:
Nov 08 04:02:12 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908
Nov 08 04:02:12 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:02:12 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:02:12 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec
Nov 08 04:02:12 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:02:12 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:02:12 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282
Nov 08 04:02:12 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:02:12 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:02:12 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:02:12 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:02:12 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:02:12 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a
Nov 08 04:02:12 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:02:12 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:02:12 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37
Nov 08 04:02:12 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:02:12 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:02:12 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b
Nov 08 04:02:12 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:02:12 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:02:12 user nova-compute[75014]: FIRMWARE:
Nov 08 04:02:12 user nova-compute[75014]: No targets found.
Nov 08 04:02:12 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:02:12 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:02:12 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b3ff56-45d4-412e-9d17-90d5e0c05dee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99336fc-d487-4eae-bbfa-c896e30b6c00]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:02:12 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:02:12 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:02:12 user nova-compute[75014]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)
Nov 08 04:02:12 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:02:12 user nova-compute[75014]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)
Nov 08 04:02:12 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:02:12 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:02:12 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:02:12 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:02:12 user nova-compute[75014]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)
Nov 08 04:02:12 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:02:12 user nova-compute[75014]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)
Nov 08 04:02:12 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:02:12 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0400744af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b'): ({'sdh'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Removing single pathed devices sdh {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb70817e-b789-49d8-9fd6-bb23fcf43e36]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf1c791-d5f1-4967-a9eb-15b483f1c3f1]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Flushing IO for device /dev/sdh {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9b8760-3857-43bb-868c-041f4d128e99]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.047s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae600deb-cc53-447a-9e02-939498360737]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] SCSI volumes sdh have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3657bb3-8755-41f6-9f29-a63f79f4be6c]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8422231-21ba-4723-9823-1373ca5a16d2]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b, portal: 172.16.0.220,3260]
Nov 08 04:02:12 user nova-compute[75014]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b, portal: 172.16.0.220,3260] successful.
Nov 08 04:02:12 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b840a7-b5cf-4d98-8582-c84164e1e911]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] <== disconnect_volume: return (343ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:02:12 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Start _get_guest_xml network_info=[{"id": "37918aae-d92b-43c0-8477-1355ac936ab0", "address": "fa:16:3e:43:25:9f", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37918aae-d9", "ovs_interfaceid": "37918aae-d92b-43c0-8477-1355ac936ab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=fc883799-3917-4eb3-ad7b-aec0fef4495b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'fc883799-3917-4eb3-ad7b-aec0fef4495b'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZwFESguO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '44d4794d-91c4-4eb6-a752-37f587f2b420', 'attached_at': '', 'detached_at': '', 'volume_id': '24d32672-c667-4adb-84b1-0dece53e7d7b', 'serial': '24d32672-c667-4adb-84b1-0dece53e7d7b'}, 'device_type': 'disk', 'attachment_id': '5b64cc42-e7c5-442d-8607-de4d46fac4f3', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:02:13 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:02:13 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:02:13 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=fc883799-3917-4eb3-ad7b-aec0fef4495b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG nova.objects.instance [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lazy-loading 'vcpu_model' on Instance uuid 44d4794d-91c4-4eb6-a752-37f587f2b420 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG nova.objects.base [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Object Instance<44d4794d-91c4-4eb6-a752-37f587f2b420> lazy-loaded attributes: resources,vcpu_model {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZwFESguO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:02:13 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:02:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:02:13 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:02:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:02:13 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[499c687f-bd52-444b-bb0a-c56d966fb4a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:02:13 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[155beac7-03e4-488d-b237-0856a3bf2f65]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b] added
Nov 08 04:02:13 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f7acd2-76e3-4cf8-b935-6d9f67761577]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b19198-df65-49ab-a1b1-d4c3437ed8c6]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZwFESguO {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZwFESguO" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e721f0a5-6357-4320-9971-e371b97428b3]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZwFESguO'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[24385ebd-5253-4159-ae8d-ecee3d04737f]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[918647b5-2988-4247-a5ea-8759bb0f3205]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:02:13 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:02:13 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:02:13 user nova-compute[75014]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)
Nov 08 04:02:13 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:02:13 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:02:13 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:02:13 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:02:13 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:02:13 user nova-compute[75014]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)
Nov 08 04:02:13 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:02:13 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:02:13 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[171f4f99-c236-4bee-b222-3d821d33647b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b, portal: 172.16.0.220,3260]
Nov 08 04:02:13 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b, portal: 172.16.0.220,3260] successful.
Nov 08 04:02:13 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50397ad-82b9-498b-b667-cb860c832b6f]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9832991d-25d8-4589-b08c-4c26c28a2841]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:02:13 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:02:13 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:02:13 user nova-compute[75014]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)
Nov 08 04:02:13 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:02:13 user nova-compute[75014]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)
Nov 08 04:02:13 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:02:13 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:02:13 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:02:13 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:02:13 user nova-compute[75014]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)
Nov 08 04:02:13 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:02:13 user nova-compute[75014]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)
Nov 08 04:02:13 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:02:13 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] HCTL ('39', '-', '-', 0) found on session 21 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c25f946-c2f0-45ec-ba49-c7cb3181b829]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:13 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Searching for a device in session 21 and hctl ['39', '*', '*', 0] yield: None {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:02:14 user nova-compute[75014]: DEBUG nova.compute.manager [req-b0d93666-7724-4425-bcf1-55a2e5a087ba req-76dac537-0f83-4505-a808-665f2dcdabca service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Received event network-vif-plugged-37918aae-d92b-43c0-8477-1355ac936ab0 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:02:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b0d93666-7724-4425-bcf1-55a2e5a087ba req-76dac537-0f83-4505-a808-665f2dcdabca service nova] Acquiring lock "44d4794d-91c4-4eb6-a752-37f587f2b420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b0d93666-7724-4425-bcf1-55a2e5a087ba req-76dac537-0f83-4505-a808-665f2dcdabca service nova] Lock "44d4794d-91c4-4eb6-a752-37f587f2b420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b0d93666-7724-4425-bcf1-55a2e5a087ba req-76dac537-0f83-4505-a808-665f2dcdabca service nova] Lock "44d4794d-91c4-4eb6-a752-37f587f2b420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:14 user nova-compute[75014]: DEBUG nova.compute.manager [req-b0d93666-7724-4425-bcf1-55a2e5a087ba req-76dac537-0f83-4505-a808-665f2dcdabca service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] No waiting events found dispatching network-vif-plugged-37918aae-d92b-43c0-8477-1355ac936ab0 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:02:14 user nova-compute[75014]: WARNING nova.compute.manager [req-b0d93666-7724-4425-bcf1-55a2e5a087ba req-76dac537-0f83-4505-a808-665f2dcdabca service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Received unexpected event network-vif-plugged-37918aae-d92b-43c0-8477-1355ac936ab0 for instance with vm_state active and task_state reboot_started_hard.
Nov 08 04:02:14 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Searching for a device in session 21 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:02:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZwFESguO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:02:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:02:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26131376466623163', 'path': '/dev/sdh'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:02:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131376466623163', 'path': '/dev/sdh'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:02:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:59:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1283389400',display_name='tempest-TestMinimumBasicScenario-server-1283389400',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1283389400',id=22,image_ref='fc883799-3917-4eb3-ad7b-aec0fef4495b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd4W/27RUr/jFVGcD2SSXjFI9PeHAFU2/fUSyG/RGRc5V0x95Y0r91VEtl6T8buh3ZpbGPW38t75T1O0iy+2Qg623tDMYN5y6qvwp2gWJUmqQS0VB/6/qYXbUlezOiduA==',key_name='tempest-TestMinimumBasicScenario-309319752',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:59:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60831c0130424415a7bcf071bba28ab0',ramdisk_id='',reservation_id='r-ykj7rhm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fc883799-3917-4eb3-ad7b-aec0fef4495b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-696617302',owner_user_name='tempest-TestMinimumBasicScenario-696617302-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:02:12Z,user_data=None,user_id='377368f8d9a540aebd8b8760b7130fb5',uuid=44d4794d-91c4-4eb6-a752-37f587f2b420,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37918aae-d92b-43c0-8477-1355ac936ab0", "address": "fa:16:3e:43:25:9f", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37918aae-d9", "ovs_interfaceid": "37918aae-d92b-43c0-8477-1355ac936ab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:02:14 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Converting VIF {"id": "37918aae-d92b-43c0-8477-1355ac936ab0", "address": "fa:16:3e:43:25:9f", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37918aae-d9", "ovs_interfaceid": "37918aae-d92b-43c0-8477-1355ac936ab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:02:14 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:25:9f,bridge_name='br-int',has_traffic_filtering=True,id=37918aae-d92b-43c0-8477-1355ac936ab0,network=Network(b36b65ee-1443-4741-946a-096b65a4e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37918aae-d9') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:02:14 user nova-compute[75014]: DEBUG nova.objects.instance [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lazy-loading 'pci_devices' on Instance uuid 44d4794d-91c4-4eb6-a752-37f587f2b420 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:02:14 user nova-compute[75014]: DEBUG nova.objects.base [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Object Instance<44d4794d-91c4-4eb6-a752-37f587f2b420> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:02:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:02:14 user nova-compute[75014]:   <uuid>44d4794d-91c4-4eb6-a752-37f587f2b420</uuid>
Nov 08 04:02:14 user nova-compute[75014]:   <name>instance-00000016</name>
Nov 08 04:02:14 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:02:14 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:02:14 user nova-compute[75014]:   <metadata>
Nov 08 04:02:14 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:02:14 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:02:14 user nova-compute[75014]:       <nova:name>tempest-TestMinimumBasicScenario-server-1283389400</nova:name>
Nov 08 04:02:14 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:02:13</nova:creationTime>
Nov 08 04:02:14 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:02:14 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:02:14 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:02:14 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:02:14 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:02:14 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:02:14 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:02:14 user nova-compute[75014]:       <nova:owner>
Nov 08 04:02:14 user nova-compute[75014]:         <nova:user uuid="377368f8d9a540aebd8b8760b7130fb5">tempest-TestMinimumBasicScenario-696617302-project-member</nova:user>
Nov 08 04:02:14 user nova-compute[75014]:         <nova:project uuid="60831c0130424415a7bcf071bba28ab0">tempest-TestMinimumBasicScenario-696617302</nova:project>
Nov 08 04:02:14 user nova-compute[75014]:       </nova:owner>
Nov 08 04:02:14 user nova-compute[75014]:       <nova:root type="image" uuid="fc883799-3917-4eb3-ad7b-aec0fef4495b"/>
Nov 08 04:02:14 user nova-compute[75014]:       <nova:ports>
Nov 08 04:02:14 user nova-compute[75014]:         <nova:port uuid="37918aae-d92b-43c0-8477-1355ac936ab0">
Nov 08 04:02:14 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 04:02:14 user nova-compute[75014]:         </nova:port>
Nov 08 04:02:14 user nova-compute[75014]:       </nova:ports>
Nov 08 04:02:14 user nova-compute[75014]:     </nova:instance>
Nov 08 04:02:14 user nova-compute[75014]:   </metadata>
Nov 08 04:02:14 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:02:14 user nova-compute[75014]:     <system>
Nov 08 04:02:14 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:02:14 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:02:14 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:02:14 user nova-compute[75014]:       <entry name="serial">44d4794d-91c4-4eb6-a752-37f587f2b420</entry>
Nov 08 04:02:14 user nova-compute[75014]:       <entry name="uuid">44d4794d-91c4-4eb6-a752-37f587f2b420</entry>
Nov 08 04:02:14 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:02:14 user nova-compute[75014]:     </system>
Nov 08 04:02:14 user nova-compute[75014]:   </sysinfo>
Nov 08 04:02:14 user nova-compute[75014]:   <os>
Nov 08 04:02:14 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:02:14 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:02:14 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:02:14 user nova-compute[75014]:   </os>
Nov 08 04:02:14 user nova-compute[75014]:   <features>
Nov 08 04:02:14 user nova-compute[75014]:     <acpi/>
Nov 08 04:02:14 user nova-compute[75014]:     <apic/>
Nov 08 04:02:14 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:02:14 user nova-compute[75014]:   </features>
Nov 08 04:02:14 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:02:14 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:02:14 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:02:14 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:02:14 user nova-compute[75014]:   </clock>
Nov 08 04:02:14 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:02:14 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:02:14 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:02:14 user nova-compute[75014]:   </cpu>
Nov 08 04:02:14 user nova-compute[75014]:   <devices>
Nov 08 04:02:14 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 04:02:14 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 04:02:14 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk"/>
Nov 08 04:02:14 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:02:14 user nova-compute[75014]:     </disk>
Nov 08 04:02:14 user nova-compute[75014]:     <disk type="block" device="disk">
Nov 08 04:02:14 user nova-compute[75014]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:02:14 user nova-compute[75014]:       <source dev="/dev/sdh"/>
Nov 08 04:02:14 user nova-compute[75014]:       <target dev="vdb" bus="virtio"/>
Nov 08 04:02:14 user nova-compute[75014]:       <serial>24d32672-c667-4adb-84b1-0dece53e7d7b</serial>
Nov 08 04:02:14 user nova-compute[75014]:     </disk>
Nov 08 04:02:14 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:02:14 user nova-compute[75014]:       <mac address="fa:16:3e:43:25:9f"/>
Nov 08 04:02:14 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:02:14 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:02:14 user nova-compute[75014]:       <target dev="tap37918aae-d9"/>
Nov 08 04:02:14 user nova-compute[75014]:     </interface>
Nov 08 04:02:14 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:02:14 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/console.log" append="off"/>
Nov 08 04:02:14 user nova-compute[75014]:     </serial>
Nov 08 04:02:14 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:02:14 user nova-compute[75014]:     <video>
Nov 08 04:02:14 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:02:14 user nova-compute[75014]:     </video>
Nov 08 04:02:14 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:02:14 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:02:14 user nova-compute[75014]:     </rng>
Nov 08 04:02:14 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:02:14 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:02:14 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:02:14 user nova-compute[75014]:     </memballoon>
Nov 08 04:02:14 user nova-compute[75014]:   </devices>
Nov 08 04:02:14 user nova-compute[75014]: </domain>
Nov 08 04:02:14 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:02:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk --force-share --output=json" returned: 0 in 0.311s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:02:15 user nova-compute[75014]: DEBUG nova.objects.instance [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lazy-loading 'trusted_certs' on Instance uuid 44d4794d-91c4-4eb6-a752-37f587f2b420 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:02:15 user nova-compute[75014]: DEBUG nova.objects.base [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Object Instance<44d4794d-91c4-4eb6-a752-37f587f2b420> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:02:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68492d0b8b75f9135d6b506d5542c276cef0cb3e --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68492d0b8b75f9135d6b506d5542c276cef0cb3e --force-share --output=json" returned: 0 in 0.178s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:15 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Checking if we can resize image /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 04:02:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:15 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Cannot resize image /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 04:02:15 user nova-compute[75014]: DEBUG nova.objects.instance [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lazy-loading 'migration_context' on Instance uuid 44d4794d-91c4-4eb6-a752-37f587f2b420 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:02:15 user nova-compute[75014]: DEBUG nova.objects.base [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Object Instance<44d4794d-91c4-4eb6-a752-37f587f2b420> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:02:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:59:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1283389400',display_name='tempest-TestMinimumBasicScenario-server-1283389400',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1283389400',id=22,image_ref='fc883799-3917-4eb3-ad7b-aec0fef4495b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd4W/27RUr/jFVGcD2SSXjFI9PeHAFU2/fUSyG/RGRc5V0x95Y0r91VEtl6T8buh3ZpbGPW38t75T1O0iy+2Qg623tDMYN5y6qvwp2gWJUmqQS0VB/6/qYXbUlezOiduA==',key_name='tempest-TestMinimumBasicScenario-309319752',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:59:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='60831c0130424415a7bcf071bba28ab0',ramdisk_id='',reservation_id='r-ykj7rhm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fc883799-3917-4eb3-ad7b-aec0fef4495b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-696617302',owner_user_name='tempest-TestMinimumBasicScenario-696617302-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:02:12Z,user_data=None,user_id='377368f8d9a540aebd8b8760b7130fb5',uuid=44d4794d-91c4-4eb6-a752-37f587f2b420,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37918aae-d92b-43c0-8477-1355ac936ab0", "address": "fa:16:3e:43:25:9f", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37918aae-d9", "ovs_interfaceid": "37918aae-d92b-43c0-8477-1355ac936ab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:02:15 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Converting VIF {"id": "37918aae-d92b-43c0-8477-1355ac936ab0", "address": "fa:16:3e:43:25:9f", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37918aae-d9", "ovs_interfaceid": "37918aae-d92b-43c0-8477-1355ac936ab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:02:15 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:25:9f,bridge_name='br-int',has_traffic_filtering=True,id=37918aae-d92b-43c0-8477-1355ac936ab0,network=Network(b36b65ee-1443-4741-946a-096b65a4e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37918aae-d9') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:02:15 user nova-compute[75014]: DEBUG os_vif [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:25:9f,bridge_name='br-int',has_traffic_filtering=True,id=37918aae-d92b-43c0-8477-1355ac936ab0,network=Network(b36b65ee-1443-4741-946a-096b65a4e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37918aae-d9') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:02:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:02:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:02:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2be6d679-d756-5971-bf4a-f012a9b7aa43', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:02:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:02:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37918aae-d9, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:02:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37918aae-d9, col_values=(('qos', UUID('76ff64b6-26b7-4b85-948b-ba923face6f7')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:02:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37918aae-d9, col_values=(('external_ids', {'iface-id': '37918aae-d92b-43c0-8477-1355ac936ab0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:25:9f', 'vm-uuid': '44d4794d-91c4-4eb6-a752-37f587f2b420'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:02:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:02:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:15 user nova-compute[75014]: INFO os_vif [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:25:9f,bridge_name='br-int',has_traffic_filtering=True,id=37918aae-d92b-43c0-8477-1355ac936ab0,network=Network(b36b65ee-1443-4741-946a-096b65a4e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37918aae-d9')
Nov 08 04:02:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:17 user nova-compute[75014]: DEBUG nova.compute.manager [req-4a688766-ea09-4f90-a906-76c3c966b6c2 req-ba3f5c63-e8c7-4608-84bf-cea8e5c3feda service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Received event network-vif-plugged-37918aae-d92b-43c0-8477-1355ac936ab0 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:02:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4a688766-ea09-4f90-a906-76c3c966b6c2 req-ba3f5c63-e8c7-4608-84bf-cea8e5c3feda service nova] Acquiring lock "44d4794d-91c4-4eb6-a752-37f587f2b420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4a688766-ea09-4f90-a906-76c3c966b6c2 req-ba3f5c63-e8c7-4608-84bf-cea8e5c3feda service nova] Lock "44d4794d-91c4-4eb6-a752-37f587f2b420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4a688766-ea09-4f90-a906-76c3c966b6c2 req-ba3f5c63-e8c7-4608-84bf-cea8e5c3feda service nova] Lock "44d4794d-91c4-4eb6-a752-37f587f2b420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:17 user nova-compute[75014]: DEBUG nova.compute.manager [req-4a688766-ea09-4f90-a906-76c3c966b6c2 req-ba3f5c63-e8c7-4608-84bf-cea8e5c3feda service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] No waiting events found dispatching network-vif-plugged-37918aae-d92b-43c0-8477-1355ac936ab0 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:02:17 user nova-compute[75014]: WARNING nova.compute.manager [req-4a688766-ea09-4f90-a906-76c3c966b6c2 req-ba3f5c63-e8c7-4608-84bf-cea8e5c3feda service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Received unexpected event network-vif-plugged-37918aae-d92b-43c0-8477-1355ac936ab0 for instance with vm_state active and task_state reboot_started_hard.
Nov 08 04:02:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:19 user nova-compute[75014]: DEBUG nova.compute.manager [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:02:19 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Instance rebooted successfully.
Nov 08 04:02:19 user nova-compute[75014]: DEBUG nova.compute.manager [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:02:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6eb9ca89-aaca-4a93-acb2-9940da6edd02 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "44d4794d-91c4-4eb6-a752-37f587f2b420" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.133s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:19 user nova-compute[75014]: DEBUG nova.compute.manager [req-7994e090-81bd-4e16-95c7-62f7b8ecf5d8 req-14cd2c11-11c9-4083-888e-ac44e98ace7c service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Received event network-vif-plugged-37918aae-d92b-43c0-8477-1355ac936ab0 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:02:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-7994e090-81bd-4e16-95c7-62f7b8ecf5d8 req-14cd2c11-11c9-4083-888e-ac44e98ace7c service nova] Acquiring lock "44d4794d-91c4-4eb6-a752-37f587f2b420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-7994e090-81bd-4e16-95c7-62f7b8ecf5d8 req-14cd2c11-11c9-4083-888e-ac44e98ace7c service nova] Lock "44d4794d-91c4-4eb6-a752-37f587f2b420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-7994e090-81bd-4e16-95c7-62f7b8ecf5d8 req-14cd2c11-11c9-4083-888e-ac44e98ace7c service nova] Lock "44d4794d-91c4-4eb6-a752-37f587f2b420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:19 user nova-compute[75014]: DEBUG nova.compute.manager [req-7994e090-81bd-4e16-95c7-62f7b8ecf5d8 req-14cd2c11-11c9-4083-888e-ac44e98ace7c service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] No waiting events found dispatching network-vif-plugged-37918aae-d92b-43c0-8477-1355ac936ab0 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:02:19 user nova-compute[75014]: WARNING nova.compute.manager [req-7994e090-81bd-4e16-95c7-62f7b8ecf5d8 req-14cd2c11-11c9-4083-888e-ac44e98ace7c service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Received unexpected event network-vif-plugged-37918aae-d92b-43c0-8477-1355ac936ab0 for instance with vm_state active and task_state None.
Nov 08 04:02:20 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-75f55cf6-4a96-4005-8634-f30a56450b77 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Acquiring lock "e432a710-90cd-4b46-8b49-f6b3ab8480dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-75f55cf6-4a96-4005-8634-f30a56450b77 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lock "e432a710-90cd-4b46-8b49-f6b3ab8480dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-75f55cf6-4a96-4005-8634-f30a56450b77 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Acquiring lock "e432a710-90cd-4b46-8b49-f6b3ab8480dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-75f55cf6-4a96-4005-8634-f30a56450b77 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lock "e432a710-90cd-4b46-8b49-f6b3ab8480dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-75f55cf6-4a96-4005-8634-f30a56450b77 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lock "e432a710-90cd-4b46-8b49-f6b3ab8480dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:21 user nova-compute[75014]: INFO nova.compute.manager [None req-75f55cf6-4a96-4005-8634-f30a56450b77 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Terminating instance
Nov 08 04:02:21 user nova-compute[75014]: DEBUG nova.compute.manager [None req-75f55cf6-4a96-4005-8634-f30a56450b77 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG nova.compute.manager [req-b8f947cc-07a5-42a8-b53d-6e9656fc39fd req-75b75fc9-8507-44b1-9716-c07cdac382a7 service nova] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Received event network-vif-unplugged-2df00777-dbee-4261-bd75-145228e8364b {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b8f947cc-07a5-42a8-b53d-6e9656fc39fd req-75b75fc9-8507-44b1-9716-c07cdac382a7 service nova] Acquiring lock "e432a710-90cd-4b46-8b49-f6b3ab8480dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b8f947cc-07a5-42a8-b53d-6e9656fc39fd req-75b75fc9-8507-44b1-9716-c07cdac382a7 service nova] Lock "e432a710-90cd-4b46-8b49-f6b3ab8480dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b8f947cc-07a5-42a8-b53d-6e9656fc39fd req-75b75fc9-8507-44b1-9716-c07cdac382a7 service nova] Lock "e432a710-90cd-4b46-8b49-f6b3ab8480dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG nova.compute.manager [req-b8f947cc-07a5-42a8-b53d-6e9656fc39fd req-75b75fc9-8507-44b1-9716-c07cdac382a7 service nova] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] No waiting events found dispatching network-vif-unplugged-2df00777-dbee-4261-bd75-145228e8364b {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG nova.compute.manager [req-b8f947cc-07a5-42a8-b53d-6e9656fc39fd req-75b75fc9-8507-44b1-9716-c07cdac382a7 service nova] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Received event network-vif-unplugged-2df00777-dbee-4261-bd75-145228e8364b for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:02:22 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d is timed out.
Nov 08 04:02:22 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Successfully detached device vdb from instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d from the live domain config.
Nov 08 04:02:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MExPpRDs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:02:22 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:02:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b966a88-2f04-4d4b-bcca-03dc2693baba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:22 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Instance destroyed successfully.
Nov 08 04:02:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:02:22 user nova-compute[75014]: No targets found.
Nov 08 04:02:22 user nova-compute[75014]: iSNS:
Nov 08 04:02:22 user nova-compute[75014]: No targets found.
Nov 08 04:02:22 user nova-compute[75014]: STATIC:
Nov 08 04:02:22 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908
Nov 08 04:02:22 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:02:22 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:02:22 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec
Nov 08 04:02:22 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:02:22 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:02:22 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282
Nov 08 04:02:22 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:02:22 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:02:22 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:02:22 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:02:22 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:02:22 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a
Nov 08 04:02:22 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:02:22 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:02:22 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37
Nov 08 04:02:22 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:02:22 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:02:22 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b
Nov 08 04:02:22 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:02:22 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:02:22 user nova-compute[75014]: FIRMWARE:
Nov 08 04:02:22 user nova-compute[75014]: No targets found.
Nov 08 04:02:22 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:02:22 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:02:22 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG nova.objects.instance [None req-75f55cf6-4a96-4005-8634-f30a56450b77 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lazy-loading 'resources' on Instance uuid e432a710-90cd-4b46-8b49-f6b3ab8480dc {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-75f55cf6-4a96-4005-8634-f30a56450b77 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2043684667',display_name='tempest-VolumesActionsTest-instance-2043684667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2043684667',id=26,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:00:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a77d1e7a3adc430ab1a17b1c954db9a4',ramdisk_id='',reservation_id='r-gap580gx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-158235265',owner_user_name='tempest-VolumesActionsTest-158235265-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:00:34Z,user_data=None,user_id='2952d351dfab46f2bd6caa61d6d59540',uuid=e432a710-90cd-4b46-8b49-f6b3ab8480dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2df00777-dbee-4261-bd75-145228e8364b", "address": "fa:16:3e:8b:b6:a9", "network": {"id": "8ee4c37f-4f4b-4886-9824-d394b2d3d49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-754640303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77d1e7a3adc430ab1a17b1c954db9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df00777-db", "ovs_interfaceid": "2df00777-dbee-4261-bd75-145228e8364b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-75f55cf6-4a96-4005-8634-f30a56450b77 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Converting VIF {"id": "2df00777-dbee-4261-bd75-145228e8364b", "address": "fa:16:3e:8b:b6:a9", "network": {"id": "8ee4c37f-4f4b-4886-9824-d394b2d3d49d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-754640303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77d1e7a3adc430ab1a17b1c954db9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df00777-db", "ovs_interfaceid": "2df00777-dbee-4261-bd75-145228e8364b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-75f55cf6-4a96-4005-8634-f30a56450b77 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:b6:a9,bridge_name='br-int',has_traffic_filtering=True,id=2df00777-dbee-4261-bd75-145228e8364b,network=Network(8ee4c37f-4f4b-4886-9824-d394b2d3d49d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df00777-db') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG os_vif [None req-75f55cf6-4a96-4005-8634-f30a56450b77 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:b6:a9,bridge_name='br-int',has_traffic_filtering=True,id=2df00777-dbee-4261-bd75-145228e8364b,network=Network(8ee4c37f-4f4b-4886-9824-d394b2d3d49d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df00777-db') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2df00777-db, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa22e656-37f3-4505-a223-ac0a19d670a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=501e7893-e9b4-4a66-938b-9953f5928a37) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:22 user nova-compute[75014]: INFO os_vif [None req-75f55cf6-4a96-4005-8634-f30a56450b77 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:b6:a9,bridge_name='br-int',has_traffic_filtering=True,id=2df00777-dbee-4261-bd75-145228e8364b,network=Network(8ee4c37f-4f4b-4886-9824-d394b2d3d49d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df00777-db')
Nov 08 04:02:22 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-75f55cf6-4a96-4005-8634-f30a56450b77 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Deleting instance files /opt/stack/data/nova/instances/e432a710-90cd-4b46-8b49-f6b3ab8480dc_del
Nov 08 04:02:22 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-75f55cf6-4a96-4005-8634-f30a56450b77 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Deletion of /opt/stack/data/nova/instances/e432a710-90cd-4b46-8b49-f6b3ab8480dc_del complete
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[06515455-1898-4b72-b338-955a4f8dbbe7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:02:22 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:02:22 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:02:22 user nova-compute[75014]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)
Nov 08 04:02:22 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:02:22 user nova-compute[75014]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)
Nov 08 04:02:22 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:02:22 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:02:22 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:02:22 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:02:22 user nova-compute[75014]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 (non-flash)
Nov 08 04:02:22 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:02:22 user nova-compute[75014]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)
Nov 08 04:02:22 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:02:22 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f04183c2200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282'): ({'sde'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Removing single pathed devices sde {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e491663b-5e97-430f-a660-7b1ce746f91a]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b53902-418f-403a-9970-84c04e48fd4e]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Flushing IO for device /dev/sde {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bffcff5-44c8-45f1-9ead-4c17a1fc1d9f]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:22 user nova-compute[75014]: INFO nova.compute.manager [None req-75f55cf6-4a96-4005-8634-f30a56450b77 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Took 0.79 seconds to destroy the instance on the hypervisor.
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-75f55cf6-4a96-4005-8634-f30a56450b77 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b470336-ad24-49e2-bfbf-0622187da718]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] SCSI volumes sde have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c200378-6cd3-4b90-bb1a-ef11c7ed4f4c]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfa21cd-f6c5-4f10-afd0-c09f69081693]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282, portal: 172.16.0.220,3260]
Nov 08 04:02:22 user nova-compute[75014]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282, portal: 172.16.0.220,3260] successful.
Nov 08 04:02:22 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7b3943-b00c-4fa6-b643-8330e73fb282 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d02023-e532-401f-b481-bfee1559ce4a]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] <== disconnect_volume: return (398ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:02:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:02:23 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:02:23 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Took 0.57 seconds to deallocate network for instance.
Nov 08 04:02:23 user nova-compute[75014]: DEBUG nova.compute.manager [req-fe99a68c-88d1-4422-ac5c-f8568e574314 req-98e432aa-48b6-4eb3-b87c-134335590366 service nova] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Received event network-vif-deleted-2df00777-dbee-4261-bd75-145228e8364b {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:02:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-75f55cf6-4a96-4005-8634-f30a56450b77 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-75f55cf6-4a96-4005-8634-f30a56450b77 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:23 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-75f55cf6-4a96-4005-8634-f30a56450b77 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:02:23 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-75f55cf6-4a96-4005-8634-f30a56450b77 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:02:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-75f55cf6-4a96-4005-8634-f30a56450b77 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.536s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:23 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-75f55cf6-4a96-4005-8634-f30a56450b77 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Deleted allocations for instance e432a710-90cd-4b46-8b49-f6b3ab8480dc
Nov 08 04:02:24 user nova-compute[75014]: DEBUG nova.objects.instance [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lazy-loading 'flavor' on Instance uuid 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:02:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-75f55cf6-4a96-4005-8634-f30a56450b77 tempest-VolumesActionsTest-158235265 tempest-VolumesActionsTest-158235265-project-member] Lock "e432a710-90cd-4b46-8b49-f6b3ab8480dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.245s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-58377727-2a16-4357-a658-812a76fd52ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.606s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:24 user nova-compute[75014]: DEBUG nova.compute.manager [req-6b88bec8-997c-44a8-b188-028aee4b15d3 req-0f3e375a-8349-4937-94e0-4e0bc4d346e4 service nova] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Received event network-vif-plugged-2df00777-dbee-4261-bd75-145228e8364b {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:02:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-6b88bec8-997c-44a8-b188-028aee4b15d3 req-0f3e375a-8349-4937-94e0-4e0bc4d346e4 service nova] Acquiring lock "e432a710-90cd-4b46-8b49-f6b3ab8480dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-6b88bec8-997c-44a8-b188-028aee4b15d3 req-0f3e375a-8349-4937-94e0-4e0bc4d346e4 service nova] Lock "e432a710-90cd-4b46-8b49-f6b3ab8480dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-6b88bec8-997c-44a8-b188-028aee4b15d3 req-0f3e375a-8349-4937-94e0-4e0bc4d346e4 service nova] Lock "e432a710-90cd-4b46-8b49-f6b3ab8480dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:24 user nova-compute[75014]: DEBUG nova.compute.manager [req-6b88bec8-997c-44a8-b188-028aee4b15d3 req-0f3e375a-8349-4937-94e0-4e0bc4d346e4 service nova] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] No waiting events found dispatching network-vif-plugged-2df00777-dbee-4261-bd75-145228e8364b {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:02:24 user nova-compute[75014]: WARNING nova.compute.manager [req-6b88bec8-997c-44a8-b188-028aee4b15d3 req-0f3e375a-8349-4937-94e0-4e0bc4d346e4 service nova] [instance: e432a710-90cd-4b46-8b49-f6b3ab8480dc] Received unexpected event network-vif-plugged-2df00777-dbee-4261-bd75-145228e8364b for instance with vm_state deleted and task_state None.
Nov 08 04:02:26 user nova-compute[75014]: DEBUG nova.compute.manager [req-d1054103-fede-45fa-b4d5-16aea22bbc8c req-f9425b24-476b-4d10-a9bc-9f0d01815d7a service nova] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Received event network-changed-4f3b192f-a567-463a-b120-1b328e11feaa {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:02:26 user nova-compute[75014]: DEBUG nova.compute.manager [req-d1054103-fede-45fa-b4d5-16aea22bbc8c req-f9425b24-476b-4d10-a9bc-9f0d01815d7a service nova] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Refreshing instance network info cache due to event network-changed-4f3b192f-a567-463a-b120-1b328e11feaa. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:02:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d1054103-fede-45fa-b4d5-16aea22bbc8c req-f9425b24-476b-4d10-a9bc-9f0d01815d7a service nova] Acquiring lock "refresh_cache-c23c9e00-b782-4530-bb01-a7a167951c1d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:02:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d1054103-fede-45fa-b4d5-16aea22bbc8c req-f9425b24-476b-4d10-a9bc-9f0d01815d7a service nova] Acquired lock "refresh_cache-c23c9e00-b782-4530-bb01-a7a167951c1d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:02:26 user nova-compute[75014]: DEBUG nova.network.neutron [req-d1054103-fede-45fa-b4d5-16aea22bbc8c req-f9425b24-476b-4d10-a9bc-9f0d01815d7a service nova] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Refreshing network info cache for port 4f3b192f-a567-463a-b120-1b328e11feaa {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:02:26 user nova-compute[75014]: DEBUG nova.network.neutron [req-d1054103-fede-45fa-b4d5-16aea22bbc8c req-f9425b24-476b-4d10-a9bc-9f0d01815d7a service nova] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Updated VIF entry in instance network info cache for port 4f3b192f-a567-463a-b120-1b328e11feaa. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:02:26 user nova-compute[75014]: DEBUG nova.network.neutron [req-d1054103-fede-45fa-b4d5-16aea22bbc8c req-f9425b24-476b-4d10-a9bc-9f0d01815d7a service nova] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Updating instance_info_cache with network_info: [{"id": "4f3b192f-a567-463a-b120-1b328e11feaa", "address": "fa:16:3e:70:b6:a1", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3b192f-a5", "ovs_interfaceid": "4f3b192f-a567-463a-b120-1b328e11feaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:02:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d1054103-fede-45fa-b4d5-16aea22bbc8c req-f9425b24-476b-4d10-a9bc-9f0d01815d7a service nova] Releasing lock "refresh_cache-c23c9e00-b782-4530-bb01-a7a167951c1d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:02:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:27 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Waiting for libvirt event about the detach of device tap5a2c52cf-1f with device alias net1 from instance 5c23c904-7d83-489c-bb45-04add15c2bf6 is timed out.
Nov 08 04:02:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3f:dc:9e"/><model type="virtio"/><mtu size="1442"/><target dev="tap5a2c52cf-1f"/></interface> {{(pid=75014) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 04:02:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:3f:dc:9e"/><model type="virtio"/><mtu size="1442"/><target dev="tap5a2c52cf-1f"/></interface>not found in domain: <domain type='kvm' id='29'>
Nov 08 04:02:27 user nova-compute[75014]:   <name>instance-00000017</name>
Nov 08 04:02:27 user nova-compute[75014]:   <uuid>5c23c904-7d83-489c-bb45-04add15c2bf6</uuid>
Nov 08 04:02:27 user nova-compute[75014]:   <metadata>
Nov 08 04:02:27 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:02:27 user nova-compute[75014]:   <nova:package version="0.0.0"/>
Nov 08 04:02:27 user nova-compute[75014]:   <nova:name>tempest-device-tagging-server-974517943</nova:name>
Nov 08 04:02:27 user nova-compute[75014]:   <nova:creationTime>2023-11-08 04:01:13</nova:creationTime>
Nov 08 04:02:27 user nova-compute[75014]:   <nova:flavor name="m1.tiny">
Nov 08 04:02:27 user nova-compute[75014]:     <nova:memory>512</nova:memory>
Nov 08 04:02:27 user nova-compute[75014]:     <nova:disk>1</nova:disk>
Nov 08 04:02:27 user nova-compute[75014]:     <nova:swap>0</nova:swap>
Nov 08 04:02:27 user nova-compute[75014]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:02:27 user nova-compute[75014]:     <nova:vcpus>1</nova:vcpus>
Nov 08 04:02:27 user nova-compute[75014]:   </nova:flavor>
Nov 08 04:02:27 user nova-compute[75014]:   <nova:owner>
Nov 08 04:02:27 user nova-compute[75014]:     <nova:user uuid="685cdd725739412982a0d768ca78b325">tempest-TaggedAttachmentsTest-1223504486-project-member</nova:user>
Nov 08 04:02:27 user nova-compute[75014]:     <nova:project uuid="9e1d4a398f55459aaa5526ef57b816ab">tempest-TaggedAttachmentsTest-1223504486</nova:project>
Nov 08 04:02:27 user nova-compute[75014]:   </nova:owner>
Nov 08 04:02:27 user nova-compute[75014]:   <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:02:27 user nova-compute[75014]:   <nova:ports>
Nov 08 04:02:27 user nova-compute[75014]:     <nova:port uuid="eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f">
Nov 08 04:02:27 user nova-compute[75014]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 04:02:27 user nova-compute[75014]:     </nova:port>
Nov 08 04:02:27 user nova-compute[75014]:     <nova:port uuid="5a2c52cf-1fbe-4c48-b782-e221e1251c45">
Nov 08 04:02:27 user nova-compute[75014]:       <nova:ip type="fixed" address="10.10.10.119" ipVersion="4"/>
Nov 08 04:02:27 user nova-compute[75014]:     </nova:port>
Nov 08 04:02:27 user nova-compute[75014]:   </nova:ports>
Nov 08 04:02:27 user nova-compute[75014]: </nova:instance>
Nov 08 04:02:27 user nova-compute[75014]:   </metadata>
Nov 08 04:02:27 user nova-compute[75014]:   <memory unit='KiB'>524288</memory>
Nov 08 04:02:27 user nova-compute[75014]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 04:02:27 user nova-compute[75014]:   <vcpu placement='static'>1</vcpu>
Nov 08 04:02:27 user nova-compute[75014]:   <resource>
Nov 08 04:02:27 user nova-compute[75014]:     <partition>/machine</partition>
Nov 08 04:02:27 user nova-compute[75014]:   </resource>
Nov 08 04:02:27 user nova-compute[75014]:   <sysinfo type='smbios'>
Nov 08 04:02:27 user nova-compute[75014]:     <system>
Nov 08 04:02:27 user nova-compute[75014]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 04:02:27 user nova-compute[75014]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 04:02:27 user nova-compute[75014]:       <entry name='version'>0.0.0</entry>
Nov 08 04:02:27 user nova-compute[75014]:       <entry name='serial'>5c23c904-7d83-489c-bb45-04add15c2bf6</entry>
Nov 08 04:02:27 user nova-compute[75014]:       <entry name='uuid'>5c23c904-7d83-489c-bb45-04add15c2bf6</entry>
Nov 08 04:02:27 user nova-compute[75014]:       <entry name='family'>Virtual Machine</entry>
Nov 08 04:02:27 user nova-compute[75014]:     </system>
Nov 08 04:02:27 user nova-compute[75014]:   </sysinfo>
Nov 08 04:02:27 user nova-compute[75014]:   <os>
Nov 08 04:02:27 user nova-compute[75014]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 04:02:27 user nova-compute[75014]:     <boot dev='hd'/>
Nov 08 04:02:27 user nova-compute[75014]:     <smbios mode='sysinfo'/>
Nov 08 04:02:27 user nova-compute[75014]:   </os>
Nov 08 04:02:27 user nova-compute[75014]:   <features>
Nov 08 04:02:27 user nova-compute[75014]:     <acpi/>
Nov 08 04:02:27 user nova-compute[75014]:     <apic/>
Nov 08 04:02:27 user nova-compute[75014]:     <vmcoreinfo state='on'/>
Nov 08 04:02:27 user nova-compute[75014]:   </features>
Nov 08 04:02:27 user nova-compute[75014]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 04:02:27 user nova-compute[75014]:     <model fallback='forbid'>Nehalem</model>
Nov 08 04:02:27 user nova-compute[75014]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 04:02:27 user nova-compute[75014]:     <feature policy='require' name='vme'/>
Nov 08 04:02:27 user nova-compute[75014]:     <feature policy='require' name='x2apic'/>
Nov 08 04:02:27 user nova-compute[75014]:     <feature policy='require' name='hypervisor'/>
Nov 08 04:02:27 user nova-compute[75014]:   </cpu>
Nov 08 04:02:27 user nova-compute[75014]:   <clock offset='utc'>
Nov 08 04:02:27 user nova-compute[75014]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 04:02:27 user nova-compute[75014]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 04:02:27 user nova-compute[75014]:     <timer name='hpet' present='no'/>
Nov 08 04:02:27 user nova-compute[75014]:   </clock>
Nov 08 04:02:27 user nova-compute[75014]:   <on_poweroff>destroy</on_poweroff>
Nov 08 04:02:27 user nova-compute[75014]:   <on_reboot>restart</on_reboot>
Nov 08 04:02:27 user nova-compute[75014]:   <on_crash>destroy</on_crash>
Nov 08 04:02:27 user nova-compute[75014]:   <devices>
Nov 08 04:02:27 user nova-compute[75014]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 04:02:27 user nova-compute[75014]:     <disk type='file' device='disk'>
Nov 08 04:02:27 user nova-compute[75014]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 04:02:27 user nova-compute[75014]:       <source file='/opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk' index='2'/>
Nov 08 04:02:27 user nova-compute[75014]:       <backingStore type='file' index='3'>
Nov 08 04:02:27 user nova-compute[75014]:         <format type='raw'/>
Nov 08 04:02:27 user nova-compute[75014]:         <source file='/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9'/>
Nov 08 04:02:27 user nova-compute[75014]:         <backingStore/>
Nov 08 04:02:27 user nova-compute[75014]:       </backingStore>
Nov 08 04:02:27 user nova-compute[75014]:       <target dev='vda' bus='virtio'/>
Nov 08 04:02:27 user nova-compute[75014]:       <alias name='virtio-disk0'/>
Nov 08 04:02:27 user nova-compute[75014]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 04:02:27 user nova-compute[75014]:     </disk>
Nov 08 04:02:27 user nova-compute[75014]:     <disk type='file' device='cdrom'>
Nov 08 04:02:27 user nova-compute[75014]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 04:02:27 user nova-compute[75014]:       <source file='/opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk.config' index='1'/>
Nov 08 04:02:27 user nova-compute[75014]:       <backingStore/>
Nov 08 04:02:27 user nova-compute[75014]:       <target dev='hda' bus='ide'/>
Nov 08 04:02:27 user nova-compute[75014]:       <readonly/>
Nov 08 04:02:27 user nova-compute[75014]:       <alias name='ide0-0-0'/>
Nov 08 04:02:27 user nova-compute[75014]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 04:02:27 user nova-compute[75014]:     </disk>
Nov 08 04:02:27 user nova-compute[75014]:     <controller type='usb' index='0' model='none'>
Nov 08 04:02:27 user nova-compute[75014]:       <alias name='usb'/>
Nov 08 04:02:27 user nova-compute[75014]:     </controller>
Nov 08 04:02:27 user nova-compute[75014]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 04:02:27 user nova-compute[75014]:       <alias name='pci.0'/>
Nov 08 04:02:27 user nova-compute[75014]:     </controller>
Nov 08 04:02:27 user nova-compute[75014]:     <controller type='ide' index='0'>
Nov 08 04:02:27 user nova-compute[75014]:       <alias name='ide'/>
Nov 08 04:02:27 user nova-compute[75014]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 04:02:27 user nova-compute[75014]:     </controller>
Nov 08 04:02:27 user nova-compute[75014]:     <interface type='ethernet'>
Nov 08 04:02:27 user nova-compute[75014]:       <mac address='fa:16:3e:e1:e9:27'/>
Nov 08 04:02:27 user nova-compute[75014]:       <target dev='tapeb7a20ed-c5'/>
Nov 08 04:02:27 user nova-compute[75014]:       <model type='virtio'/>
Nov 08 04:02:27 user nova-compute[75014]:       <mtu size='1442'/>
Nov 08 04:02:27 user nova-compute[75014]:       <alias name='net0'/>
Nov 08 04:02:27 user nova-compute[75014]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 04:02:27 user nova-compute[75014]:     </interface>
Nov 08 04:02:27 user nova-compute[75014]:     <serial type='pty'>
Nov 08 04:02:27 user nova-compute[75014]:       <source path='/dev/pts/12'/>
Nov 08 04:02:27 user nova-compute[75014]:       <log file='/opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/console.log' append='off'/>
Nov 08 04:02:27 user nova-compute[75014]:       <target type='isa-serial' port='0'>
Nov 08 04:02:27 user nova-compute[75014]:         <model name='isa-serial'/>
Nov 08 04:02:27 user nova-compute[75014]:       </target>
Nov 08 04:02:27 user nova-compute[75014]:       <alias name='serial0'/>
Nov 08 04:02:27 user nova-compute[75014]:     </serial>
Nov 08 04:02:27 user nova-compute[75014]:     <console type='pty' tty='/dev/pts/12'>
Nov 08 04:02:27 user nova-compute[75014]:       <source path='/dev/pts/12'/>
Nov 08 04:02:27 user nova-compute[75014]:       <log file='/opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/console.log' append='off'/>
Nov 08 04:02:27 user nova-compute[75014]:       <target type='serial' port='0'/>
Nov 08 04:02:27 user nova-compute[75014]:       <alias name='serial0'/>
Nov 08 04:02:27 user nova-compute[75014]:     </console>
Nov 08 04:02:27 user nova-compute[75014]:     <input type='mouse' bus='ps2'>
Nov 08 04:02:27 user nova-compute[75014]:       <alias name='input0'/>
Nov 08 04:02:27 user nova-compute[75014]:     </input>
Nov 08 04:02:27 user nova-compute[75014]:     <input type='keyboard' bus='ps2'>
Nov 08 04:02:27 user nova-compute[75014]:       <alias name='input1'/>
Nov 08 04:02:27 user nova-compute[75014]:     </input>
Nov 08 04:02:27 user nova-compute[75014]:     <graphics type='vnc' port='5912' autoport='yes' listen='0.0.0.0'>
Nov 08 04:02:27 user nova-compute[75014]:       <listen type='address' address='0.0.0.0'/>
Nov 08 04:02:27 user nova-compute[75014]:     </graphics>
Nov 08 04:02:27 user nova-compute[75014]:     <audio id='1' type='none'/>
Nov 08 04:02:27 user nova-compute[75014]:     <video>
Nov 08 04:02:27 user nova-compute[75014]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 04:02:27 user nova-compute[75014]:       <alias name='video0'/>
Nov 08 04:02:27 user nova-compute[75014]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 04:02:27 user nova-compute[75014]:     </video>
Nov 08 04:02:27 user nova-compute[75014]:     <memballoon model='virtio'>
Nov 08 04:02:27 user nova-compute[75014]:       <stats period='10'/>
Nov 08 04:02:27 user nova-compute[75014]:       <alias name='balloon0'/>
Nov 08 04:02:27 user nova-compute[75014]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 04:02:27 user nova-compute[75014]:     </memballoon>
Nov 08 04:02:27 user nova-compute[75014]:     <rng model='virtio'>
Nov 08 04:02:27 user nova-compute[75014]:       <backend model='random'>/dev/urandom</backend>
Nov 08 04:02:27 user nova-compute[75014]:       <alias name='rng0'/>
Nov 08 04:02:27 user nova-compute[75014]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 04:02:27 user nova-compute[75014]:     </rng>
Nov 08 04:02:27 user nova-compute[75014]:   </devices>
Nov 08 04:02:27 user nova-compute[75014]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 04:02:27 user nova-compute[75014]:     <label>libvirt-5c23c904-7d83-489c-bb45-04add15c2bf6</label>
Nov 08 04:02:27 user nova-compute[75014]:     <imagelabel>libvirt-5c23c904-7d83-489c-bb45-04add15c2bf6</imagelabel>
Nov 08 04:02:27 user nova-compute[75014]:   </seclabel>
Nov 08 04:02:27 user nova-compute[75014]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 04:02:27 user nova-compute[75014]:     <label>+64055:+108</label>
Nov 08 04:02:27 user nova-compute[75014]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 04:02:27 user nova-compute[75014]:   </seclabel>
Nov 08 04:02:27 user nova-compute[75014]: </domain>
Nov 08 04:02:27 user nova-compute[75014]:  {{(pid=75014) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 04:02:27 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Successfully detached device tap5a2c52cf-1f from instance 5c23c904-7d83-489c-bb45-04add15c2bf6 from the live domain config.
Nov 08 04:02:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-974517943',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-974517943',id=23,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdPXIOA7/TBoq0/votl12iKLEhI7NRfXy6j2NIlXxKNWayc0DBpjQWW2qoeBSHfSuOgOB6ZxxP+O5TEB48eK0wLHpB0ujWsQOr2xATZarqhcb9XmT1u6oZJjB9db9Gzpw==',key_name='tempest-keypair-275261075',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:59:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e1d4a398f55459aaa5526ef57b816ab',ramdisk_id='',reservation_id='r-nodg7g02',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1223504486',owner_user_name='tempest-TaggedAttachmentsTest-1223504486-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T03:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='685cdd725739412982a0d768ca78b325',uuid=5c23c904-7d83-489c-bb45-04add15c2bf6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a2c52cf-1fbe-4c48-b782-e221e1251c45", "address": "fa:16:3e:3f:dc:9e", "network": {"id": "fb818c50-19ce-4bc5-bdb5-bfdc8410c008", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-947199703", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9e1d4a398f55459aaa5526ef57b816ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2c52cf-1f", "ovs_interfaceid": "5a2c52cf-1fbe-4c48-b782-e221e1251c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:02:27 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Converting VIF {"id": "5a2c52cf-1fbe-4c48-b782-e221e1251c45", "address": "fa:16:3e:3f:dc:9e", "network": {"id": "fb818c50-19ce-4bc5-bdb5-bfdc8410c008", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-947199703", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9e1d4a398f55459aaa5526ef57b816ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2c52cf-1f", "ovs_interfaceid": "5a2c52cf-1fbe-4c48-b782-e221e1251c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:02:27 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:dc:9e,bridge_name='br-int',has_traffic_filtering=True,id=5a2c52cf-1fbe-4c48-b782-e221e1251c45,network=Network(fb818c50-19ce-4bc5-bdb5-bfdc8410c008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2c52cf-1f') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:02:27 user nova-compute[75014]: DEBUG os_vif [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:dc:9e,bridge_name='br-int',has_traffic_filtering=True,id=5a2c52cf-1fbe-4c48-b782-e221e1251c45,network=Network(fb818c50-19ce-4bc5-bdb5-bfdc8410c008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2c52cf-1f') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:02:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a2c52cf-1f, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:02:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:02:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=364abd1e-ee41-4bf1-8504-88fbf3cd48c2) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:02:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:27 user nova-compute[75014]: INFO os_vif [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:dc:9e,bridge_name='br-int',has_traffic_filtering=True,id=5a2c52cf-1fbe-4c48-b782-e221e1251c45,network=Network(fb818c50-19ce-4bc5-bdb5-bfdc8410c008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2c52cf-1f')
Nov 08 04:02:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:02:27 user nova-compute[75014]:   <nova:package version="0.0.0"/>
Nov 08 04:02:27 user nova-compute[75014]:   <nova:name>tempest-device-tagging-server-974517943</nova:name>
Nov 08 04:02:27 user nova-compute[75014]:   <nova:creationTime>2023-11-08 04:02:27</nova:creationTime>
Nov 08 04:02:27 user nova-compute[75014]:   <nova:flavor name="m1.tiny">
Nov 08 04:02:27 user nova-compute[75014]:     <nova:memory>512</nova:memory>
Nov 08 04:02:27 user nova-compute[75014]:     <nova:disk>1</nova:disk>
Nov 08 04:02:27 user nova-compute[75014]:     <nova:swap>0</nova:swap>
Nov 08 04:02:27 user nova-compute[75014]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:02:27 user nova-compute[75014]:     <nova:vcpus>1</nova:vcpus>
Nov 08 04:02:27 user nova-compute[75014]:   </nova:flavor>
Nov 08 04:02:27 user nova-compute[75014]:   <nova:owner>
Nov 08 04:02:27 user nova-compute[75014]:     <nova:user uuid="685cdd725739412982a0d768ca78b325">tempest-TaggedAttachmentsTest-1223504486-project-member</nova:user>
Nov 08 04:02:27 user nova-compute[75014]:     <nova:project uuid="9e1d4a398f55459aaa5526ef57b816ab">tempest-TaggedAttachmentsTest-1223504486</nova:project>
Nov 08 04:02:27 user nova-compute[75014]:   </nova:owner>
Nov 08 04:02:27 user nova-compute[75014]:   <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:02:27 user nova-compute[75014]:   <nova:ports>
Nov 08 04:02:27 user nova-compute[75014]:     <nova:port uuid="eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f">
Nov 08 04:02:27 user nova-compute[75014]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 04:02:27 user nova-compute[75014]:     </nova:port>
Nov 08 04:02:27 user nova-compute[75014]:   </nova:ports>
Nov 08 04:02:27 user nova-compute[75014]: </nova:instance>
Nov 08 04:02:27 user nova-compute[75014]:  {{(pid=75014) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 08 04:02:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Acquiring lock "refresh_cache-5c23c904-7d83-489c-bb45-04add15c2bf6" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:02:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Acquired lock "refresh_cache-5c23c904-7d83-489c-bb45-04add15c2bf6" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:02:28 user nova-compute[75014]: DEBUG nova.network.neutron [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:02:28 user nova-compute[75014]: DEBUG nova.compute.manager [req-9158e7da-2034-4a5d-8966-114391953a5f req-1c7f4165-fc14-432b-9fb4-df980f130b09 service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Received event network-vif-deleted-5a2c52cf-1fbe-4c48-b782-e221e1251c45 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:02:28 user nova-compute[75014]: INFO nova.compute.manager [req-9158e7da-2034-4a5d-8966-114391953a5f req-1c7f4165-fc14-432b-9fb4-df980f130b09 service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Neutron deleted interface 5a2c52cf-1fbe-4c48-b782-e221e1251c45; detaching it from the instance and deleting it from the info cache
Nov 08 04:02:28 user nova-compute[75014]: DEBUG nova.network.neutron [req-9158e7da-2034-4a5d-8966-114391953a5f req-1c7f4165-fc14-432b-9fb4-df980f130b09 service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Updating instance_info_cache with network_info: [{"id": "eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f", "address": "fa:16:3e:e1:e9:27", "network": {"id": "aec98e5a-5443-47fc-80ec-7aeaafb548c5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2062049335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e1d4a398f55459aaa5526ef57b816ab", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb7a20ed-c5", "ovs_interfaceid": "eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:02:28 user nova-compute[75014]: DEBUG nova.objects.instance [req-9158e7da-2034-4a5d-8966-114391953a5f req-1c7f4165-fc14-432b-9fb4-df980f130b09 service nova] Lazy-loading 'system_metadata' on Instance uuid 5c23c904-7d83-489c-bb45-04add15c2bf6 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:02:28 user nova-compute[75014]: DEBUG nova.objects.instance [req-9158e7da-2034-4a5d-8966-114391953a5f req-1c7f4165-fc14-432b-9fb4-df980f130b09 service nova] Lazy-loading 'flavor' on Instance uuid 5c23c904-7d83-489c-bb45-04add15c2bf6 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:02:28 user nova-compute[75014]: DEBUG nova.objects.base [req-9158e7da-2034-4a5d-8966-114391953a5f req-1c7f4165-fc14-432b-9fb4-df980f130b09 service nova] Object Instance<5c23c904-7d83-489c-bb45-04add15c2bf6> lazy-loaded attributes: system_metadata,flavor {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:02:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [req-9158e7da-2034-4a5d-8966-114391953a5f req-1c7f4165-fc14-432b-9fb4-df980f130b09 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-974517943',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-974517943',id=23,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdPXIOA7/TBoq0/votl12iKLEhI7NRfXy6j2NIlXxKNWayc0DBpjQWW2qoeBSHfSuOgOB6ZxxP+O5TEB48eK0wLHpB0ujWsQOr2xATZarqhcb9XmT1u6oZJjB9db9Gzpw==',key_name='tempest-keypair-275261075',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:59:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e1d4a398f55459aaa5526ef57b816ab',ramdisk_id='',reservation_id='r-nodg7g02',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1223504486',owner_user_name='tempest-TaggedAttachmentsTest-1223504486-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T03:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='685cdd725739412982a0d768ca78b325',uuid=5c23c904-7d83-489c-bb45-04add15c2bf6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a2c52cf-1fbe-4c48-b782-e221e1251c45", "address": "fa:16:3e:3f:dc:9e", "network": {"id": "fb818c50-19ce-4bc5-bdb5-bfdc8410c008", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-947199703", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9e1d4a398f55459aaa5526ef57b816ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2c52cf-1f", "ovs_interfaceid": "5a2c52cf-1fbe-4c48-b782-e221e1251c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:02:28 user nova-compute[75014]: DEBUG nova.network.os_vif_util [req-9158e7da-2034-4a5d-8966-114391953a5f req-1c7f4165-fc14-432b-9fb4-df980f130b09 service nova] Converting VIF {"id": "5a2c52cf-1fbe-4c48-b782-e221e1251c45", "address": "fa:16:3e:3f:dc:9e", "network": {"id": "fb818c50-19ce-4bc5-bdb5-bfdc8410c008", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-947199703", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9e1d4a398f55459aaa5526ef57b816ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2c52cf-1f", "ovs_interfaceid": "5a2c52cf-1fbe-4c48-b782-e221e1251c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:02:28 user nova-compute[75014]: DEBUG nova.network.os_vif_util [req-9158e7da-2034-4a5d-8966-114391953a5f req-1c7f4165-fc14-432b-9fb4-df980f130b09 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:dc:9e,bridge_name='br-int',has_traffic_filtering=True,id=5a2c52cf-1fbe-4c48-b782-e221e1251c45,network=Network(fb818c50-19ce-4bc5-bdb5-bfdc8410c008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2c52cf-1f') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:02:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [req-9158e7da-2034-4a5d-8966-114391953a5f req-1c7f4165-fc14-432b-9fb4-df980f130b09 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3f:dc:9e"/><model type="virtio"/><mtu size="1442"/><target dev="tap5a2c52cf-1f"/></interface> {{(pid=75014) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 04:02:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [req-9158e7da-2034-4a5d-8966-114391953a5f req-1c7f4165-fc14-432b-9fb4-df980f130b09 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:3f:dc:9e"/><model type="virtio"/><mtu size="1442"/><target dev="tap5a2c52cf-1f"/></interface>not found in domain: <domain type='kvm' id='29'>
Nov 08 04:02:28 user nova-compute[75014]:   <name>instance-00000017</name>
Nov 08 04:02:28 user nova-compute[75014]:   <uuid>5c23c904-7d83-489c-bb45-04add15c2bf6</uuid>
Nov 08 04:02:28 user nova-compute[75014]:   <metadata>
Nov 08 04:02:28 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:02:28 user nova-compute[75014]:   <nova:package version="0.0.0"/>
Nov 08 04:02:28 user nova-compute[75014]:   <nova:name>tempest-device-tagging-server-974517943</nova:name>
Nov 08 04:02:28 user nova-compute[75014]:   <nova:creationTime>2023-11-08 04:02:27</nova:creationTime>
Nov 08 04:02:28 user nova-compute[75014]:   <nova:flavor name="m1.tiny">
Nov 08 04:02:28 user nova-compute[75014]:     <nova:memory>512</nova:memory>
Nov 08 04:02:28 user nova-compute[75014]:     <nova:disk>1</nova:disk>
Nov 08 04:02:28 user nova-compute[75014]:     <nova:swap>0</nova:swap>
Nov 08 04:02:28 user nova-compute[75014]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:02:28 user nova-compute[75014]:     <nova:vcpus>1</nova:vcpus>
Nov 08 04:02:28 user nova-compute[75014]:   </nova:flavor>
Nov 08 04:02:28 user nova-compute[75014]:   <nova:owner>
Nov 08 04:02:28 user nova-compute[75014]:     <nova:user uuid="685cdd725739412982a0d768ca78b325">tempest-TaggedAttachmentsTest-1223504486-project-member</nova:user>
Nov 08 04:02:28 user nova-compute[75014]:     <nova:project uuid="9e1d4a398f55459aaa5526ef57b816ab">tempest-TaggedAttachmentsTest-1223504486</nova:project>
Nov 08 04:02:28 user nova-compute[75014]:   </nova:owner>
Nov 08 04:02:28 user nova-compute[75014]:   <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:02:28 user nova-compute[75014]:   <nova:ports>
Nov 08 04:02:28 user nova-compute[75014]:     <nova:port uuid="eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f">
Nov 08 04:02:28 user nova-compute[75014]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 04:02:28 user nova-compute[75014]:     </nova:port>
Nov 08 04:02:28 user nova-compute[75014]:   </nova:ports>
Nov 08 04:02:28 user nova-compute[75014]: </nova:instance>
Nov 08 04:02:28 user nova-compute[75014]:   </metadata>
Nov 08 04:02:28 user nova-compute[75014]:   <memory unit='KiB'>524288</memory>
Nov 08 04:02:28 user nova-compute[75014]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 04:02:28 user nova-compute[75014]:   <vcpu placement='static'>1</vcpu>
Nov 08 04:02:28 user nova-compute[75014]:   <resource>
Nov 08 04:02:28 user nova-compute[75014]:     <partition>/machine</partition>
Nov 08 04:02:28 user nova-compute[75014]:   </resource>
Nov 08 04:02:28 user nova-compute[75014]:   <sysinfo type='smbios'>
Nov 08 04:02:28 user nova-compute[75014]:     <system>
Nov 08 04:02:28 user nova-compute[75014]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 04:02:28 user nova-compute[75014]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 04:02:28 user nova-compute[75014]:       <entry name='version'>0.0.0</entry>
Nov 08 04:02:28 user nova-compute[75014]:       <entry name='serial'>5c23c904-7d83-489c-bb45-04add15c2bf6</entry>
Nov 08 04:02:28 user nova-compute[75014]:       <entry name='uuid'>5c23c904-7d83-489c-bb45-04add15c2bf6</entry>
Nov 08 04:02:28 user nova-compute[75014]:       <entry name='family'>Virtual Machine</entry>
Nov 08 04:02:28 user nova-compute[75014]:     </system>
Nov 08 04:02:28 user nova-compute[75014]:   </sysinfo>
Nov 08 04:02:28 user nova-compute[75014]:   <os>
Nov 08 04:02:28 user nova-compute[75014]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 04:02:28 user nova-compute[75014]:     <boot dev='hd'/>
Nov 08 04:02:28 user nova-compute[75014]:     <smbios mode='sysinfo'/>
Nov 08 04:02:28 user nova-compute[75014]:   </os>
Nov 08 04:02:28 user nova-compute[75014]:   <features>
Nov 08 04:02:28 user nova-compute[75014]:     <acpi/>
Nov 08 04:02:28 user nova-compute[75014]:     <apic/>
Nov 08 04:02:28 user nova-compute[75014]:     <vmcoreinfo state='on'/>
Nov 08 04:02:28 user nova-compute[75014]:   </features>
Nov 08 04:02:28 user nova-compute[75014]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 04:02:28 user nova-compute[75014]:     <model fallback='forbid'>Nehalem</model>
Nov 08 04:02:28 user nova-compute[75014]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 04:02:28 user nova-compute[75014]:     <feature policy='require' name='vme'/>
Nov 08 04:02:28 user nova-compute[75014]:     <feature policy='require' name='x2apic'/>
Nov 08 04:02:28 user nova-compute[75014]:     <feature policy='require' name='hypervisor'/>
Nov 08 04:02:28 user nova-compute[75014]:   </cpu>
Nov 08 04:02:28 user nova-compute[75014]:   <clock offset='utc'>
Nov 08 04:02:28 user nova-compute[75014]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 04:02:28 user nova-compute[75014]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 04:02:28 user nova-compute[75014]:     <timer name='hpet' present='no'/>
Nov 08 04:02:28 user nova-compute[75014]:   </clock>
Nov 08 04:02:28 user nova-compute[75014]:   <on_poweroff>destroy</on_poweroff>
Nov 08 04:02:28 user nova-compute[75014]:   <on_reboot>restart</on_reboot>
Nov 08 04:02:28 user nova-compute[75014]:   <on_crash>destroy</on_crash>
Nov 08 04:02:28 user nova-compute[75014]:   <devices>
Nov 08 04:02:28 user nova-compute[75014]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 04:02:28 user nova-compute[75014]:     <disk type='file' device='disk'>
Nov 08 04:02:28 user nova-compute[75014]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 04:02:28 user nova-compute[75014]:       <source file='/opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk' index='2'/>
Nov 08 04:02:28 user nova-compute[75014]:       <backingStore type='file' index='3'>
Nov 08 04:02:28 user nova-compute[75014]:         <format type='raw'/>
Nov 08 04:02:28 user nova-compute[75014]:         <source file='/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9'/>
Nov 08 04:02:28 user nova-compute[75014]:         <backingStore/>
Nov 08 04:02:28 user nova-compute[75014]:       </backingStore>
Nov 08 04:02:28 user nova-compute[75014]:       <target dev='vda' bus='virtio'/>
Nov 08 04:02:28 user nova-compute[75014]:       <alias name='virtio-disk0'/>
Nov 08 04:02:28 user nova-compute[75014]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 04:02:28 user nova-compute[75014]:     </disk>
Nov 08 04:02:28 user nova-compute[75014]:     <disk type='file' device='cdrom'>
Nov 08 04:02:28 user nova-compute[75014]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 04:02:28 user nova-compute[75014]:       <source file='/opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk.config' index='1'/>
Nov 08 04:02:28 user nova-compute[75014]:       <backingStore/>
Nov 08 04:02:28 user nova-compute[75014]:       <target dev='hda' bus='ide'/>
Nov 08 04:02:28 user nova-compute[75014]:       <readonly/>
Nov 08 04:02:28 user nova-compute[75014]:       <alias name='ide0-0-0'/>
Nov 08 04:02:28 user nova-compute[75014]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 04:02:28 user nova-compute[75014]:     </disk>
Nov 08 04:02:28 user nova-compute[75014]:     <controller type='usb' index='0' model='none'>
Nov 08 04:02:28 user nova-compute[75014]:       <alias name='usb'/>
Nov 08 04:02:28 user nova-compute[75014]:     </controller>
Nov 08 04:02:28 user nova-compute[75014]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 04:02:28 user nova-compute[75014]:       <alias name='pci.0'/>
Nov 08 04:02:28 user nova-compute[75014]:     </controller>
Nov 08 04:02:28 user nova-compute[75014]:     <controller type='ide' index='0'>
Nov 08 04:02:28 user nova-compute[75014]:       <alias name='ide'/>
Nov 08 04:02:28 user nova-compute[75014]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 04:02:28 user nova-compute[75014]:     </controller>
Nov 08 04:02:28 user nova-compute[75014]:     <interface type='ethernet'>
Nov 08 04:02:28 user nova-compute[75014]:       <mac address='fa:16:3e:e1:e9:27'/>
Nov 08 04:02:28 user nova-compute[75014]:       <target dev='tapeb7a20ed-c5'/>
Nov 08 04:02:28 user nova-compute[75014]:       <model type='virtio'/>
Nov 08 04:02:28 user nova-compute[75014]:       <mtu size='1442'/>
Nov 08 04:02:28 user nova-compute[75014]:       <alias name='net0'/>
Nov 08 04:02:28 user nova-compute[75014]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 04:02:28 user nova-compute[75014]:     </interface>
Nov 08 04:02:28 user nova-compute[75014]:     <serial type='pty'>
Nov 08 04:02:28 user nova-compute[75014]:       <source path='/dev/pts/12'/>
Nov 08 04:02:28 user nova-compute[75014]:       <log file='/opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/console.log' append='off'/>
Nov 08 04:02:28 user nova-compute[75014]:       <target type='isa-serial' port='0'>
Nov 08 04:02:28 user nova-compute[75014]:         <model name='isa-serial'/>
Nov 08 04:02:28 user nova-compute[75014]:       </target>
Nov 08 04:02:28 user nova-compute[75014]:       <alias name='serial0'/>
Nov 08 04:02:28 user nova-compute[75014]:     </serial>
Nov 08 04:02:28 user nova-compute[75014]:     <console type='pty' tty='/dev/pts/12'>
Nov 08 04:02:28 user nova-compute[75014]:       <source path='/dev/pts/12'/>
Nov 08 04:02:28 user nova-compute[75014]:       <log file='/opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/console.log' append='off'/>
Nov 08 04:02:28 user nova-compute[75014]:       <target type='serial' port='0'/>
Nov 08 04:02:28 user nova-compute[75014]:       <alias name='serial0'/>
Nov 08 04:02:28 user nova-compute[75014]:     </console>
Nov 08 04:02:28 user nova-compute[75014]:     <input type='mouse' bus='ps2'>
Nov 08 04:02:28 user nova-compute[75014]:       <alias name='input0'/>
Nov 08 04:02:28 user nova-compute[75014]:     </input>
Nov 08 04:02:28 user nova-compute[75014]:     <input type='keyboard' bus='ps2'>
Nov 08 04:02:28 user nova-compute[75014]:       <alias name='input1'/>
Nov 08 04:02:28 user nova-compute[75014]:     </input>
Nov 08 04:02:28 user nova-compute[75014]:     <graphics type='vnc' port='5912' autoport='yes' listen='0.0.0.0'>
Nov 08 04:02:28 user nova-compute[75014]:       <listen type='address' address='0.0.0.0'/>
Nov 08 04:02:28 user nova-compute[75014]:     </graphics>
Nov 08 04:02:28 user nova-compute[75014]:     <audio id='1' type='none'/>
Nov 08 04:02:28 user nova-compute[75014]:     <video>
Nov 08 04:02:28 user nova-compute[75014]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 04:02:28 user nova-compute[75014]:       <alias name='video0'/>
Nov 08 04:02:28 user nova-compute[75014]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 04:02:28 user nova-compute[75014]:     </video>
Nov 08 04:02:28 user nova-compute[75014]:     <memballoon model='virtio'>
Nov 08 04:02:28 user nova-compute[75014]:       <stats period='10'/>
Nov 08 04:02:28 user nova-compute[75014]:       <alias name='balloon0'/>
Nov 08 04:02:28 user nova-compute[75014]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 04:02:28 user nova-compute[75014]:     </memballoon>
Nov 08 04:02:28 user nova-compute[75014]:     <rng model='virtio'>
Nov 08 04:02:28 user nova-compute[75014]:       <backend model='random'>/dev/urandom</backend>
Nov 08 04:02:28 user nova-compute[75014]:       <alias name='rng0'/>
Nov 08 04:02:28 user nova-compute[75014]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 04:02:28 user nova-compute[75014]:     </rng>
Nov 08 04:02:28 user nova-compute[75014]:   </devices>
Nov 08 04:02:28 user nova-compute[75014]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 04:02:28 user nova-compute[75014]:     <label>libvirt-5c23c904-7d83-489c-bb45-04add15c2bf6</label>
Nov 08 04:02:28 user nova-compute[75014]:     <imagelabel>libvirt-5c23c904-7d83-489c-bb45-04add15c2bf6</imagelabel>
Nov 08 04:02:28 user nova-compute[75014]:   </seclabel>
Nov 08 04:02:28 user nova-compute[75014]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 04:02:28 user nova-compute[75014]:     <label>+64055:+108</label>
Nov 08 04:02:28 user nova-compute[75014]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 04:02:28 user nova-compute[75014]:   </seclabel>
Nov 08 04:02:28 user nova-compute[75014]: </domain>
Nov 08 04:02:28 user nova-compute[75014]:  {{(pid=75014) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 04:02:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [req-9158e7da-2034-4a5d-8966-114391953a5f req-1c7f4165-fc14-432b-9fb4-df980f130b09 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3f:dc:9e"/><model type="virtio"/><mtu size="1442"/><target dev="tap5a2c52cf-1f"/></interface> {{(pid=75014) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 04:02:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [req-9158e7da-2034-4a5d-8966-114391953a5f req-1c7f4165-fc14-432b-9fb4-df980f130b09 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:3f:dc:9e"/><model type="virtio"/><mtu size="1442"/><target dev="tap5a2c52cf-1f"/></interface>not found in domain: <domain type='kvm' id='29'>
Nov 08 04:02:28 user nova-compute[75014]:   <name>instance-00000017</name>
Nov 08 04:02:28 user nova-compute[75014]:   <uuid>5c23c904-7d83-489c-bb45-04add15c2bf6</uuid>
Nov 08 04:02:28 user nova-compute[75014]:   <metadata>
Nov 08 04:02:28 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:02:28 user nova-compute[75014]:   <nova:package version="0.0.0"/>
Nov 08 04:02:28 user nova-compute[75014]:   <nova:name>tempest-device-tagging-server-974517943</nova:name>
Nov 08 04:02:28 user nova-compute[75014]:   <nova:creationTime>2023-11-08 04:02:27</nova:creationTime>
Nov 08 04:02:28 user nova-compute[75014]:   <nova:flavor name="m1.tiny">
Nov 08 04:02:28 user nova-compute[75014]:     <nova:memory>512</nova:memory>
Nov 08 04:02:28 user nova-compute[75014]:     <nova:disk>1</nova:disk>
Nov 08 04:02:28 user nova-compute[75014]:     <nova:swap>0</nova:swap>
Nov 08 04:02:28 user nova-compute[75014]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:02:28 user nova-compute[75014]:     <nova:vcpus>1</nova:vcpus>
Nov 08 04:02:28 user nova-compute[75014]:   </nova:flavor>
Nov 08 04:02:28 user nova-compute[75014]:   <nova:owner>
Nov 08 04:02:28 user nova-compute[75014]:     <nova:user uuid="685cdd725739412982a0d768ca78b325">tempest-TaggedAttachmentsTest-1223504486-project-member</nova:user>
Nov 08 04:02:28 user nova-compute[75014]:     <nova:project uuid="9e1d4a398f55459aaa5526ef57b816ab">tempest-TaggedAttachmentsTest-1223504486</nova:project>
Nov 08 04:02:28 user nova-compute[75014]:   </nova:owner>
Nov 08 04:02:28 user nova-compute[75014]:   <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:02:28 user nova-compute[75014]:   <nova:ports>
Nov 08 04:02:28 user nova-compute[75014]:     <nova:port uuid="eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f">
Nov 08 04:02:28 user nova-compute[75014]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 04:02:28 user nova-compute[75014]:     </nova:port>
Nov 08 04:02:28 user nova-compute[75014]:   </nova:ports>
Nov 08 04:02:28 user nova-compute[75014]: </nova:instance>
Nov 08 04:02:28 user nova-compute[75014]:   </metadata>
Nov 08 04:02:28 user nova-compute[75014]:   <memory unit='KiB'>524288</memory>
Nov 08 04:02:28 user nova-compute[75014]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 04:02:28 user nova-compute[75014]:   <vcpu placement='static'>1</vcpu>
Nov 08 04:02:28 user nova-compute[75014]:   <resource>
Nov 08 04:02:28 user nova-compute[75014]:     <partition>/machine</partition>
Nov 08 04:02:28 user nova-compute[75014]:   </resource>
Nov 08 04:02:28 user nova-compute[75014]:   <sysinfo type='smbios'>
Nov 08 04:02:28 user nova-compute[75014]:     <system>
Nov 08 04:02:28 user nova-compute[75014]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 04:02:28 user nova-compute[75014]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 04:02:28 user nova-compute[75014]:       <entry name='version'>0.0.0</entry>
Nov 08 04:02:28 user nova-compute[75014]:       <entry name='serial'>5c23c904-7d83-489c-bb45-04add15c2bf6</entry>
Nov 08 04:02:28 user nova-compute[75014]:       <entry name='uuid'>5c23c904-7d83-489c-bb45-04add15c2bf6</entry>
Nov 08 04:02:28 user nova-compute[75014]:       <entry name='family'>Virtual Machine</entry>
Nov 08 04:02:28 user nova-compute[75014]:     </system>
Nov 08 04:02:28 user nova-compute[75014]:   </sysinfo>
Nov 08 04:02:28 user nova-compute[75014]:   <os>
Nov 08 04:02:28 user nova-compute[75014]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 04:02:28 user nova-compute[75014]:     <boot dev='hd'/>
Nov 08 04:02:28 user nova-compute[75014]:     <smbios mode='sysinfo'/>
Nov 08 04:02:28 user nova-compute[75014]:   </os>
Nov 08 04:02:28 user nova-compute[75014]:   <features>
Nov 08 04:02:28 user nova-compute[75014]:     <acpi/>
Nov 08 04:02:28 user nova-compute[75014]:     <apic/>
Nov 08 04:02:28 user nova-compute[75014]:     <vmcoreinfo state='on'/>
Nov 08 04:02:28 user nova-compute[75014]:   </features>
Nov 08 04:02:28 user nova-compute[75014]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 04:02:28 user nova-compute[75014]:     <model fallback='forbid'>Nehalem</model>
Nov 08 04:02:28 user nova-compute[75014]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 04:02:28 user nova-compute[75014]:     <feature policy='require' name='vme'/>
Nov 08 04:02:28 user nova-compute[75014]:     <feature policy='require' name='x2apic'/>
Nov 08 04:02:28 user nova-compute[75014]:     <feature policy='require' name='hypervisor'/>
Nov 08 04:02:28 user nova-compute[75014]:   </cpu>
Nov 08 04:02:28 user nova-compute[75014]:   <clock offset='utc'>
Nov 08 04:02:28 user nova-compute[75014]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 04:02:28 user nova-compute[75014]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 04:02:28 user nova-compute[75014]:     <timer name='hpet' present='no'/>
Nov 08 04:02:28 user nova-compute[75014]:   </clock>
Nov 08 04:02:28 user nova-compute[75014]:   <on_poweroff>destroy</on_poweroff>
Nov 08 04:02:28 user nova-compute[75014]:   <on_reboot>restart</on_reboot>
Nov 08 04:02:28 user nova-compute[75014]:   <on_crash>destroy</on_crash>
Nov 08 04:02:28 user nova-compute[75014]:   <devices>
Nov 08 04:02:28 user nova-compute[75014]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 04:02:28 user nova-compute[75014]:     <disk type='file' device='disk'>
Nov 08 04:02:28 user nova-compute[75014]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 04:02:28 user nova-compute[75014]:       <source file='/opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk' index='2'/>
Nov 08 04:02:28 user nova-compute[75014]:       <backingStore type='file' index='3'>
Nov 08 04:02:28 user nova-compute[75014]:         <format type='raw'/>
Nov 08 04:02:28 user nova-compute[75014]:         <source file='/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9'/>
Nov 08 04:02:28 user nova-compute[75014]:         <backingStore/>
Nov 08 04:02:28 user nova-compute[75014]:       </backingStore>
Nov 08 04:02:28 user nova-compute[75014]:       <target dev='vda' bus='virtio'/>
Nov 08 04:02:28 user nova-compute[75014]:       <alias name='virtio-disk0'/>
Nov 08 04:02:28 user nova-compute[75014]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 04:02:28 user nova-compute[75014]:     </disk>
Nov 08 04:02:28 user nova-compute[75014]:     <disk type='file' device='cdrom'>
Nov 08 04:02:28 user nova-compute[75014]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 04:02:28 user nova-compute[75014]:       <source file='/opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk.config' index='1'/>
Nov 08 04:02:28 user nova-compute[75014]:       <backingStore/>
Nov 08 04:02:28 user nova-compute[75014]:       <target dev='hda' bus='ide'/>
Nov 08 04:02:28 user nova-compute[75014]:       <readonly/>
Nov 08 04:02:28 user nova-compute[75014]:       <alias name='ide0-0-0'/>
Nov 08 04:02:28 user nova-compute[75014]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 04:02:28 user nova-compute[75014]:     </disk>
Nov 08 04:02:28 user nova-compute[75014]:     <controller type='usb' index='0' model='none'>
Nov 08 04:02:28 user nova-compute[75014]:       <alias name='usb'/>
Nov 08 04:02:28 user nova-compute[75014]:     </controller>
Nov 08 04:02:28 user nova-compute[75014]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 04:02:28 user nova-compute[75014]:       <alias name='pci.0'/>
Nov 08 04:02:28 user nova-compute[75014]:     </controller>
Nov 08 04:02:28 user nova-compute[75014]:     <controller type='ide' index='0'>
Nov 08 04:02:28 user nova-compute[75014]:       <alias name='ide'/>
Nov 08 04:02:28 user nova-compute[75014]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 04:02:28 user nova-compute[75014]:     </controller>
Nov 08 04:02:28 user nova-compute[75014]:     <interface type='ethernet'>
Nov 08 04:02:28 user nova-compute[75014]:       <mac address='fa:16:3e:e1:e9:27'/>
Nov 08 04:02:28 user nova-compute[75014]:       <target dev='tapeb7a20ed-c5'/>
Nov 08 04:02:28 user nova-compute[75014]:       <model type='virtio'/>
Nov 08 04:02:28 user nova-compute[75014]:       <mtu size='1442'/>
Nov 08 04:02:28 user nova-compute[75014]:       <alias name='net0'/>
Nov 08 04:02:28 user nova-compute[75014]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 04:02:28 user nova-compute[75014]:     </interface>
Nov 08 04:02:28 user nova-compute[75014]:     <serial type='pty'>
Nov 08 04:02:28 user nova-compute[75014]:       <source path='/dev/pts/12'/>
Nov 08 04:02:28 user nova-compute[75014]:       <log file='/opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/console.log' append='off'/>
Nov 08 04:02:28 user nova-compute[75014]:       <target type='isa-serial' port='0'>
Nov 08 04:02:28 user nova-compute[75014]:         <model name='isa-serial'/>
Nov 08 04:02:28 user nova-compute[75014]:       </target>
Nov 08 04:02:28 user nova-compute[75014]:       <alias name='serial0'/>
Nov 08 04:02:28 user nova-compute[75014]:     </serial>
Nov 08 04:02:28 user nova-compute[75014]:     <console type='pty' tty='/dev/pts/12'>
Nov 08 04:02:28 user nova-compute[75014]:       <source path='/dev/pts/12'/>
Nov 08 04:02:28 user nova-compute[75014]:       <log file='/opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/console.log' append='off'/>
Nov 08 04:02:28 user nova-compute[75014]:       <target type='serial' port='0'/>
Nov 08 04:02:28 user nova-compute[75014]:       <alias name='serial0'/>
Nov 08 04:02:28 user nova-compute[75014]:     </console>
Nov 08 04:02:28 user nova-compute[75014]:     <input type='mouse' bus='ps2'>
Nov 08 04:02:28 user nova-compute[75014]:       <alias name='input0'/>
Nov 08 04:02:28 user nova-compute[75014]:     </input>
Nov 08 04:02:28 user nova-compute[75014]:     <input type='keyboard' bus='ps2'>
Nov 08 04:02:28 user nova-compute[75014]:       <alias name='input1'/>
Nov 08 04:02:28 user nova-compute[75014]:     </input>
Nov 08 04:02:28 user nova-compute[75014]:     <graphics type='vnc' port='5912' autoport='yes' listen='0.0.0.0'>
Nov 08 04:02:28 user nova-compute[75014]:       <listen type='address' address='0.0.0.0'/>
Nov 08 04:02:28 user nova-compute[75014]:     </graphics>
Nov 08 04:02:28 user nova-compute[75014]:     <audio id='1' type='none'/>
Nov 08 04:02:28 user nova-compute[75014]:     <video>
Nov 08 04:02:28 user nova-compute[75014]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 04:02:28 user nova-compute[75014]:       <alias name='video0'/>
Nov 08 04:02:28 user nova-compute[75014]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 04:02:28 user nova-compute[75014]:     </video>
Nov 08 04:02:28 user nova-compute[75014]:     <memballoon model='virtio'>
Nov 08 04:02:28 user nova-compute[75014]:       <stats period='10'/>
Nov 08 04:02:28 user nova-compute[75014]:       <alias name='balloon0'/>
Nov 08 04:02:28 user nova-compute[75014]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 04:02:28 user nova-compute[75014]:     </memballoon>
Nov 08 04:02:28 user nova-compute[75014]:     <rng model='virtio'>
Nov 08 04:02:28 user nova-compute[75014]:       <backend model='random'>/dev/urandom</backend>
Nov 08 04:02:28 user nova-compute[75014]:       <alias name='rng0'/>
Nov 08 04:02:28 user nova-compute[75014]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 04:02:28 user nova-compute[75014]:     </rng>
Nov 08 04:02:28 user nova-compute[75014]:   </devices>
Nov 08 04:02:28 user nova-compute[75014]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 04:02:28 user nova-compute[75014]:     <label>libvirt-5c23c904-7d83-489c-bb45-04add15c2bf6</label>
Nov 08 04:02:28 user nova-compute[75014]:     <imagelabel>libvirt-5c23c904-7d83-489c-bb45-04add15c2bf6</imagelabel>
Nov 08 04:02:28 user nova-compute[75014]:   </seclabel>
Nov 08 04:02:28 user nova-compute[75014]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 04:02:28 user nova-compute[75014]:     <label>+64055:+108</label>
Nov 08 04:02:28 user nova-compute[75014]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 04:02:28 user nova-compute[75014]:   </seclabel>
Nov 08 04:02:28 user nova-compute[75014]: </domain>
Nov 08 04:02:28 user nova-compute[75014]:  {{(pid=75014) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 04:02:28 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [req-9158e7da-2034-4a5d-8966-114391953a5f req-1c7f4165-fc14-432b-9fb4-df980f130b09 service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Detaching interface fa:16:3e:3f:dc:9e failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap5a2c52cf-1f' not found.
Nov 08 04:02:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [req-9158e7da-2034-4a5d-8966-114391953a5f req-1c7f4165-fc14-432b-9fb4-df980f130b09 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-974517943',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-974517943',id=23,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdPXIOA7/TBoq0/votl12iKLEhI7NRfXy6j2NIlXxKNWayc0DBpjQWW2qoeBSHfSuOgOB6ZxxP+O5TEB48eK0wLHpB0ujWsQOr2xATZarqhcb9XmT1u6oZJjB9db9Gzpw==',key_name='tempest-keypair-275261075',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:59:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e1d4a398f55459aaa5526ef57b816ab',ramdisk_id='',reservation_id='r-nodg7g02',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1223504486',owner_user_name='tempest-TaggedAttachmentsTest-1223504486-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T03:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='685cdd725739412982a0d768ca78b325',uuid=5c23c904-7d83-489c-bb45-04add15c2bf6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a2c52cf-1fbe-4c48-b782-e221e1251c45", "address": "fa:16:3e:3f:dc:9e", "network": {"id": "fb818c50-19ce-4bc5-bdb5-bfdc8410c008", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-947199703", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9e1d4a398f55459aaa5526ef57b816ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2c52cf-1f", "ovs_interfaceid": "5a2c52cf-1fbe-4c48-b782-e221e1251c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:02:28 user nova-compute[75014]: DEBUG nova.network.os_vif_util [req-9158e7da-2034-4a5d-8966-114391953a5f req-1c7f4165-fc14-432b-9fb4-df980f130b09 service nova] Converting VIF {"id": "5a2c52cf-1fbe-4c48-b782-e221e1251c45", "address": "fa:16:3e:3f:dc:9e", "network": {"id": "fb818c50-19ce-4bc5-bdb5-bfdc8410c008", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-947199703", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9e1d4a398f55459aaa5526ef57b816ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2c52cf-1f", "ovs_interfaceid": "5a2c52cf-1fbe-4c48-b782-e221e1251c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:02:28 user nova-compute[75014]: DEBUG nova.network.os_vif_util [req-9158e7da-2034-4a5d-8966-114391953a5f req-1c7f4165-fc14-432b-9fb4-df980f130b09 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:dc:9e,bridge_name='br-int',has_traffic_filtering=True,id=5a2c52cf-1fbe-4c48-b782-e221e1251c45,network=Network(fb818c50-19ce-4bc5-bdb5-bfdc8410c008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2c52cf-1f') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:02:28 user nova-compute[75014]: DEBUG os_vif [req-9158e7da-2034-4a5d-8966-114391953a5f req-1c7f4165-fc14-432b-9fb4-df980f130b09 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:dc:9e,bridge_name='br-int',has_traffic_filtering=True,id=5a2c52cf-1fbe-4c48-b782-e221e1251c45,network=Network(fb818c50-19ce-4bc5-bdb5-bfdc8410c008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2c52cf-1f') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:02:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a2c52cf-1f, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:02:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:02:28 user nova-compute[75014]: INFO os_vif [req-9158e7da-2034-4a5d-8966-114391953a5f req-1c7f4165-fc14-432b-9fb4-df980f130b09 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:dc:9e,bridge_name='br-int',has_traffic_filtering=True,id=5a2c52cf-1fbe-4c48-b782-e221e1251c45,network=Network(fb818c50-19ce-4bc5-bdb5-bfdc8410c008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2c52cf-1f')
Nov 08 04:02:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [req-9158e7da-2034-4a5d-8966-114391953a5f req-1c7f4165-fc14-432b-9fb4-df980f130b09 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:02:28 user nova-compute[75014]:   <nova:package version="0.0.0"/>
Nov 08 04:02:28 user nova-compute[75014]:   <nova:name>tempest-device-tagging-server-974517943</nova:name>
Nov 08 04:02:28 user nova-compute[75014]:   <nova:creationTime>2023-11-08 04:02:28</nova:creationTime>
Nov 08 04:02:28 user nova-compute[75014]:   <nova:flavor name="m1.tiny">
Nov 08 04:02:28 user nova-compute[75014]:     <nova:memory>512</nova:memory>
Nov 08 04:02:28 user nova-compute[75014]:     <nova:disk>1</nova:disk>
Nov 08 04:02:28 user nova-compute[75014]:     <nova:swap>0</nova:swap>
Nov 08 04:02:28 user nova-compute[75014]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:02:28 user nova-compute[75014]:     <nova:vcpus>1</nova:vcpus>
Nov 08 04:02:28 user nova-compute[75014]:   </nova:flavor>
Nov 08 04:02:28 user nova-compute[75014]:   <nova:owner>
Nov 08 04:02:28 user nova-compute[75014]:     <nova:user uuid="685cdd725739412982a0d768ca78b325">tempest-TaggedAttachmentsTest-1223504486-project-member</nova:user>
Nov 08 04:02:28 user nova-compute[75014]:     <nova:project uuid="9e1d4a398f55459aaa5526ef57b816ab">tempest-TaggedAttachmentsTest-1223504486</nova:project>
Nov 08 04:02:28 user nova-compute[75014]:   </nova:owner>
Nov 08 04:02:28 user nova-compute[75014]:   <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:02:28 user nova-compute[75014]:   <nova:ports>
Nov 08 04:02:28 user nova-compute[75014]:     <nova:port uuid="eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f">
Nov 08 04:02:28 user nova-compute[75014]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 04:02:28 user nova-compute[75014]:     </nova:port>
Nov 08 04:02:28 user nova-compute[75014]:   </nova:ports>
Nov 08 04:02:28 user nova-compute[75014]: </nova:instance>
Nov 08 04:02:28 user nova-compute[75014]:  {{(pid=75014) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 08 04:02:28 user nova-compute[75014]: INFO nova.network.neutron [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Port 5a2c52cf-1fbe-4c48-b782-e221e1251c45 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 08 04:02:28 user nova-compute[75014]: DEBUG nova.network.neutron [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Updating instance_info_cache with network_info: [{"id": "eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f", "address": "fa:16:3e:e1:e9:27", "network": {"id": "aec98e5a-5443-47fc-80ec-7aeaafb548c5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2062049335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e1d4a398f55459aaa5526ef57b816ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb7a20ed-c5", "ovs_interfaceid": "eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:02:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Releasing lock "refresh_cache-5c23c904-7d83-489c-bb45-04add15c2bf6" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:02:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1fa87336-c038-44cb-a54a-850d0bba92c2 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lock "interface-5c23c904-7d83-489c-bb45-04add15c2bf6-5a2c52cf-1fbe-4c48-b782-e221e1251c45" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.583s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:31 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:02:31 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:02:31 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:02:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "0b3b62d9-2543-402b-bdb5-cac994b755c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "0b3b62d9-2543-402b-bdb5-cac994b755c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:32 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:02:32 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:02:32 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 04:02:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-5bfa6580-e0fe-46b0-b497-8db67806113a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:02:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-5bfa6580-e0fe-46b0-b497-8db67806113a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:02:32 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 04:02:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 04:02:32 user nova-compute[75014]: INFO nova.compute.claims [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Claim successful on node user
Nov 08 04:02:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:32 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Updating instance_info_cache with network_info: [{"id": "3f08242a-d68d-4744-8b4c-49bdc29ea557", "address": "fa:16:3e:65:f5:c2", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f08242a-d6", "ovs_interfaceid": "3f08242a-d68d-4744-8b4c-49bdc29ea557", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:02:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-5bfa6580-e0fe-46b0-b497-8db67806113a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:02:32 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 04:02:32 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:02:32 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:02:32 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:02:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.579s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:33 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 04:02:33 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 04:02:33 user nova-compute[75014]: DEBUG nova.network.neutron [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 04:02:33 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 04:02:33 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 04:02:33 user nova-compute[75014]: INFO nova.virt.block_device [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Booting with volume-backed-image 877f8699-2084-427a-babd-cf4f98c3b417 at /dev/vda
Nov 08 04:02:33 user nova-compute[75014]: DEBUG nova.policy [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '630b9ba8f1d9471f9cea51f74106381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92a182cdeb8543fea1ab24326734991e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 04:02:33 user nova-compute[75014]: DEBUG nova.network.neutron [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Successfully created port: 4b006ecf-b195-4491-8ba7-7109ae8701df {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 04:02:33 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:02:34 user nova-compute[75014]: DEBUG nova.network.neutron [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Successfully updated port: 4b006ecf-b195-4491-8ba7-7109ae8701df {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 04:02:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "refresh_cache-0b3b62d9-2543-402b-bdb5-cac994b755c9" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:02:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquired lock "refresh_cache-0b3b62d9-2543-402b-bdb5-cac994b755c9" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:02:34 user nova-compute[75014]: DEBUG nova.network.neutron [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:02:34 user nova-compute[75014]: DEBUG nova.compute.manager [req-88ba87c8-e7c9-416c-854b-77a8088f32f1 req-bd60c2cc-766f-490d-87df-de229036a983 service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Received event network-changed-4b006ecf-b195-4491-8ba7-7109ae8701df {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:02:34 user nova-compute[75014]: DEBUG nova.compute.manager [req-88ba87c8-e7c9-416c-854b-77a8088f32f1 req-bd60c2cc-766f-490d-87df-de229036a983 service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Refreshing instance network info cache due to event network-changed-4b006ecf-b195-4491-8ba7-7109ae8701df. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:02:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-88ba87c8-e7c9-416c-854b-77a8088f32f1 req-bd60c2cc-766f-490d-87df-de229036a983 service nova] Acquiring lock "refresh_cache-0b3b62d9-2543-402b-bdb5-cac994b755c9" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:02:34 user nova-compute[75014]: DEBUG nova.network.neutron [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 04:02:34 user nova-compute[75014]: DEBUG nova.network.neutron [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Updating instance_info_cache with network_info: [{"id": "4b006ecf-b195-4491-8ba7-7109ae8701df", "address": "fa:16:3e:c5:3a:a9", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b006ecf-b1", "ovs_interfaceid": "4b006ecf-b195-4491-8ba7-7109ae8701df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:02:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Releasing lock "refresh_cache-0b3b62d9-2543-402b-bdb5-cac994b755c9" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:02:34 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Instance network_info: |[{"id": "4b006ecf-b195-4491-8ba7-7109ae8701df", "address": "fa:16:3e:c5:3a:a9", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b006ecf-b1", "ovs_interfaceid": "4b006ecf-b195-4491-8ba7-7109ae8701df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 04:02:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-88ba87c8-e7c9-416c-854b-77a8088f32f1 req-bd60c2cc-766f-490d-87df-de229036a983 service nova] Acquired lock "refresh_cache-0b3b62d9-2543-402b-bdb5-cac994b755c9" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:02:34 user nova-compute[75014]: DEBUG nova.network.neutron [req-88ba87c8-e7c9-416c-854b-77a8088f32f1 req-bd60c2cc-766f-490d-87df-de229036a983 service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Refreshing network info cache for port 4b006ecf-b195-4491-8ba7-7109ae8701df {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:02:35 user nova-compute[75014]: DEBUG nova.network.neutron [req-88ba87c8-e7c9-416c-854b-77a8088f32f1 req-bd60c2cc-766f-490d-87df-de229036a983 service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Updated VIF entry in instance network info cache for port 4b006ecf-b195-4491-8ba7-7109ae8701df. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:02:35 user nova-compute[75014]: DEBUG nova.network.neutron [req-88ba87c8-e7c9-416c-854b-77a8088f32f1 req-bd60c2cc-766f-490d-87df-de229036a983 service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Updating instance_info_cache with network_info: [{"id": "4b006ecf-b195-4491-8ba7-7109ae8701df", "address": "fa:16:3e:c5:3a:a9", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b006ecf-b1", "ovs_interfaceid": "4b006ecf-b195-4491-8ba7-7109ae8701df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:02:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-88ba87c8-e7c9-416c-854b-77a8088f32f1 req-bd60c2cc-766f-490d-87df-de229036a983 service nova] Releasing lock "refresh_cache-0b3b62d9-2543-402b-bdb5-cac994b755c9" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:02:35 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:02:35 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:02:35 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:02:35 user nova-compute[75014]: INFO nova.compute.manager [None req-75cd9433-a380-4cb5-8169-b50834cbc57c tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Unrescuing
Nov 08 04:02:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-75cd9433-a380-4cb5-8169-b50834cbc57c tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Acquiring lock "refresh_cache-bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:02:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-75cd9433-a380-4cb5-8169-b50834cbc57c tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Acquired lock "refresh_cache-bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:02:35 user nova-compute[75014]: DEBUG nova.network.neutron [None req-75cd9433-a380-4cb5-8169-b50834cbc57c tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:02:36 user nova-compute[75014]: DEBUG nova.compute.manager [req-5c9b70fd-5cdd-4e7d-b315-fef470bf75e3 req-41471a88-f7e5-4aea-b53c-a213cfe9320a service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Received event network-changed-2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:02:36 user nova-compute[75014]: DEBUG nova.compute.manager [req-5c9b70fd-5cdd-4e7d-b315-fef470bf75e3 req-41471a88-f7e5-4aea-b53c-a213cfe9320a service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Refreshing instance network info cache due to event network-changed-2d19a877-95a3-4cc5-b98f-c5a097a01304. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:02:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5c9b70fd-5cdd-4e7d-b315-fef470bf75e3 req-41471a88-f7e5-4aea-b53c-a213cfe9320a service nova] Acquiring lock "refresh_cache-bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:02:36 user nova-compute[75014]: DEBUG nova.network.neutron [None req-75cd9433-a380-4cb5-8169-b50834cbc57c tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Updating instance_info_cache with network_info: [{"id": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "address": "fa:16:3e:d8:7a:3e", "network": {"id": "64afeb98-3d7d-4d85-a8ac-2deff17e7463", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-737690621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05de04b5317b4257b434019a2db27f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d19a877-95", "ovs_interfaceid": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:02:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-75cd9433-a380-4cb5-8169-b50834cbc57c tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Releasing lock "refresh_cache-bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:02:36 user nova-compute[75014]: DEBUG nova.objects.instance [None req-75cd9433-a380-4cb5-8169-b50834cbc57c tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lazy-loading 'flavor' on Instance uuid bd153f84-98cd-4c6d-a7ab-5759b0b5bf55 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:02:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5c9b70fd-5cdd-4e7d-b315-fef470bf75e3 req-41471a88-f7e5-4aea-b53c-a213cfe9320a service nova] Acquired lock "refresh_cache-bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:02:36 user nova-compute[75014]: DEBUG nova.network.neutron [req-5c9b70fd-5cdd-4e7d-b315-fef470bf75e3 req-41471a88-f7e5-4aea-b53c-a213cfe9320a service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Refreshing network info cache for port 2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:02:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:37 user nova-compute[75014]: DEBUG nova.network.neutron [req-5c9b70fd-5cdd-4e7d-b315-fef470bf75e3 req-41471a88-f7e5-4aea-b53c-a213cfe9320a service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Updated VIF entry in instance network info cache for port 2d19a877-95a3-4cc5-b98f-c5a097a01304. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:02:37 user nova-compute[75014]: DEBUG nova.network.neutron [req-5c9b70fd-5cdd-4e7d-b315-fef470bf75e3 req-41471a88-f7e5-4aea-b53c-a213cfe9320a service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Updating instance_info_cache with network_info: [{"id": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "address": "fa:16:3e:d8:7a:3e", "network": {"id": "64afeb98-3d7d-4d85-a8ac-2deff17e7463", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-737690621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05de04b5317b4257b434019a2db27f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d19a877-95", "ovs_interfaceid": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:02:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5c9b70fd-5cdd-4e7d-b315-fef470bf75e3 req-41471a88-f7e5-4aea-b53c-a213cfe9320a service nova] Releasing lock "refresh_cache-bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:02:37 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Instance destroyed successfully.
Nov 08 04:02:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:38 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:02:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:38 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:02:38 user nova-compute[75014]: DEBUG nova.compute.manager [req-577170f6-8d47-49ad-93c7-3d60027756c8 req-75cce9c7-6bbc-4e14-9260-9e444b658800 service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Received event network-changed-2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:02:38 user nova-compute[75014]: DEBUG nova.compute.manager [req-577170f6-8d47-49ad-93c7-3d60027756c8 req-75cce9c7-6bbc-4e14-9260-9e444b658800 service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Refreshing instance network info cache due to event network-changed-2d19a877-95a3-4cc5-b98f-c5a097a01304. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:02:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-577170f6-8d47-49ad-93c7-3d60027756c8 req-75cce9c7-6bbc-4e14-9260-9e444b658800 service nova] Acquiring lock "refresh_cache-bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:02:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-577170f6-8d47-49ad-93c7-3d60027756c8 req-75cce9c7-6bbc-4e14-9260-9e444b658800 service nova] Acquired lock "refresh_cache-bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:02:38 user nova-compute[75014]: DEBUG nova.network.neutron [req-577170f6-8d47-49ad-93c7-3d60027756c8 req-75cce9c7-6bbc-4e14-9260-9e444b658800 service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Refreshing network info cache for port 2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:02:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:39 user nova-compute[75014]: DEBUG nova.network.neutron [req-577170f6-8d47-49ad-93c7-3d60027756c8 req-75cce9c7-6bbc-4e14-9260-9e444b658800 service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Updated VIF entry in instance network info cache for port 2d19a877-95a3-4cc5-b98f-c5a097a01304. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:02:39 user nova-compute[75014]: DEBUG nova.network.neutron [req-577170f6-8d47-49ad-93c7-3d60027756c8 req-75cce9c7-6bbc-4e14-9260-9e444b658800 service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Updating instance_info_cache with network_info: [{"id": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "address": "fa:16:3e:d8:7a:3e", "network": {"id": "64afeb98-3d7d-4d85-a8ac-2deff17e7463", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-737690621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05de04b5317b4257b434019a2db27f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d19a877-95", "ovs_interfaceid": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:02:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-577170f6-8d47-49ad-93c7-3d60027756c8 req-75cce9c7-6bbc-4e14-9260-9e444b658800 service nova] Releasing lock "refresh_cache-bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:02:39 user nova-compute[75014]: DEBUG nova.compute.manager [req-577170f6-8d47-49ad-93c7-3d60027756c8 req-75cce9c7-6bbc-4e14-9260-9e444b658800 service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Received event network-vif-unplugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:02:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-577170f6-8d47-49ad-93c7-3d60027756c8 req-75cce9c7-6bbc-4e14-9260-9e444b658800 service nova] Acquiring lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-577170f6-8d47-49ad-93c7-3d60027756c8 req-75cce9c7-6bbc-4e14-9260-9e444b658800 service nova] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-577170f6-8d47-49ad-93c7-3d60027756c8 req-75cce9c7-6bbc-4e14-9260-9e444b658800 service nova] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:39 user nova-compute[75014]: DEBUG nova.compute.manager [req-577170f6-8d47-49ad-93c7-3d60027756c8 req-75cce9c7-6bbc-4e14-9260-9e444b658800 service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] No waiting events found dispatching network-vif-unplugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:02:39 user nova-compute[75014]: WARNING nova.compute.manager [req-577170f6-8d47-49ad-93c7-3d60027756c8 req-75cce9c7-6bbc-4e14-9260-9e444b658800 service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Received unexpected event network-vif-unplugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 for instance with vm_state rescued and task_state unrescuing.
Nov 08 04:02:39 user nova-compute[75014]: DEBUG nova.compute.manager [req-577170f6-8d47-49ad-93c7-3d60027756c8 req-75cce9c7-6bbc-4e14-9260-9e444b658800 service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Received event network-vif-plugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:02:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-577170f6-8d47-49ad-93c7-3d60027756c8 req-75cce9c7-6bbc-4e14-9260-9e444b658800 service nova] Acquiring lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-577170f6-8d47-49ad-93c7-3d60027756c8 req-75cce9c7-6bbc-4e14-9260-9e444b658800 service nova] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-577170f6-8d47-49ad-93c7-3d60027756c8 req-75cce9c7-6bbc-4e14-9260-9e444b658800 service nova] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:39 user nova-compute[75014]: DEBUG nova.compute.manager [req-577170f6-8d47-49ad-93c7-3d60027756c8 req-75cce9c7-6bbc-4e14-9260-9e444b658800 service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] No waiting events found dispatching network-vif-plugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:02:39 user nova-compute[75014]: WARNING nova.compute.manager [req-577170f6-8d47-49ad-93c7-3d60027756c8 req-75cce9c7-6bbc-4e14-9260-9e444b658800 service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Received unexpected event network-vif-plugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 for instance with vm_state rescued and task_state unrescuing.
Nov 08 04:02:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:02:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:02:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:40 user nova-compute[75014]: DEBUG nova.compute.manager [req-93ea9e39-f0b2-4ef2-9990-ba962a17f323 req-803b1452-090f-4a0f-ba67-a278b931ab5a service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Received event network-vif-plugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:02:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-93ea9e39-f0b2-4ef2-9990-ba962a17f323 req-803b1452-090f-4a0f-ba67-a278b931ab5a service nova] Acquiring lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-93ea9e39-f0b2-4ef2-9990-ba962a17f323 req-803b1452-090f-4a0f-ba67-a278b931ab5a service nova] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-93ea9e39-f0b2-4ef2-9990-ba962a17f323 req-803b1452-090f-4a0f-ba67-a278b931ab5a service nova] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:40 user nova-compute[75014]: DEBUG nova.compute.manager [req-93ea9e39-f0b2-4ef2-9990-ba962a17f323 req-803b1452-090f-4a0f-ba67-a278b931ab5a service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] No waiting events found dispatching network-vif-plugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:02:40 user nova-compute[75014]: WARNING nova.compute.manager [req-93ea9e39-f0b2-4ef2-9990-ba962a17f323 req-803b1452-090f-4a0f-ba67-a278b931ab5a service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Received unexpected event network-vif-plugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 for instance with vm_state rescued and task_state unrescuing.
Nov 08 04:02:40 user nova-compute[75014]: DEBUG nova.compute.manager [req-93ea9e39-f0b2-4ef2-9990-ba962a17f323 req-803b1452-090f-4a0f-ba67-a278b931ab5a service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Received event network-vif-plugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:02:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-93ea9e39-f0b2-4ef2-9990-ba962a17f323 req-803b1452-090f-4a0f-ba67-a278b931ab5a service nova] Acquiring lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-93ea9e39-f0b2-4ef2-9990-ba962a17f323 req-803b1452-090f-4a0f-ba67-a278b931ab5a service nova] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-93ea9e39-f0b2-4ef2-9990-ba962a17f323 req-803b1452-090f-4a0f-ba67-a278b931ab5a service nova] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:40 user nova-compute[75014]: DEBUG nova.compute.manager [req-93ea9e39-f0b2-4ef2-9990-ba962a17f323 req-803b1452-090f-4a0f-ba67-a278b931ab5a service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] No waiting events found dispatching network-vif-plugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:02:40 user nova-compute[75014]: WARNING nova.compute.manager [req-93ea9e39-f0b2-4ef2-9990-ba962a17f323 req-803b1452-090f-4a0f-ba67-a278b931ab5a service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Received unexpected event network-vif-plugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 for instance with vm_state rescued and task_state unrescuing.
Nov 08 04:02:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:41 user nova-compute[75014]: DEBUG nova.compute.manager [None req-75cd9433-a380-4cb5-8169-b50834cbc57c tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:02:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:02:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:02:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:02:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:44 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:02:44 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:02:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=7340MB free_disk=24.678905487060547GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:02:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9f205fe5-576f-4ef0-874b-1544c0307a7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:02:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 5bfa6580-e0fe-46b0-b497-8db67806113a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:02:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 8527ee40-fb8a-469b-9696-d7bde8cc96f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:02:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 655fe5eb-1271-4b9f-a5a6-6342bd012a69 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:02:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance bd153f84-98cd-4c6d-a7ab-5759b0b5bf55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:02:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 691bf2a3-13b2-466c-90a3-8dd01dfc18cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:02:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:02:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance d4726cd1-51ea-41e2-ad36-be12b4d4c26b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:02:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 44d4794d-91c4-4eb6-a752-37f587f2b420 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:02:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 5c23c904-7d83-489c-bb45-04add15c2bf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:02:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance d555b6b3-86ec-40ae-aa20-48846b5157d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:02:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance c23c9e00-b782-4530-bb01-a7a167951c1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:02:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 79dea88d-f5cd-4e8b-a98b-01af128f35ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:02:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 0b3b62d9-2543-402b-bdb5-cac994b755c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:02:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:02:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:02:45 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:02:45 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:02:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:02:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.665s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "691bf2a3-13b2-466c-90a3-8dd01dfc18cb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "691bf2a3-13b2-466c-90a3-8dd01dfc18cb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:53 user nova-compute[75014]: INFO nova.compute.manager [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Detaching volume 6473b6b6-2ad6-4da7-9799-a570400bdc37
Nov 08 04:02:53 user nova-compute[75014]: INFO nova.virt.block_device [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Attempting to driver detach volume 6473b6b6-2ad6-4da7-9799-a570400bdc37 from mountpoint /dev/vdb
Nov 08 04:02:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Attempting to detach device vdb from instance 691bf2a3-13b2-466c-90a3-8dd01dfc18cb from the persistent domain config. {{(pid=75014) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 04:02:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:02:53 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:02:53 user nova-compute[75014]:   <source dev="/dev/sdd"/>
Nov 08 04:02:53 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:02:53 user nova-compute[75014]:   <serial>6473b6b6-2ad6-4da7-9799-a570400bdc37</serial>
Nov 08 04:02:53 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:02:53 user nova-compute[75014]: </disk>
Nov 08 04:02:53 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:02:53 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Successfully detached device vdb from instance 691bf2a3-13b2-466c-90a3-8dd01dfc18cb from the persistent domain config.
Nov 08 04:02:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 691bf2a3-13b2-466c-90a3-8dd01dfc18cb from the live domain config. {{(pid=75014) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 04:02:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:02:53 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:02:53 user nova-compute[75014]:   <source dev="/dev/sdd"/>
Nov 08 04:02:53 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:02:53 user nova-compute[75014]:   <serial>6473b6b6-2ad6-4da7-9799-a570400bdc37</serial>
Nov 08 04:02:53 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:02:53 user nova-compute[75014]: </disk>
Nov 08 04:02:53 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:02:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 691bf2a3-13b2-466c-90a3-8dd01dfc18cb {{(pid=75014) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 04:02:53 user nova-compute[75014]: DEBUG os_brick.utils [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:02:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:53 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a647da-c3a1-4c42-b2ab-95ae2b93c6ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:53 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0c2114-e388-4724-b760-aca83cb2a27e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:53 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e573a52f-9294-4ef7-a23c-569c5449a2ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:53 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1191abe-9eb9-40d7-a923-10407038c680]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:02:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:02:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:02:54 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:02:54 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d93f8fc-94ba-4f9b-b2bc-5766c71e3265]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:02:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:02:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:02:54 user nova-compute[75014]: DEBUG os_brick.utils [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:02:54 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Updating existing volume attachment record: b6d1a664-93ce-42ff-9fea-2cd63d656d01 {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:02:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG nova.objects.instance [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lazy-loading 'flavor' on Instance uuid 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9e064b35-ff88-4061-85b3-aefc61a27c36 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Acquiring lock "5c23c904-7d83-489c-bb45-04add15c2bf6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9e064b35-ff88-4061-85b3-aefc61a27c36 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lock "5c23c904-7d83-489c-bb45-04add15c2bf6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9e064b35-ff88-4061-85b3-aefc61a27c36 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Acquiring lock "5c23c904-7d83-489c-bb45-04add15c2bf6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9e064b35-ff88-4061-85b3-aefc61a27c36 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lock "5c23c904-7d83-489c-bb45-04add15c2bf6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9e064b35-ff88-4061-85b3-aefc61a27c36 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lock "5c23c904-7d83-489c-bb45-04add15c2bf6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:58 user nova-compute[75014]: INFO nova.compute.manager [None req-9e064b35-ff88-4061-85b3-aefc61a27c36 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Terminating instance
Nov 08 04:02:58 user nova-compute[75014]: DEBUG nova.compute.manager [None req-9e064b35-ff88-4061-85b3-aefc61a27c36 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:58 user nova-compute[75014]: INFO nova.compute.manager [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Attaching volume 2a5a439f-c079-4ac4-b663-ee809d0cfec8 to /dev/vdb
Nov 08 04:02:58 user nova-compute[75014]: DEBUG os_brick.utils [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e517d6d7-337d-4f8f-b7d4-72729f218177]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6cd774-08ce-4eee-ac30-f574a4464be5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[413d3739-b5ad-4886-bdf1-e804000cbfcf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1759ae0d-8297-48d3-8910-f28da367828d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:02:58 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:02:58 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[035b4d11-afcd-49ed-94fc-ec17d40db94b]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG os_brick.utils [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Updating existing volume attachment record: 14fedab6-521b-41b5-90f5-8bb63c1059d2 {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG nova.compute.manager [req-44287bb2-c431-4507-a97a-5cfc04958760 req-42b7737b-b76e-4c8e-b84e-ec97aff9befa service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Received event network-vif-unplugged-eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-44287bb2-c431-4507-a97a-5cfc04958760 req-42b7737b-b76e-4c8e-b84e-ec97aff9befa service nova] Acquiring lock "5c23c904-7d83-489c-bb45-04add15c2bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-44287bb2-c431-4507-a97a-5cfc04958760 req-42b7737b-b76e-4c8e-b84e-ec97aff9befa service nova] Lock "5c23c904-7d83-489c-bb45-04add15c2bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-44287bb2-c431-4507-a97a-5cfc04958760 req-42b7737b-b76e-4c8e-b84e-ec97aff9befa service nova] Lock "5c23c904-7d83-489c-bb45-04add15c2bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG nova.compute.manager [req-44287bb2-c431-4507-a97a-5cfc04958760 req-42b7737b-b76e-4c8e-b84e-ec97aff9befa service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] No waiting events found dispatching network-vif-unplugged-eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG nova.compute.manager [req-44287bb2-c431-4507-a97a-5cfc04958760 req-42b7737b-b76e-4c8e-b84e-ec97aff9befa service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Received event network-vif-unplugged-eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:02:58 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Instance destroyed successfully.
Nov 08 04:02:58 user nova-compute[75014]: DEBUG nova.objects.instance [None req-9e064b35-ff88-4061-85b3-aefc61a27c36 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lazy-loading 'resources' on Instance uuid 5c23c904-7d83-489c-bb45-04add15c2bf6 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-9e064b35-ff88-4061-85b3-aefc61a27c36 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T03:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-974517943',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-974517943',id=23,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdPXIOA7/TBoq0/votl12iKLEhI7NRfXy6j2NIlXxKNWayc0DBpjQWW2qoeBSHfSuOgOB6ZxxP+O5TEB48eK0wLHpB0ujWsQOr2xATZarqhcb9XmT1u6oZJjB9db9Gzpw==',key_name='tempest-keypair-275261075',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:59:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e1d4a398f55459aaa5526ef57b816ab',ramdisk_id='',reservation_id='r-nodg7g02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1223504486',owner_user_name='tempest-TaggedAttachmentsTest-1223504486-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T03:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='685cdd725739412982a0d768ca78b325',uuid=5c23c904-7d83-489c-bb45-04add15c2bf6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f", "address": "fa:16:3e:e1:e9:27", "network": {"id": "aec98e5a-5443-47fc-80ec-7aeaafb548c5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2062049335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e1d4a398f55459aaa5526ef57b816ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb7a20ed-c5", "ovs_interfaceid": "eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-9e064b35-ff88-4061-85b3-aefc61a27c36 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Converting VIF {"id": "eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f", "address": "fa:16:3e:e1:e9:27", "network": {"id": "aec98e5a-5443-47fc-80ec-7aeaafb548c5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2062049335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e1d4a398f55459aaa5526ef57b816ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb7a20ed-c5", "ovs_interfaceid": "eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-9e064b35-ff88-4061-85b3-aefc61a27c36 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:e9:27,bridge_name='br-int',has_traffic_filtering=True,id=eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f,network=Network(aec98e5a-5443-47fc-80ec-7aeaafb548c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb7a20ed-c5') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG os_vif [None req-9e064b35-ff88-4061-85b3-aefc61a27c36 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:e9:27,bridge_name='br-int',has_traffic_filtering=True,id=eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f,network=Network(aec98e5a-5443-47fc-80ec-7aeaafb548c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb7a20ed-c5') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb7a20ed-c5, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=516af1a5-c0c4-425a-a073-53e656cdf733) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:58 user nova-compute[75014]: INFO os_vif [None req-9e064b35-ff88-4061-85b3-aefc61a27c36 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:e9:27,bridge_name='br-int',has_traffic_filtering=True,id=eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f,network=Network(aec98e5a-5443-47fc-80ec-7aeaafb548c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb7a20ed-c5')
Nov 08 04:02:58 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-9e064b35-ff88-4061-85b3-aefc61a27c36 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Deleting instance files /opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6_del
Nov 08 04:02:58 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-9e064b35-ff88-4061-85b3-aefc61a27c36 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Deletion of /opt/stack/data/nova/instances/5c23c904-7d83-489c-bb45-04add15c2bf6_del complete
Nov 08 04:02:58 user nova-compute[75014]: INFO nova.compute.manager [None req-9e064b35-ff88-4061-85b3-aefc61a27c36 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 08 04:02:58 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-9e064b35-ff88-4061-85b3-aefc61a27c36 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:02:58 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:02:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:02:59 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:02:59 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Took 0.84 seconds to deallocate network for instance.
Nov 08 04:02:59 user nova-compute[75014]: DEBUG nova.compute.manager [req-f72a84d9-1336-42f6-946d-bf621b429c18 req-0601a838-3406-4550-ac15-b15e54ae4eba service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Received event network-vif-deleted-eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:02:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9e064b35-ff88-4061-85b3-aefc61a27c36 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:02:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9e064b35-ff88-4061-85b3-aefc61a27c36 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:03:00 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-9e064b35-ff88-4061-85b3-aefc61a27c36 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:03:00 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-9e064b35-ff88-4061-85b3-aefc61a27c36 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:03:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9e064b35-ff88-4061-85b3-aefc61a27c36 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.450s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:03:00 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-9e064b35-ff88-4061-85b3-aefc61a27c36 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Deleted allocations for instance 5c23c904-7d83-489c-bb45-04add15c2bf6
Nov 08 04:03:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9e064b35-ff88-4061-85b3-aefc61a27c36 tempest-TaggedAttachmentsTest-1223504486 tempest-TaggedAttachmentsTest-1223504486-project-member] Lock "5c23c904-7d83-489c-bb45-04add15c2bf6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.383s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:03:00 user nova-compute[75014]: DEBUG nova.compute.manager [req-207d115f-5092-4e82-b095-439bf30d4965 req-c28a2f3f-c61c-44f8-856a-e276cbccd058 service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Received event network-vif-plugged-eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:03:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-207d115f-5092-4e82-b095-439bf30d4965 req-c28a2f3f-c61c-44f8-856a-e276cbccd058 service nova] Acquiring lock "5c23c904-7d83-489c-bb45-04add15c2bf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:03:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-207d115f-5092-4e82-b095-439bf30d4965 req-c28a2f3f-c61c-44f8-856a-e276cbccd058 service nova] Lock "5c23c904-7d83-489c-bb45-04add15c2bf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:03:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-207d115f-5092-4e82-b095-439bf30d4965 req-c28a2f3f-c61c-44f8-856a-e276cbccd058 service nova] Lock "5c23c904-7d83-489c-bb45-04add15c2bf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:03:00 user nova-compute[75014]: DEBUG nova.compute.manager [req-207d115f-5092-4e82-b095-439bf30d4965 req-c28a2f3f-c61c-44f8-856a-e276cbccd058 service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] No waiting events found dispatching network-vif-plugged-eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:03:00 user nova-compute[75014]: WARNING nova.compute.manager [req-207d115f-5092-4e82-b095-439bf30d4965 req-c28a2f3f-c61c-44f8-856a-e276cbccd058 service nova] [instance: 5c23c904-7d83-489c-bb45-04add15c2bf6] Received unexpected event network-vif-plugged-eb7a20ed-c565-4f5e-86b1-f77a32ea7c9f for instance with vm_state deleted and task_state None.
Nov 08 04:03:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:13 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 691bf2a3-13b2-466c-90a3-8dd01dfc18cb is timed out.
Nov 08 04:03:13 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Successfully detached device vdb from instance 691bf2a3-13b2-466c-90a3-8dd01dfc18cb from the live domain config.
Nov 08 04:03:13 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:03:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZIzTkPtd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:03:13 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:03:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:03:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:03:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d836944-b66f-4905-9589-7fd58172d868]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:03:13 user nova-compute[75014]: No targets found.
Nov 08 04:03:13 user nova-compute[75014]: iSNS:
Nov 08 04:03:13 user nova-compute[75014]: No targets found.
Nov 08 04:03:13 user nova-compute[75014]: STATIC:
Nov 08 04:03:13 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908
Nov 08 04:03:13 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:03:13 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:03:13 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec
Nov 08 04:03:13 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:03:13 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:03:13 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:03:13 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:03:13 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:03:13 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a
Nov 08 04:03:13 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:03:13 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:03:13 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37
Nov 08 04:03:13 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:03:13 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:03:13 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b
Nov 08 04:03:13 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:03:13 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:03:13 user nova-compute[75014]: FIRMWARE:
Nov 08 04:03:13 user nova-compute[75014]: No targets found.
Nov 08 04:03:13 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:03:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:03:13 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:03:13 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:03:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:03:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3e0eb5-083a-4d02-8af9-b3a03fd11323]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a883eea-7521-43dc-94b4-2b7e85ce3f10]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:03:13 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:03:13 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:03:13 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:03:13 user nova-compute[75014]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)
Nov 08 04:03:13 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:03:13 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:03:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:03:13 user nova-compute[75014]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 (non-flash)
Nov 08 04:03:13 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:03:13 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:03:13 user nova-compute[75014]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)
Nov 08 04:03:13 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:03:13 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:03:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f04200f2320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37'): ({'sdd'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:03:13 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Removing single pathed devices sdd {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:03:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28e2d08-da14-496d-bcd1-404c10dee563]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a326c2-e012-4ba1-9df4-f885835ee8cf]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:13 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Flushing IO for device /dev/sdd {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:03:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ec8eb5-8980-41b0-a710-9d141257a99c]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:14 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:03:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1e04f8-d6e6-4ea1-97db-22fb7ffb39ea]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:14 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:03:14 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] SCSI volumes sdd have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:03:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:03:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[79644f3a-23c0-4092-9cbe-307955aceed9]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:03:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd62e0f-61e8-4dd4-8dad-fd5183116c62]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37, portal: 172.16.0.220,3260]
Nov 08 04:03:14 user nova-compute[75014]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37, portal: 172.16.0.220,3260] successful.
Nov 08 04:03:14 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:03:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6473b6b6-2ad6-4da7-9799-a570400bdc37 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57e2e2a-e92d-4292-b463-7e045a8e1c60]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:03:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:03:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] <== disconnect_volume: return (352ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:03:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:03:15 user nova-compute[75014]: DEBUG nova.objects.instance [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lazy-loading 'flavor' on Instance uuid 691bf2a3-13b2-466c-90a3-8dd01dfc18cb {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:03:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8c8af7a3-47fa-4bee-969d-ae537c1d509f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "691bf2a3-13b2-466c-90a3-8dd01dfc18cb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.939s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:03:15 user nova-compute[75014]: INFO nova.compute.manager [None req-fa7e82a3-9377-482d-8a43-e947448f02c6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Unrescuing
Nov 08 04:03:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-fa7e82a3-9377-482d-8a43-e947448f02c6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "refresh_cache-d4726cd1-51ea-41e2-ad36-be12b4d4c26b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:03:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-fa7e82a3-9377-482d-8a43-e947448f02c6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquired lock "refresh_cache-d4726cd1-51ea-41e2-ad36-be12b4d4c26b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:03:15 user nova-compute[75014]: DEBUG nova.network.neutron [None req-fa7e82a3-9377-482d-8a43-e947448f02c6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:03:15 user nova-compute[75014]: DEBUG nova.network.neutron [None req-fa7e82a3-9377-482d-8a43-e947448f02c6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Updating instance_info_cache with network_info: [{"id": "564c15b6-eb02-4a0c-8b00-d611297ac247", "address": "fa:16:3e:60:c7:25", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap564c15b6-eb", "ovs_interfaceid": "564c15b6-eb02-4a0c-8b00-d611297ac247", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:03:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-fa7e82a3-9377-482d-8a43-e947448f02c6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Releasing lock "refresh_cache-d4726cd1-51ea-41e2-ad36-be12b4d4c26b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:03:15 user nova-compute[75014]: DEBUG nova.objects.instance [None req-fa7e82a3-9377-482d-8a43-e947448f02c6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lazy-loading 'flavor' on Instance uuid d4726cd1-51ea-41e2-ad36-be12b4d4c26b {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:03:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:16 user nova-compute[75014]: DEBUG nova.compute.manager [req-19a2e657-ea35-4b3d-bb3b-6535e931907d req-8d2b65db-9075-4d0e-9b0f-6280e0c2d78c service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Received event network-vif-unplugged-564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:03:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-19a2e657-ea35-4b3d-bb3b-6535e931907d req-8d2b65db-9075-4d0e-9b0f-6280e0c2d78c service nova] Acquiring lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:03:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-19a2e657-ea35-4b3d-bb3b-6535e931907d req-8d2b65db-9075-4d0e-9b0f-6280e0c2d78c service nova] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:03:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-19a2e657-ea35-4b3d-bb3b-6535e931907d req-8d2b65db-9075-4d0e-9b0f-6280e0c2d78c service nova] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:03:16 user nova-compute[75014]: DEBUG nova.compute.manager [req-19a2e657-ea35-4b3d-bb3b-6535e931907d req-8d2b65db-9075-4d0e-9b0f-6280e0c2d78c service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] No waiting events found dispatching network-vif-unplugged-564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:03:16 user nova-compute[75014]: WARNING nova.compute.manager [req-19a2e657-ea35-4b3d-bb3b-6535e931907d req-8d2b65db-9075-4d0e-9b0f-6280e0c2d78c service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Received unexpected event network-vif-unplugged-564c15b6-eb02-4a0c-8b00-d611297ac247 for instance with vm_state rescued and task_state unrescuing.
Nov 08 04:03:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:16 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Instance destroyed successfully.
Nov 08 04:03:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:18 user nova-compute[75014]: DEBUG nova.compute.manager [req-1f70c3c0-3b82-4dff-8db1-7bbf03833fe1 req-0528985d-affb-4bbe-be51-8706c71b08ea service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Received event network-vif-plugged-564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:03:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1f70c3c0-3b82-4dff-8db1-7bbf03833fe1 req-0528985d-affb-4bbe-be51-8706c71b08ea service nova] Acquiring lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:03:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1f70c3c0-3b82-4dff-8db1-7bbf03833fe1 req-0528985d-affb-4bbe-be51-8706c71b08ea service nova] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:03:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1f70c3c0-3b82-4dff-8db1-7bbf03833fe1 req-0528985d-affb-4bbe-be51-8706c71b08ea service nova] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:03:18 user nova-compute[75014]: DEBUG nova.compute.manager [req-1f70c3c0-3b82-4dff-8db1-7bbf03833fe1 req-0528985d-affb-4bbe-be51-8706c71b08ea service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] No waiting events found dispatching network-vif-plugged-564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:03:18 user nova-compute[75014]: WARNING nova.compute.manager [req-1f70c3c0-3b82-4dff-8db1-7bbf03833fe1 req-0528985d-affb-4bbe-be51-8706c71b08ea service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Received unexpected event network-vif-plugged-564c15b6-eb02-4a0c-8b00-d611297ac247 for instance with vm_state rescued and task_state unrescuing.
Nov 08 04:03:18 user nova-compute[75014]: DEBUG nova.compute.manager [req-1f70c3c0-3b82-4dff-8db1-7bbf03833fe1 req-0528985d-affb-4bbe-be51-8706c71b08ea service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Received event network-vif-plugged-564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:03:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1f70c3c0-3b82-4dff-8db1-7bbf03833fe1 req-0528985d-affb-4bbe-be51-8706c71b08ea service nova] Acquiring lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:03:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1f70c3c0-3b82-4dff-8db1-7bbf03833fe1 req-0528985d-affb-4bbe-be51-8706c71b08ea service nova] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:03:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1f70c3c0-3b82-4dff-8db1-7bbf03833fe1 req-0528985d-affb-4bbe-be51-8706c71b08ea service nova] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:03:18 user nova-compute[75014]: DEBUG nova.compute.manager [req-1f70c3c0-3b82-4dff-8db1-7bbf03833fe1 req-0528985d-affb-4bbe-be51-8706c71b08ea service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] No waiting events found dispatching network-vif-plugged-564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:03:18 user nova-compute[75014]: WARNING nova.compute.manager [req-1f70c3c0-3b82-4dff-8db1-7bbf03833fe1 req-0528985d-affb-4bbe-be51-8706c71b08ea service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Received unexpected event network-vif-plugged-564c15b6-eb02-4a0c-8b00-d611297ac247 for instance with vm_state rescued and task_state unrescuing.
Nov 08 04:03:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:20 user nova-compute[75014]: DEBUG nova.compute.manager [None req-fa7e82a3-9377-482d-8a43-e947448f02c6 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:03:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-375bb846-d827-4ccd-a41c-3e209b4df720 req-22ca0d73-fa5b-481f-9881-a4ec5f754c68 service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Received event network-vif-plugged-564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:03:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-375bb846-d827-4ccd-a41c-3e209b4df720 req-22ca0d73-fa5b-481f-9881-a4ec5f754c68 service nova] Acquiring lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:03:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-375bb846-d827-4ccd-a41c-3e209b4df720 req-22ca0d73-fa5b-481f-9881-a4ec5f754c68 service nova] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:03:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-375bb846-d827-4ccd-a41c-3e209b4df720 req-22ca0d73-fa5b-481f-9881-a4ec5f754c68 service nova] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:03:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-375bb846-d827-4ccd-a41c-3e209b4df720 req-22ca0d73-fa5b-481f-9881-a4ec5f754c68 service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] No waiting events found dispatching network-vif-plugged-564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:03:20 user nova-compute[75014]: WARNING nova.compute.manager [req-375bb846-d827-4ccd-a41c-3e209b4df720 req-22ca0d73-fa5b-481f-9881-a4ec5f754c68 service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Received unexpected event network-vif-plugged-564c15b6-eb02-4a0c-8b00-d611297ac247 for instance with vm_state active and task_state None.
Nov 08 04:03:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'powdDRga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:03:22 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:03:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:03:22 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:03:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:03:22 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:03:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36f705f-00db-4d7a-9db8-36d9a80558fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:03:22 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c17513c-be06-418e-bbde-da8b1519a17e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8] added
Nov 08 04:03:22 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f928071a-387e-45ff-b7da-0ca3bb0b7718]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[30502bb1-f718-44ac-b124-97bdd9aba174]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v powdDRga {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v powdDRga" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec6103f-a7e7-4cad-917b-a8eb484c07de]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'powdDRga'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4403ec4f-3f74-4fa9-a47c-a45c9cd85c74]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[68346d84-810c-42b4-aea0-23f3a05fa2df]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:03:22 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:03:22 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:03:22 user nova-compute[75014]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)
Nov 08 04:03:22 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:03:22 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:03:22 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:03:22 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:03:22 user nova-compute[75014]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)
Nov 08 04:03:22 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:03:22 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[099841f1-6b60-45a5-904c-caa022f6bf27]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8, portal: 172.16.0.220,3260]
Nov 08 04:03:22 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8, portal: 172.16.0.220,3260] successful.
Nov 08 04:03:22 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:03:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.142s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:23 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb01ea8-94c4-4e59-8b96-a594b5d485db]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:23 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:03:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:23 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4294139a-77b9-4ea1-9ed0-09fcfe360481]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:23 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:03:23 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:03:23 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:03:23 user nova-compute[75014]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)
Nov 08 04:03:23 user nova-compute[75014]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 (non-flash)
Nov 08 04:03:23 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:03:23 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:03:23 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:03:23 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:03:23 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:03:23 user nova-compute[75014]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)
Nov 08 04:03:23 user nova-compute[75014]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 (non-flash)
Nov 08 04:03:23 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:03:23 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:03:23 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.425s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:03:23 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:03:23 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:03:23 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:03:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:23 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c39c63-b3e3-4876-9b69-6224a24c0237]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:23 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:03:23 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'powdDRga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:03:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.458s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:03:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] <== connect_volume: return (1460ms) {'type': 'block', 'scsi_wwn': '26562303162343930', 'path': '/dev/sdd'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:03:24 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562303162343930', 'path': '/dev/sdd'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:03:24 user nova-compute[75014]: DEBUG nova.objects.instance [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lazy-loading 'flavor' on Instance uuid 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:03:24 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 04:03:24 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:03:24 user nova-compute[75014]:   <source dev="/dev/sdd"/>
Nov 08 04:03:24 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:03:24 user nova-compute[75014]:   <serial>2a5a439f-c079-4ac4-b663-ee809d0cfec8</serial>
Nov 08 04:03:24 user nova-compute[75014]: </disk>
Nov 08 04:03:24 user nova-compute[75014]:  {{(pid=75014) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 04:03:24 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:03:24 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:03:24 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] No VIF found with MAC fa:16:3e:8f:4a:4b, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:03:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0864f330-06e6-4f58-a128-a51284bcf4b4 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.469s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:03:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:03:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:03:26 user nova-compute[75014]: INFO nova.compute.manager [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Detaching volume 2a5a439f-c079-4ac4-b663-ee809d0cfec8
Nov 08 04:03:26 user nova-compute[75014]: INFO nova.virt.block_device [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Attempting to driver detach volume 2a5a439f-c079-4ac4-b663-ee809d0cfec8 from mountpoint /dev/vdb
Nov 08 04:03:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Attempting to detach device vdb from instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d from the persistent domain config. {{(pid=75014) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 04:03:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:03:26 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:03:26 user nova-compute[75014]:   <source dev="/dev/sdd"/>
Nov 08 04:03:26 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:03:26 user nova-compute[75014]:   <serial>2a5a439f-c079-4ac4-b663-ee809d0cfec8</serial>
Nov 08 04:03:26 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:03:26 user nova-compute[75014]: </disk>
Nov 08 04:03:26 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:03:26 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Successfully detached device vdb from instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d from the persistent domain config.
Nov 08 04:03:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d from the live domain config. {{(pid=75014) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 04:03:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:03:26 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:03:26 user nova-compute[75014]:   <source dev="/dev/sdd"/>
Nov 08 04:03:26 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:03:26 user nova-compute[75014]:   <serial>2a5a439f-c079-4ac4-b663-ee809d0cfec8</serial>
Nov 08 04:03:26 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:03:26 user nova-compute[75014]: </disk>
Nov 08 04:03:26 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:03:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d {{(pid=75014) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 04:03:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:32 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:03:32 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:03:32 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:03:33 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:03:33 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:03:33 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:03:33 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:03:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-8527ee40-fb8a-469b-9696-d7bde8cc96f7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:03:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-8527ee40-fb8a-469b-9696-d7bde8cc96f7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:03:33 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 04:03:33 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Updating instance_info_cache with network_info: [{"id": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "address": "fa:16:3e:eb:34:b6", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa428a2cb-5b", "ovs_interfaceid": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:03:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-8527ee40-fb8a-469b-9696-d7bde8cc96f7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:03:33 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 04:03:33 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:03:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:37 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:03:37 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:03:37 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:03:38 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:03:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:03:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:03:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:03:38 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:03:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:03:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:03:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:03:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:03:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 04:03:42 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Creating image(s)
Nov 08 04:03:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Did not create local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Ensure instance console log exists: /opt/stack/data/nova/instances/0b3b62d9-2543-402b-bdb5-cac994b755c9/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Start _get_guest_xml network_info=[{"id": "4b006ecf-b195-4491-8ba7-7109ae8701df", "address": "fa:16:3e:c5:3a:a9", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b006ecf-b1", "ovs_interfaceid": "4b006ecf-b195-4491-8ba7-7109ae8701df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oPyKNglX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0b3b62d9-2543-402b-bdb5-cac994b755c9', 'attached_at': '', 'detached_at': '', 'volume_id': '47179dad-70f6-4bbd-afc1-51487445cd00', 'serial': '47179dad-70f6-4bbd-afc1-51487445cd00'}, 'device_type': 'disk', 'attachment_id': 'b6d1a664-93ce-42ff-9fea-2cd63d656d01', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:03:42 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:03:42 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:03:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oPyKNglX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:03:42 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:03:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:03:42 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:03:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:03:42 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:03:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d183a8ba-75bd-4044-b58f-e11839b1134a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:03:42 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e15a95-dede-40ad-8e08-a7d4a9fb04c0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00] added
Nov 08 04:03:42 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[723f5274-d6e6-4b0d-91aa-aa7f4cebb7ac]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5a03a0-84c1-483c-96a5-2fd927b7377d]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:03:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oPyKNglX {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oPyKNglX" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8185d45b-0794-486e-9196-3e03fc6f34cf]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oPyKNglX'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[659bbe3a-320c-4676-b659-1d9a4ccba68e]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39840fc-2baf-4ca1-9205-e54f0338f14c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99bef9d0-6a23-4734-a147-f9654a3eb67b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:03:43 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:03:43 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:03:43 user nova-compute[75014]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)
Nov 08 04:03:43 user nova-compute[75014]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 (non-flash)
Nov 08 04:03:43 user nova-compute[75014]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99bef9d0-6a23-4734-a147-f9654a3eb67b (non-flash)
Nov 08 04:03:43 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:03:43 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:03:43 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:03:43 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:03:43 user nova-compute[75014]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)
Nov 08 04:03:43 user nova-compute[75014]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 (non-flash)
Nov 08 04:03:43 user nova-compute[75014]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99bef9d0-6a23-4734-a147-f9654a3eb67b (non-flash)
Nov 08 04:03:43 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:03:43 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbfd36d-55cb-4338-8920-bf847453dea9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00, portal: 172.16.0.220,3260]
Nov 08 04:03:43 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00, portal: 172.16.0.220,3260] successful.
Nov 08 04:03:43 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:43 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:03:43 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:03:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=7414MB free_disk=24.69753646850586GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99e3262-9278-4b8e-a1a4-489128bd1566]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ecfd77-5f50-48e3-b1ce-1c8b432dde73]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99bef9d0-6a23-4734-a147-f9654a3eb67b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:03:43 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:03:43 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:03:43 user nova-compute[75014]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)
Nov 08 04:03:43 user nova-compute[75014]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 (non-flash)
Nov 08 04:03:43 user nova-compute[75014]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99bef9d0-6a23-4734-a147-f9654a3eb67b (non-flash)
Nov 08 04:03:43 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:03:43 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:03:43 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:03:43 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:03:43 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:03:43 user nova-compute[75014]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)
Nov 08 04:03:43 user nova-compute[75014]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 (non-flash)
Nov 08 04:03:43 user nova-compute[75014]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99bef9d0-6a23-4734-a147-f9654a3eb67b (non-flash)
Nov 08 04:03:43 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:03:43 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:03:43 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.651s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] HCTL ('40', '-', '-', 0) found on session 24 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ad5608-c89a-4cd6-9826-027b497cb0e0]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Searching for a device in session 24 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oPyKNglX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5344f747-e41c-4e02-8b24-296ab8e17987 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "691bf2a3-13b2-466c-90a3-8dd01dfc18cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5344f747-e41c-4e02-8b24-296ab8e17987 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "691bf2a3-13b2-466c-90a3-8dd01dfc18cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5344f747-e41c-4e02-8b24-296ab8e17987 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "691bf2a3-13b2-466c-90a3-8dd01dfc18cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5344f747-e41c-4e02-8b24-296ab8e17987 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "691bf2a3-13b2-466c-90a3-8dd01dfc18cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5344f747-e41c-4e02-8b24-296ab8e17987 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "691bf2a3-13b2-466c-90a3-8dd01dfc18cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:03:43 user nova-compute[75014]: INFO nova.compute.manager [None req-5344f747-e41c-4e02-8b24-296ab8e17987 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Terminating instance
Nov 08 04:03:43 user nova-compute[75014]: DEBUG nova.compute.manager [None req-5344f747-e41c-4e02-8b24-296ab8e17987 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9f205fe5-576f-4ef0-874b-1544c0307a7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 5bfa6580-e0fe-46b0-b497-8db67806113a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 8527ee40-fb8a-469b-9696-d7bde8cc96f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 655fe5eb-1271-4b9f-a5a6-6342bd012a69 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance bd153f84-98cd-4c6d-a7ab-5759b0b5bf55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 691bf2a3-13b2-466c-90a3-8dd01dfc18cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance d4726cd1-51ea-41e2-ad36-be12b4d4c26b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 44d4794d-91c4-4eb6-a752-37f587f2b420 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance d555b6b3-86ec-40ae-aa20-48846b5157d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance c23c9e00-b782-4530-bb01-a7a167951c1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 79dea88d-f5cd-4e8b-a98b-01af128f35ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 0b3b62d9-2543-402b-bdb5-cac994b755c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-d64ff3ee-d167-483e-a1e9-836845a93e83 req-9d63c77f-e23a-4e68-9cdd-1accdea506d6 service nova] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Received event network-vif-unplugged-fddcd530-d245-4d58-a0ca-59ddc2ac0121 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d64ff3ee-d167-483e-a1e9-836845a93e83 req-9d63c77f-e23a-4e68-9cdd-1accdea506d6 service nova] Acquiring lock "691bf2a3-13b2-466c-90a3-8dd01dfc18cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d64ff3ee-d167-483e-a1e9-836845a93e83 req-9d63c77f-e23a-4e68-9cdd-1accdea506d6 service nova] Lock "691bf2a3-13b2-466c-90a3-8dd01dfc18cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d64ff3ee-d167-483e-a1e9-836845a93e83 req-9d63c77f-e23a-4e68-9cdd-1accdea506d6 service nova] Lock "691bf2a3-13b2-466c-90a3-8dd01dfc18cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-d64ff3ee-d167-483e-a1e9-836845a93e83 req-9d63c77f-e23a-4e68-9cdd-1accdea506d6 service nova] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] No waiting events found dispatching network-vif-unplugged-fddcd530-d245-4d58-a0ca-59ddc2ac0121 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-d64ff3ee-d167-483e-a1e9-836845a93e83 req-9d63c77f-e23a-4e68-9cdd-1accdea506d6 service nova] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Received event network-vif-unplugged-fddcd530-d245-4d58-a0ca-59ddc2ac0121 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:03:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.610s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:03:44 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Instance destroyed successfully.
Nov 08 04:03:44 user nova-compute[75014]: DEBUG nova.objects.instance [None req-5344f747-e41c-4e02-8b24-296ab8e17987 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lazy-loading 'resources' on Instance uuid 691bf2a3-13b2-466c-90a3-8dd01dfc18cb {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-5344f747-e41c-4e02-8b24-296ab8e17987 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:57:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-549866031',display_name='tempest-AttachVolumeNegativeTest-server-549866031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-549866031',id=17,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZpZAmuH3ZrhrFPf9kWKXV4/Wfw2G0IqwJ5Adj4Y9yFy3YQzeKd5ElckWK+avKvBYhXo8LTI8JfqrFynPydTDRFnfGFyF9C+9cjsEO8opg/CHeCgFFjkHo84XwbkemGqA==',key_name='tempest-keypair-1998429471',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:57:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1c9753cb588478a8a93182be3256674',ramdisk_id='',reservation_id='r-0bb23suk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1215701914',owner_user_name='tempest-AttachVolumeNegativeTest-1215701914-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T03:57:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8c674d8b2cf49c08cf254a8095ef8ea',uuid=691bf2a3-13b2-466c-90a3-8dd01dfc18cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fddcd530-d245-4d58-a0ca-59ddc2ac0121", "address": "fa:16:3e:27:87:8b", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfddcd530-d2", "ovs_interfaceid": "fddcd530-d245-4d58-a0ca-59ddc2ac0121", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-5344f747-e41c-4e02-8b24-296ab8e17987 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Converting VIF {"id": "fddcd530-d245-4d58-a0ca-59ddc2ac0121", "address": "fa:16:3e:27:87:8b", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfddcd530-d2", "ovs_interfaceid": "fddcd530-d245-4d58-a0ca-59ddc2ac0121", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-5344f747-e41c-4e02-8b24-296ab8e17987 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:87:8b,bridge_name='br-int',has_traffic_filtering=True,id=fddcd530-d245-4d58-a0ca-59ddc2ac0121,network=Network(f3d67270-d525-45d9-958c-a901d121d510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfddcd530-d2') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG os_vif [None req-5344f747-e41c-4e02-8b24-296ab8e17987 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:87:8b,bridge_name='br-int',has_traffic_filtering=True,id=fddcd530-d245-4d58-a0ca-59ddc2ac0121,network=Network(f3d67270-d525-45d9-958c-a901d121d510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfddcd530-d2') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfddcd530-d2, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=039825a4-bede-40c2-9f17-9aa2277991de) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:44 user nova-compute[75014]: INFO os_vif [None req-5344f747-e41c-4e02-8b24-296ab8e17987 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:87:8b,bridge_name='br-int',has_traffic_filtering=True,id=fddcd530-d245-4d58-a0ca-59ddc2ac0121,network=Network(f3d67270-d525-45d9-958c-a901d121d510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfddcd530-d2')
Nov 08 04:03:44 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-5344f747-e41c-4e02-8b24-296ab8e17987 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Deleting instance files /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb_del
Nov 08 04:03:44 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-5344f747-e41c-4e02-8b24-296ab8e17987 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Deletion of /opt/stack/data/nova/instances/691bf2a3-13b2-466c-90a3-8dd01dfc18cb_del complete
Nov 08 04:03:44 user nova-compute[75014]: INFO nova.compute.manager [None req-5344f747-e41c-4e02-8b24-296ab8e17987 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 08 04:03:44 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-5344f747-e41c-4e02-8b24-296ab8e17987 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.691s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] <== connect_volume: return (1692ms) {'type': 'block', 'scsi_wwn': '26164636136386338', 'path': '/dev/sdi'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164636136386338', 'path': '/dev/sdi'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1905655883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1905655883',id=28,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92a182cdeb8543fea1ab24326734991e',ramdisk_id='',reservation_id='r-0igftpd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648299000',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:02:33Z,user_data=None,user_id='630b9ba8f1d9471f9cea51f74106381a',uuid=0b3b62d9-2543-402b-bdb5-cac994b755c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b006ecf-b195-4491-8ba7-7109ae8701df", "address": "fa:16:3e:c5:3a:a9", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b006ecf-b1", "ovs_interfaceid": "4b006ecf-b195-4491-8ba7-7109ae8701df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Converting VIF {"id": "4b006ecf-b195-4491-8ba7-7109ae8701df", "address": "fa:16:3e:c5:3a:a9", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b006ecf-b1", "ovs_interfaceid": "4b006ecf-b195-4491-8ba7-7109ae8701df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:3a:a9,bridge_name='br-int',has_traffic_filtering=True,id=4b006ecf-b195-4491-8ba7-7109ae8701df,network=Network(d45dbf14-9570-46c1-91a3-cbe2f7972b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b006ecf-b1') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG nova.objects.instance [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b3b62d9-2543-402b-bdb5-cac994b755c9 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:03:44 user nova-compute[75014]:   <uuid>0b3b62d9-2543-402b-bdb5-cac994b755c9</uuid>
Nov 08 04:03:44 user nova-compute[75014]:   <name>instance-0000001c</name>
Nov 08 04:03:44 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:03:44 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:03:44 user nova-compute[75014]:   <metadata>
Nov 08 04:03:44 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:03:44 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:03:44 user nova-compute[75014]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1905655883</nova:name>
Nov 08 04:03:44 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:03:42</nova:creationTime>
Nov 08 04:03:44 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:03:44 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:03:44 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:03:44 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:03:44 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:03:44 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:03:44 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:03:44 user nova-compute[75014]:       <nova:owner>
Nov 08 04:03:44 user nova-compute[75014]:         <nova:user uuid="630b9ba8f1d9471f9cea51f74106381a">tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member</nova:user>
Nov 08 04:03:44 user nova-compute[75014]:         <nova:project uuid="92a182cdeb8543fea1ab24326734991e">tempest-ServerBootFromVolumeStableRescueTest-1648299000</nova:project>
Nov 08 04:03:44 user nova-compute[75014]:       </nova:owner>
Nov 08 04:03:44 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:03:44 user nova-compute[75014]:       <nova:ports>
Nov 08 04:03:44 user nova-compute[75014]:         <nova:port uuid="4b006ecf-b195-4491-8ba7-7109ae8701df">
Nov 08 04:03:44 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 04:03:44 user nova-compute[75014]:         </nova:port>
Nov 08 04:03:44 user nova-compute[75014]:       </nova:ports>
Nov 08 04:03:44 user nova-compute[75014]:     </nova:instance>
Nov 08 04:03:44 user nova-compute[75014]:   </metadata>
Nov 08 04:03:44 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:03:44 user nova-compute[75014]:     <system>
Nov 08 04:03:44 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:03:44 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:03:44 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:03:44 user nova-compute[75014]:       <entry name="serial">0b3b62d9-2543-402b-bdb5-cac994b755c9</entry>
Nov 08 04:03:44 user nova-compute[75014]:       <entry name="uuid">0b3b62d9-2543-402b-bdb5-cac994b755c9</entry>
Nov 08 04:03:44 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:03:44 user nova-compute[75014]:     </system>
Nov 08 04:03:44 user nova-compute[75014]:   </sysinfo>
Nov 08 04:03:44 user nova-compute[75014]:   <os>
Nov 08 04:03:44 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:03:44 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:03:44 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:03:44 user nova-compute[75014]:   </os>
Nov 08 04:03:44 user nova-compute[75014]:   <features>
Nov 08 04:03:44 user nova-compute[75014]:     <acpi/>
Nov 08 04:03:44 user nova-compute[75014]:     <apic/>
Nov 08 04:03:44 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:03:44 user nova-compute[75014]:   </features>
Nov 08 04:03:44 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:03:44 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:03:44 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:03:44 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:03:44 user nova-compute[75014]:   </clock>
Nov 08 04:03:44 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:03:44 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:03:44 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:03:44 user nova-compute[75014]:   </cpu>
Nov 08 04:03:44 user nova-compute[75014]:   <devices>
Nov 08 04:03:44 user nova-compute[75014]:     <disk type="block" device="disk">
Nov 08 04:03:44 user nova-compute[75014]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:03:44 user nova-compute[75014]:       <source dev="/dev/sdi"/>
Nov 08 04:03:44 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:03:44 user nova-compute[75014]:       <serial>47179dad-70f6-4bbd-afc1-51487445cd00</serial>
Nov 08 04:03:44 user nova-compute[75014]:     </disk>
Nov 08 04:03:44 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:03:44 user nova-compute[75014]:       <mac address="fa:16:3e:c5:3a:a9"/>
Nov 08 04:03:44 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:03:44 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:03:44 user nova-compute[75014]:       <target dev="tap4b006ecf-b1"/>
Nov 08 04:03:44 user nova-compute[75014]:     </interface>
Nov 08 04:03:44 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:03:44 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/0b3b62d9-2543-402b-bdb5-cac994b755c9/console.log" append="off"/>
Nov 08 04:03:44 user nova-compute[75014]:     </serial>
Nov 08 04:03:44 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:03:44 user nova-compute[75014]:     <video>
Nov 08 04:03:44 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:03:44 user nova-compute[75014]:     </video>
Nov 08 04:03:44 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:03:44 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:03:44 user nova-compute[75014]:     </rng>
Nov 08 04:03:44 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:03:44 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:03:44 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:03:44 user nova-compute[75014]:     </memballoon>
Nov 08 04:03:44 user nova-compute[75014]:   </devices>
Nov 08 04:03:44 user nova-compute[75014]: </domain>
Nov 08 04:03:44 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1905655883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1905655883',id=28,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92a182cdeb8543fea1ab24326734991e',ramdisk_id='',reservation_id='r-0igftpd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648299000',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:02:33Z,user_data=None,user_id='630b9ba8f1d9471f9cea51f74106381a',uuid=0b3b62d9-2543-402b-bdb5-cac994b755c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b006ecf-b195-4491-8ba7-7109ae8701df", "address": "fa:16:3e:c5:3a:a9", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b006ecf-b1", "ovs_interfaceid": "4b006ecf-b195-4491-8ba7-7109ae8701df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Converting VIF {"id": "4b006ecf-b195-4491-8ba7-7109ae8701df", "address": "fa:16:3e:c5:3a:a9", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b006ecf-b1", "ovs_interfaceid": "4b006ecf-b195-4491-8ba7-7109ae8701df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:3a:a9,bridge_name='br-int',has_traffic_filtering=True,id=4b006ecf-b195-4491-8ba7-7109ae8701df,network=Network(d45dbf14-9570-46c1-91a3-cbe2f7972b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b006ecf-b1') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG os_vif [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:3a:a9,bridge_name='br-int',has_traffic_filtering=True,id=4b006ecf-b195-4491-8ba7-7109ae8701df,network=Network(d45dbf14-9570-46c1-91a3-cbe2f7972b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b006ecf-b1') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e82d0fd6-6cb4-514f-b912-71e42b3f00ab', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b006ecf-b1, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b006ecf-b1, col_values=(('qos', UUID('cede4af6-aaea-4883-a4fb-c61b8887a936')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b006ecf-b1, col_values=(('external_ids', {'iface-id': '4b006ecf-b195-4491-8ba7-7109ae8701df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:3a:a9', 'vm-uuid': '0b3b62d9-2543-402b-bdb5-cac994b755c9'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:44 user nova-compute[75014]: INFO os_vif [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:3a:a9,bridge_name='br-int',has_traffic_filtering=True,id=4b006ecf-b195-4491-8ba7-7109ae8701df,network=Network(d45dbf14-9570-46c1-91a3-cbe2f7972b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b006ecf-b1')
Nov 08 04:03:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:03:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] No VIF found with MAC fa:16:3e:c5:3a:a9, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:03:45 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:03:45 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Took 0.69 seconds to deallocate network for instance.
Nov 08 04:03:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5344f747-e41c-4e02-8b24-296ab8e17987 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:03:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5344f747-e41c-4e02-8b24-296ab8e17987 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:03:45 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-5344f747-e41c-4e02-8b24-296ab8e17987 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:03:45 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-5344f747-e41c-4e02-8b24-296ab8e17987 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:03:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5344f747-e41c-4e02-8b24-296ab8e17987 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:03:45 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-5344f747-e41c-4e02-8b24-296ab8e17987 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Deleted allocations for instance 691bf2a3-13b2-466c-90a3-8dd01dfc18cb
Nov 08 04:03:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5344f747-e41c-4e02-8b24-296ab8e17987 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "691bf2a3-13b2-466c-90a3-8dd01dfc18cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.125s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:03:45 user nova-compute[75014]: DEBUG nova.compute.manager [req-2f5b4bf5-2f5f-45e3-be5e-58a6245186e5 req-9b7a1a94-fdcc-4836-bdf9-3e84fdec3680 service nova] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Received event network-vif-plugged-fddcd530-d245-4d58-a0ca-59ddc2ac0121 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:03:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2f5b4bf5-2f5f-45e3-be5e-58a6245186e5 req-9b7a1a94-fdcc-4836-bdf9-3e84fdec3680 service nova] Acquiring lock "691bf2a3-13b2-466c-90a3-8dd01dfc18cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:03:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2f5b4bf5-2f5f-45e3-be5e-58a6245186e5 req-9b7a1a94-fdcc-4836-bdf9-3e84fdec3680 service nova] Lock "691bf2a3-13b2-466c-90a3-8dd01dfc18cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:03:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2f5b4bf5-2f5f-45e3-be5e-58a6245186e5 req-9b7a1a94-fdcc-4836-bdf9-3e84fdec3680 service nova] Lock "691bf2a3-13b2-466c-90a3-8dd01dfc18cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:03:45 user nova-compute[75014]: DEBUG nova.compute.manager [req-2f5b4bf5-2f5f-45e3-be5e-58a6245186e5 req-9b7a1a94-fdcc-4836-bdf9-3e84fdec3680 service nova] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] No waiting events found dispatching network-vif-plugged-fddcd530-d245-4d58-a0ca-59ddc2ac0121 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:03:45 user nova-compute[75014]: WARNING nova.compute.manager [req-2f5b4bf5-2f5f-45e3-be5e-58a6245186e5 req-9b7a1a94-fdcc-4836-bdf9-3e84fdec3680 service nova] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Received unexpected event network-vif-plugged-fddcd530-d245-4d58-a0ca-59ddc2ac0121 for instance with vm_state deleted and task_state None.
Nov 08 04:03:45 user nova-compute[75014]: DEBUG nova.compute.manager [req-2f5b4bf5-2f5f-45e3-be5e-58a6245186e5 req-9b7a1a94-fdcc-4836-bdf9-3e84fdec3680 service nova] [instance: 691bf2a3-13b2-466c-90a3-8dd01dfc18cb] Received event network-vif-deleted-fddcd530-d245-4d58-a0ca-59ddc2ac0121 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:03:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:46 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:46 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:46 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:46 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:46 user nova-compute[75014]: DEBUG nova.compute.manager [req-3d2a5d35-b77b-45f2-866a-09d9e655c430 req-b8af2bb5-80ea-4854-bbb0-3c426db75466 service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Received event network-vif-plugged-4b006ecf-b195-4491-8ba7-7109ae8701df {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:03:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3d2a5d35-b77b-45f2-866a-09d9e655c430 req-b8af2bb5-80ea-4854-bbb0-3c426db75466 service nova] Acquiring lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:03:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3d2a5d35-b77b-45f2-866a-09d9e655c430 req-b8af2bb5-80ea-4854-bbb0-3c426db75466 service nova] Lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:03:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3d2a5d35-b77b-45f2-866a-09d9e655c430 req-b8af2bb5-80ea-4854-bbb0-3c426db75466 service nova] Lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:03:46 user nova-compute[75014]: DEBUG nova.compute.manager [req-3d2a5d35-b77b-45f2-866a-09d9e655c430 req-b8af2bb5-80ea-4854-bbb0-3c426db75466 service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] No waiting events found dispatching network-vif-plugged-4b006ecf-b195-4491-8ba7-7109ae8701df {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:03:46 user nova-compute[75014]: WARNING nova.compute.manager [req-3d2a5d35-b77b-45f2-866a-09d9e655c430 req-b8af2bb5-80ea-4854-bbb0-3c426db75466 service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Received unexpected event network-vif-plugged-4b006ecf-b195-4491-8ba7-7109ae8701df for instance with vm_state building and task_state spawning.
Nov 08 04:03:46 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:47 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d is timed out.
Nov 08 04:03:47 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Successfully detached device vdb from instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d from the live domain config.
Nov 08 04:03:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'powdDRga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:03:47 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:03:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[223f9b52-dcb1-47ec-85d1-c1a3bc396174]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:99bef9d0-6a23-4734-a147-f9654a3eb67b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:03:47 user nova-compute[75014]: No targets found.
Nov 08 04:03:47 user nova-compute[75014]: iSNS:
Nov 08 04:03:47 user nova-compute[75014]: No targets found.
Nov 08 04:03:47 user nova-compute[75014]: STATIC:
Nov 08 04:03:47 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908
Nov 08 04:03:47 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:03:47 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:03:47 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec
Nov 08 04:03:47 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:03:47 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:03:47 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8
Nov 08 04:03:47 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:03:47 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:03:47 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00
Nov 08 04:03:47 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:03:47 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:03:47 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:03:47 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:03:47 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:03:47 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a
Nov 08 04:03:47 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:03:47 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:03:47 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b
Nov 08 04:03:47 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:03:47 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:03:47 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:99bef9d0-6a23-4734-a147-f9654a3eb67b
Nov 08 04:03:47 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:03:47 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:03:47 user nova-compute[75014]: FIRMWARE:
Nov 08 04:03:47 user nova-compute[75014]: No targets found.
Nov 08 04:03:47 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:03:47 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:03:47 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7b8b28-3c7b-4a01-bab8-561c738b0b76]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99bef9d0-6a23-4734-a147-f9654a3eb67b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b170e95d-e1a0-459a-8cea-ecd510b8a1f4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99bef9d0-6a23-4734-a147-f9654a3eb67b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:03:47 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:03:47 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:03:47 user nova-compute[75014]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)
Nov 08 04:03:47 user nova-compute[75014]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 (non-flash)
Nov 08 04:03:47 user nova-compute[75014]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99bef9d0-6a23-4734-a147-f9654a3eb67b (non-flash)
Nov 08 04:03:47 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:03:47 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:03:47 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:03:47 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:03:47 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:03:47 user nova-compute[75014]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)
Nov 08 04:03:47 user nova-compute[75014]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 (non-flash)
Nov 08 04:03:47 user nova-compute[75014]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99bef9d0-6a23-4734-a147-f9654a3eb67b (non-flash)
Nov 08 04:03:47 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:03:47 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:03:47 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f040019be20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8'): ({'sdd'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Removing single pathed devices sdd {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-eeacedf3-30bb-407c-965f-2b36774270e7 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-eeacedf3-30bb-407c-965f-2b36774270e7 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-eeacedf3-30bb-407c-965f-2b36774270e7 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-eeacedf3-30bb-407c-965f-2b36774270e7 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-eeacedf3-30bb-407c-965f-2b36774270e7 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:03:47 user nova-compute[75014]: INFO nova.compute.manager [None req-eeacedf3-30bb-407c-965f-2b36774270e7 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Terminating instance
Nov 08 04:03:47 user nova-compute[75014]: DEBUG nova.compute.manager [None req-eeacedf3-30bb-407c-965f-2b36774270e7 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1b5caf-f4bf-4194-ab49-7d5892ba9315]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[643e062f-1295-48a9-a1eb-b1b38b3c4e4c]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Flushing IO for device /dev/sdd {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb16ddc-9ffc-4098-bc2f-f357b7cc16ba]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.059s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6db49b0-67f9-4eaf-8845-afa1588a6b10]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] SCSI volumes sdd have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ee1a16-a79d-45f5-9c2d-c31ada9f829a]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.105s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc65a3da-37f4-40fa-9bd1-07fa44368a9e]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8, portal: 172.16.0.220,3260]
Nov 08 04:03:47 user nova-compute[75014]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8, portal: 172.16.0.220,3260] successful.
Nov 08 04:03:47 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a439f-c079-4ac4-b663-ee809d0cfec8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[506f465a-c140-49c9-8ced-b04f2ecab327]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.432s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] <== disconnect_volume: return (435ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:03:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:03:48 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Instance destroyed successfully.
Nov 08 04:03:48 user nova-compute[75014]: DEBUG nova.objects.instance [None req-eeacedf3-30bb-407c-965f-2b36774270e7 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lazy-loading 'resources' on Instance uuid 79dea88d-f5cd-4e8b-a98b-01af128f35ed {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-eeacedf3-30bb-407c-965f-2b36774270e7 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T03:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-126106463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-126106463',id=19,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkERAMQEozvUuRL7w/KH8SVpl6H+WMKEN72SColTSftWtRNhuQPQVVmz8MU8JS5GawhQGgUIpcwXO5XKClq5cpqfubM4gfoZ7MgOUQORMPiTldXsMzDtlaEN/70+UwQWA==',key_name='tempest-keypair-1769201340',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:02:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1d70b55f2bb42e5b7123acfcd621b2f',ramdisk_id='',reservation_id='r-n2lnrofd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-650261566',owner_user_name='tempest-AttachVolumeShelveTestJSON-650261566-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:02:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74a49a9155064771bd4e8a179f9111ac',uuid=79dea88d-f5cd-4e8b-a98b-01af128f35ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "address": "fa:16:3e:e4:5b:42", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce8dc6f-21", "ovs_interfaceid": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-eeacedf3-30bb-407c-965f-2b36774270e7 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Converting VIF {"id": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "address": "fa:16:3e:e4:5b:42", "network": {"id": "6ebf42ac-ab65-4622-8529-4c508f9d563c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2106112596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1d70b55f2bb42e5b7123acfcd621b2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce8dc6f-21", "ovs_interfaceid": "0ce8dc6f-2116-4163-8c05-2e3519724ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-eeacedf3-30bb-407c-965f-2b36774270e7 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5b:42,bridge_name='br-int',has_traffic_filtering=True,id=0ce8dc6f-2116-4163-8c05-2e3519724ee7,network=Network(6ebf42ac-ab65-4622-8529-4c508f9d563c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce8dc6f-21') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG os_vif [None req-eeacedf3-30bb-407c-965f-2b36774270e7 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5b:42,bridge_name='br-int',has_traffic_filtering=True,id=0ce8dc6f-2116-4163-8c05-2e3519724ee7,network=Network(6ebf42ac-ab65-4622-8529-4c508f9d563c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce8dc6f-21') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ce8dc6f-21, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5119251c-b60a-418a-9d60-b4c143d47f92) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:48 user nova-compute[75014]: INFO os_vif [None req-eeacedf3-30bb-407c-965f-2b36774270e7 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5b:42,bridge_name='br-int',has_traffic_filtering=True,id=0ce8dc6f-2116-4163-8c05-2e3519724ee7,network=Network(6ebf42ac-ab65-4622-8529-4c508f9d563c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce8dc6f-21')
Nov 08 04:03:48 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-eeacedf3-30bb-407c-965f-2b36774270e7 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Deleting instance files /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed_del
Nov 08 04:03:48 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-eeacedf3-30bb-407c-965f-2b36774270e7 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Deletion of /opt/stack/data/nova/instances/79dea88d-f5cd-4e8b-a98b-01af128f35ed_del complete
Nov 08 04:03:48 user nova-compute[75014]: INFO nova.compute.manager [None req-eeacedf3-30bb-407c-965f-2b36774270e7 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 08 04:03:48 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-eeacedf3-30bb-407c-965f-2b36774270e7 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG nova.compute.manager [req-10162e99-0562-4d4a-99ec-a2aa48a3eca7 req-a8a222b2-95f5-4f71-9b41-30ba99460b5e service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Received event network-vif-plugged-4b006ecf-b195-4491-8ba7-7109ae8701df {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-10162e99-0562-4d4a-99ec-a2aa48a3eca7 req-a8a222b2-95f5-4f71-9b41-30ba99460b5e service nova] Acquiring lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-10162e99-0562-4d4a-99ec-a2aa48a3eca7 req-a8a222b2-95f5-4f71-9b41-30ba99460b5e service nova] Lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-10162e99-0562-4d4a-99ec-a2aa48a3eca7 req-a8a222b2-95f5-4f71-9b41-30ba99460b5e service nova] Lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG nova.compute.manager [req-10162e99-0562-4d4a-99ec-a2aa48a3eca7 req-a8a222b2-95f5-4f71-9b41-30ba99460b5e service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] No waiting events found dispatching network-vif-plugged-4b006ecf-b195-4491-8ba7-7109ae8701df {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:03:48 user nova-compute[75014]: WARNING nova.compute.manager [req-10162e99-0562-4d4a-99ec-a2aa48a3eca7 req-a8a222b2-95f5-4f71-9b41-30ba99460b5e service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Received unexpected event network-vif-plugged-4b006ecf-b195-4491-8ba7-7109ae8701df for instance with vm_state building and task_state spawning.
Nov 08 04:03:48 user nova-compute[75014]: DEBUG nova.compute.manager [req-10162e99-0562-4d4a-99ec-a2aa48a3eca7 req-a8a222b2-95f5-4f71-9b41-30ba99460b5e service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Received event network-vif-unplugged-0ce8dc6f-2116-4163-8c05-2e3519724ee7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-10162e99-0562-4d4a-99ec-a2aa48a3eca7 req-a8a222b2-95f5-4f71-9b41-30ba99460b5e service nova] Acquiring lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-10162e99-0562-4d4a-99ec-a2aa48a3eca7 req-a8a222b2-95f5-4f71-9b41-30ba99460b5e service nova] Lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-10162e99-0562-4d4a-99ec-a2aa48a3eca7 req-a8a222b2-95f5-4f71-9b41-30ba99460b5e service nova] Lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG nova.compute.manager [req-10162e99-0562-4d4a-99ec-a2aa48a3eca7 req-a8a222b2-95f5-4f71-9b41-30ba99460b5e service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] No waiting events found dispatching network-vif-unplugged-0ce8dc6f-2116-4163-8c05-2e3519724ee7 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG nova.compute.manager [req-10162e99-0562-4d4a-99ec-a2aa48a3eca7 req-a8a222b2-95f5-4f71-9b41-30ba99460b5e service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Received event network-vif-unplugged-0ce8dc6f-2116-4163-8c05-2e3519724ee7 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG nova.compute.manager [req-10162e99-0562-4d4a-99ec-a2aa48a3eca7 req-a8a222b2-95f5-4f71-9b41-30ba99460b5e service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Received event network-vif-plugged-0ce8dc6f-2116-4163-8c05-2e3519724ee7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-10162e99-0562-4d4a-99ec-a2aa48a3eca7 req-a8a222b2-95f5-4f71-9b41-30ba99460b5e service nova] Acquiring lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-10162e99-0562-4d4a-99ec-a2aa48a3eca7 req-a8a222b2-95f5-4f71-9b41-30ba99460b5e service nova] Lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-10162e99-0562-4d4a-99ec-a2aa48a3eca7 req-a8a222b2-95f5-4f71-9b41-30ba99460b5e service nova] Lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG nova.compute.manager [req-10162e99-0562-4d4a-99ec-a2aa48a3eca7 req-a8a222b2-95f5-4f71-9b41-30ba99460b5e service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] No waiting events found dispatching network-vif-plugged-0ce8dc6f-2116-4163-8c05-2e3519724ee7 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:03:48 user nova-compute[75014]: WARNING nova.compute.manager [req-10162e99-0562-4d4a-99ec-a2aa48a3eca7 req-a8a222b2-95f5-4f71-9b41-30ba99460b5e service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Received unexpected event network-vif-plugged-0ce8dc6f-2116-4163-8c05-2e3519724ee7 for instance with vm_state active and task_state deleting.
Nov 08 04:03:48 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 04:03:48 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Instance spawned successfully.
Nov 08 04:03:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:03:48 user nova-compute[75014]: INFO nova.compute.manager [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Took 5.84 seconds to spawn the instance on the hypervisor.
Nov 08 04:03:48 user nova-compute[75014]: DEBUG nova.compute.manager [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:03:48 user nova-compute[75014]: INFO nova.compute.manager [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Took 76.34 seconds to build instance.
Nov 08 04:03:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a49e9a30-11ff-4f3a-a85e-6129c313f436 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "0b3b62d9-2543-402b-bdb5-cac994b755c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 76.454s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:03:48 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:03:48 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Took 0.84 seconds to deallocate network for instance.
Nov 08 04:03:49 user nova-compute[75014]: DEBUG nova.compute.manager [req-3fc12dbc-c916-4047-86df-aefc9472a894 req-f682d633-95a9-413d-b30b-025d0d55c848 service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Received event network-vif-deleted-0ce8dc6f-2116-4163-8c05-2e3519724ee7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:03:49 user nova-compute[75014]: INFO nova.compute.manager [req-3fc12dbc-c916-4047-86df-aefc9472a894 req-f682d633-95a9-413d-b30b-025d0d55c848 service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Neutron deleted interface 0ce8dc6f-2116-4163-8c05-2e3519724ee7; detaching it from the instance and deleting it from the info cache
Nov 08 04:03:49 user nova-compute[75014]: DEBUG nova.network.neutron [req-3fc12dbc-c916-4047-86df-aefc9472a894 req-f682d633-95a9-413d-b30b-025d0d55c848 service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:03:49 user nova-compute[75014]: DEBUG nova.compute.manager [req-3fc12dbc-c916-4047-86df-aefc9472a894 req-f682d633-95a9-413d-b30b-025d0d55c848 service nova] [instance: 79dea88d-f5cd-4e8b-a98b-01af128f35ed] Detach interface failed, port_id=0ce8dc6f-2116-4163-8c05-2e3519724ee7, reason: Instance 79dea88d-f5cd-4e8b-a98b-01af128f35ed could not be found. {{(pid=75014) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 04:03:49 user nova-compute[75014]: DEBUG nova.objects.instance [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lazy-loading 'flavor' on Instance uuid 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:03:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9e9dc8da-a83c-48dd-b679-4ff806dbf9ab tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.625s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:03:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-eeacedf3-30bb-407c-965f-2b36774270e7 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:03:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-eeacedf3-30bb-407c-965f-2b36774270e7 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:03:49 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-eeacedf3-30bb-407c-965f-2b36774270e7 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:03:49 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-eeacedf3-30bb-407c-965f-2b36774270e7 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:03:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-eeacedf3-30bb-407c-965f-2b36774270e7 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.454s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:03:49 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-eeacedf3-30bb-407c-965f-2b36774270e7 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Deleted allocations for instance 79dea88d-f5cd-4e8b-a98b-01af128f35ed
Nov 08 04:03:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-eeacedf3-30bb-407c-965f-2b36774270e7 tempest-AttachVolumeShelveTestJSON-650261566 tempest-AttachVolumeShelveTestJSON-650261566-project-member] Lock "79dea88d-f5cd-4e8b-a98b-01af128f35ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.510s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:03:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:03:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:03 user nova-compute[75014]: DEBUG nova.compute.manager [req-7c3a9908-42b5-4837-97ec-e7edd0807409 req-4fcd8c4b-4679-4a3c-83c6-316e474246fe service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Received event network-changed-37918aae-d92b-43c0-8477-1355ac936ab0 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:04:03 user nova-compute[75014]: DEBUG nova.compute.manager [req-7c3a9908-42b5-4837-97ec-e7edd0807409 req-4fcd8c4b-4679-4a3c-83c6-316e474246fe service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Refreshing instance network info cache due to event network-changed-37918aae-d92b-43c0-8477-1355ac936ab0. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:04:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-7c3a9908-42b5-4837-97ec-e7edd0807409 req-4fcd8c4b-4679-4a3c-83c6-316e474246fe service nova] Acquiring lock "refresh_cache-44d4794d-91c4-4eb6-a752-37f587f2b420" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:04:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-7c3a9908-42b5-4837-97ec-e7edd0807409 req-4fcd8c4b-4679-4a3c-83c6-316e474246fe service nova] Acquired lock "refresh_cache-44d4794d-91c4-4eb6-a752-37f587f2b420" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:04:03 user nova-compute[75014]: DEBUG nova.network.neutron [req-7c3a9908-42b5-4837-97ec-e7edd0807409 req-4fcd8c4b-4679-4a3c-83c6-316e474246fe service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Refreshing network info cache for port 37918aae-d92b-43c0-8477-1355ac936ab0 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:04:03 user nova-compute[75014]: DEBUG nova.network.neutron [req-7c3a9908-42b5-4837-97ec-e7edd0807409 req-4fcd8c4b-4679-4a3c-83c6-316e474246fe service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Updated VIF entry in instance network info cache for port 37918aae-d92b-43c0-8477-1355ac936ab0. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:04:03 user nova-compute[75014]: DEBUG nova.network.neutron [req-7c3a9908-42b5-4837-97ec-e7edd0807409 req-4fcd8c4b-4679-4a3c-83c6-316e474246fe service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Updating instance_info_cache with network_info: [{"id": "37918aae-d92b-43c0-8477-1355ac936ab0", "address": "fa:16:3e:43:25:9f", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37918aae-d9", "ovs_interfaceid": "37918aae-d92b-43c0-8477-1355ac936ab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:04:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-7c3a9908-42b5-4837-97ec-e7edd0807409 req-4fcd8c4b-4679-4a3c-83c6-316e474246fe service nova] Releasing lock "refresh_cache-44d4794d-91c4-4eb6-a752-37f587f2b420" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:04:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "44d4794d-91c4-4eb6-a752-37f587f2b420" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:04:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "44d4794d-91c4-4eb6-a752-37f587f2b420" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:04:04 user nova-compute[75014]: INFO nova.compute.manager [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Detaching volume 24d32672-c667-4adb-84b1-0dece53e7d7b
Nov 08 04:04:04 user nova-compute[75014]: INFO nova.virt.block_device [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Attempting to driver detach volume 24d32672-c667-4adb-84b1-0dece53e7d7b from mountpoint /dev/vdb
Nov 08 04:04:04 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Attempting to detach device vdb from instance 44d4794d-91c4-4eb6-a752-37f587f2b420 from the persistent domain config. {{(pid=75014) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 04:04:04 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:04:04 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:04:04 user nova-compute[75014]:   <source dev="/dev/sdh"/>
Nov 08 04:04:04 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:04:04 user nova-compute[75014]:   <serial>24d32672-c667-4adb-84b1-0dece53e7d7b</serial>
Nov 08 04:04:04 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 04:04:04 user nova-compute[75014]: </disk>
Nov 08 04:04:04 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:04:04 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Successfully detached device vdb from instance 44d4794d-91c4-4eb6-a752-37f587f2b420 from the persistent domain config.
Nov 08 04:04:04 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 44d4794d-91c4-4eb6-a752-37f587f2b420 from the live domain config. {{(pid=75014) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 04:04:04 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:04:04 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:04:04 user nova-compute[75014]:   <source dev="/dev/sdh"/>
Nov 08 04:04:04 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:04:04 user nova-compute[75014]:   <serial>24d32672-c667-4adb-84b1-0dece53e7d7b</serial>
Nov 08 04:04:04 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 04:04:04 user nova-compute[75014]: </disk>
Nov 08 04:04:04 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:04:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 44d4794d-91c4-4eb6-a752-37f587f2b420 {{(pid=75014) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 04:04:05 user nova-compute[75014]: DEBUG nova.compute.manager [req-b76d6b7e-bf05-4d87-bc89-c8cf0a7dc739 req-f8929936-f953-4be6-b28b-a3ac3c34cd14 service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Received event network-changed-37918aae-d92b-43c0-8477-1355ac936ab0 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:04:05 user nova-compute[75014]: DEBUG nova.compute.manager [req-b76d6b7e-bf05-4d87-bc89-c8cf0a7dc739 req-f8929936-f953-4be6-b28b-a3ac3c34cd14 service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Refreshing instance network info cache due to event network-changed-37918aae-d92b-43c0-8477-1355ac936ab0. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:04:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b76d6b7e-bf05-4d87-bc89-c8cf0a7dc739 req-f8929936-f953-4be6-b28b-a3ac3c34cd14 service nova] Acquiring lock "refresh_cache-44d4794d-91c4-4eb6-a752-37f587f2b420" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:04:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b76d6b7e-bf05-4d87-bc89-c8cf0a7dc739 req-f8929936-f953-4be6-b28b-a3ac3c34cd14 service nova] Acquired lock "refresh_cache-44d4794d-91c4-4eb6-a752-37f587f2b420" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:04:05 user nova-compute[75014]: DEBUG nova.network.neutron [req-b76d6b7e-bf05-4d87-bc89-c8cf0a7dc739 req-f8929936-f953-4be6-b28b-a3ac3c34cd14 service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Refreshing network info cache for port 37918aae-d92b-43c0-8477-1355ac936ab0 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:04:05 user nova-compute[75014]: DEBUG nova.network.neutron [req-b76d6b7e-bf05-4d87-bc89-c8cf0a7dc739 req-f8929936-f953-4be6-b28b-a3ac3c34cd14 service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Updated VIF entry in instance network info cache for port 37918aae-d92b-43c0-8477-1355ac936ab0. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:04:05 user nova-compute[75014]: DEBUG nova.network.neutron [req-b76d6b7e-bf05-4d87-bc89-c8cf0a7dc739 req-f8929936-f953-4be6-b28b-a3ac3c34cd14 service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Updating instance_info_cache with network_info: [{"id": "37918aae-d92b-43c0-8477-1355ac936ab0", "address": "fa:16:3e:43:25:9f", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37918aae-d9", "ovs_interfaceid": "37918aae-d92b-43c0-8477-1355ac936ab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:04:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b76d6b7e-bf05-4d87-bc89-c8cf0a7dc739 req-f8929936-f953-4be6-b28b-a3ac3c34cd14 service nova] Releasing lock "refresh_cache-44d4794d-91c4-4eb6-a752-37f587f2b420" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:04:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "36a4109b-f239-48ce-ad49-e640a12a73bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:04:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "36a4109b-f239-48ce-ad49-e640a12a73bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:04:21 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:21 user nova-compute[75014]: DEBUG nova.compute.manager [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 04:04:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:04:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:04:21 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 04:04:21 user nova-compute[75014]: INFO nova.compute.claims [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Claim successful on node user
Nov 08 04:04:21 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:04:21 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:04:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.687s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:04:22 user nova-compute[75014]: DEBUG nova.compute.manager [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 04:04:22 user nova-compute[75014]: DEBUG nova.compute.manager [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 04:04:22 user nova-compute[75014]: DEBUG nova.network.neutron [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 04:04:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:22 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 04:04:22 user nova-compute[75014]: DEBUG nova.compute.manager [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 04:04:22 user nova-compute[75014]: DEBUG nova.policy [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8398fcf62a014e7f943bff6fcc3f72f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9ecaed30ba4ad1a9d5eaca02633604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 04:04:22 user nova-compute[75014]: DEBUG nova.compute.manager [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 04:04:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 04:04:22 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Creating image(s)
Nov 08 04:04:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "/opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:04:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "/opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:04:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "/opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:04:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "781932ce-0bea-466f-95e0-066130d6c410" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:04:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "781932ce-0bea-466f-95e0-066130d6c410" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:04:22 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 04:04:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.208s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:04:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:04:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:04:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:04:22 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 04:04:22 user nova-compute[75014]: INFO nova.compute.claims [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Claim successful on node user
Nov 08 04:04:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.206s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk 1073741824" returned: 0 in 0.072s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:04:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG nova.objects.instance [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lazy-loading 'flavor' on Instance uuid 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.193s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Checking if we can resize image /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.230s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG nova.network.neutron [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Successfully created port: a575a382-2b45-4494-b351-0ace52e3588b {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Cannot resize image /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Ensure instance console log exists: /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:04:23 user nova-compute[75014]: INFO nova.compute.manager [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Attaching volume d2ac70b3-9ed2-426e-b818-09cb2dbe759e to /dev/vdb
Nov 08 04:04:23 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG os_brick.utils [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb97981-79ae-4388-82fd-c330f50547ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.807s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4226ee5f-de15-42f9-b0fc-c02ac8050d4f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.067s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[30dad5e6-505c-4d94-b9bf-9c8324c88a53]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d2dd0b-e5e8-4f36-908c-42f41b0fbdd0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG nova.network.neutron [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:04:23 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:04:23 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1ca6e1-1f52-4126-bcae-6337ac5b4e82]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG os_brick.utils [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] <== get_connector_properties: return (191ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Updating existing volume attachment record: b578240e-f195-4ce8-9bfb-83d53ad7f0a7 {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:04:23 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 04:04:23 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG nova.policy [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8794d413cb745f2b855a808c052c8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61b5c5a54c743f78e97623c26050864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 04:04:23 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Creating image(s)
Nov 08 04:04:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "/opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "/opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "/opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:23 user nova-compute[75014]: DEBUG nova.network.neutron [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Successfully updated port: a575a382-2b45-4494-b351-0ace52e3588b {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "refresh_cache-36a4109b-f239-48ce-ad49-e640a12a73bf" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquired lock "refresh_cache-36a4109b-f239-48ce-ad49-e640a12a73bf" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG nova.network.neutron [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG nova.compute.manager [req-0cd3caca-0d80-464d-808b-cdf675557d9c req-5f3f29d2-d01d-4738-ba59-27e3ee58a924 service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Received event network-changed-a575a382-2b45-4494-b351-0ace52e3588b {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG nova.compute.manager [req-0cd3caca-0d80-464d-808b-cdf675557d9c req-5f3f29d2-d01d-4738-ba59-27e3ee58a924 service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Refreshing instance network info cache due to event network-changed-a575a382-2b45-4494-b351-0ace52e3588b. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0cd3caca-0d80-464d-808b-cdf675557d9c req-5f3f29d2-d01d-4738-ba59-27e3ee58a924 service nova] Acquiring lock "refresh_cache-36a4109b-f239-48ce-ad49-e640a12a73bf" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.197s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG nova.network.neutron [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.211s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk 1073741824" returned: 0 in 0.054s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.192s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Checking if we can resize image /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG nova.network.neutron [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Successfully created port: 5b680c90-914d-4583-a698-dccacaff9987 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Cannot resize image /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Ensure instance console log exists: /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG nova.network.neutron [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Updating instance_info_cache with network_info: [{"id": "a575a382-2b45-4494-b351-0ace52e3588b", "address": "fa:16:3e:17:47:bd", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa575a382-2b", "ovs_interfaceid": "a575a382-2b45-4494-b351-0ace52e3588b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Releasing lock "refresh_cache-36a4109b-f239-48ce-ad49-e640a12a73bf" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG nova.compute.manager [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Instance network_info: |[{"id": "a575a382-2b45-4494-b351-0ace52e3588b", "address": "fa:16:3e:17:47:bd", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa575a382-2b", "ovs_interfaceid": "a575a382-2b45-4494-b351-0ace52e3588b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0cd3caca-0d80-464d-808b-cdf675557d9c req-5f3f29d2-d01d-4738-ba59-27e3ee58a924 service nova] Acquired lock "refresh_cache-36a4109b-f239-48ce-ad49-e640a12a73bf" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG nova.network.neutron [req-0cd3caca-0d80-464d-808b-cdf675557d9c req-5f3f29d2-d01d-4738-ba59-27e3ee58a924 service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Refreshing network info cache for port a575a382-2b45-4494-b351-0ace52e3588b {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Start _get_guest_xml network_info=[{"id": "a575a382-2b45-4494-b351-0ace52e3588b", "address": "fa:16:3e:17:47:bd", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa575a382-2b", "ovs_interfaceid": "a575a382-2b45-4494-b351-0ace52e3588b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:04:24 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:04:24 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:04:24 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:04:24 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-372983470',display_name='tempest-tempest.common.compute-instance-372983470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-372983470',id=29,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhheGyNzDlKZ2iBJ0DNzi5AYIcLl14TQHCatvNP3avHAzjaEguIvBGcBxNnOYp/JkyWAjVRAHcTHBiFLXLHVGrIzmoaj96sMdyVyHAw+f4ZhavFNOqzCWT3h0YxLOs+7g==',key_name='tempest-keypair-1837241282',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b9ecaed30ba4ad1a9d5eaca02633604',ramdisk_id='',reservation_id='r-prevyyvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-537496863',owner_user_name='tempest-ServerActionsTestOtherA-537496863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:04:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8398fcf62a014e7f943bff6fcc3f72f3',uuid=36a4109b-f239-48ce-ad49-e640a12a73bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a575a382-2b45-4494-b351-0ace52e3588b", "address": "fa:16:3e:17:47:bd", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa575a382-2b", "ovs_interfaceid": "a575a382-2b45-4494-b351-0ace52e3588b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Converting VIF {"id": "a575a382-2b45-4494-b351-0ace52e3588b", "address": "fa:16:3e:17:47:bd", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa575a382-2b", "ovs_interfaceid": "a575a382-2b45-4494-b351-0ace52e3588b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:47:bd,bridge_name='br-int',has_traffic_filtering=True,id=a575a382-2b45-4494-b351-0ace52e3588b,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa575a382-2b') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG nova.objects.instance [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lazy-loading 'pci_devices' on Instance uuid 36a4109b-f239-48ce-ad49-e640a12a73bf {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:04:25 user nova-compute[75014]:   <uuid>36a4109b-f239-48ce-ad49-e640a12a73bf</uuid>
Nov 08 04:04:25 user nova-compute[75014]:   <name>instance-0000001d</name>
Nov 08 04:04:25 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:04:25 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:04:25 user nova-compute[75014]:   <metadata>
Nov 08 04:04:25 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:04:25 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:04:25 user nova-compute[75014]:       <nova:name>tempest-tempest.common.compute-instance-372983470</nova:name>
Nov 08 04:04:25 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:04:24</nova:creationTime>
Nov 08 04:04:25 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:04:25 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:04:25 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:04:25 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:04:25 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:04:25 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:04:25 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:04:25 user nova-compute[75014]:       <nova:owner>
Nov 08 04:04:25 user nova-compute[75014]:         <nova:user uuid="8398fcf62a014e7f943bff6fcc3f72f3">tempest-ServerActionsTestOtherA-537496863-project-member</nova:user>
Nov 08 04:04:25 user nova-compute[75014]:         <nova:project uuid="7b9ecaed30ba4ad1a9d5eaca02633604">tempest-ServerActionsTestOtherA-537496863</nova:project>
Nov 08 04:04:25 user nova-compute[75014]:       </nova:owner>
Nov 08 04:04:25 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:04:25 user nova-compute[75014]:       <nova:ports>
Nov 08 04:04:25 user nova-compute[75014]:         <nova:port uuid="a575a382-2b45-4494-b351-0ace52e3588b">
Nov 08 04:04:25 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 04:04:25 user nova-compute[75014]:         </nova:port>
Nov 08 04:04:25 user nova-compute[75014]:       </nova:ports>
Nov 08 04:04:25 user nova-compute[75014]:     </nova:instance>
Nov 08 04:04:25 user nova-compute[75014]:   </metadata>
Nov 08 04:04:25 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:04:25 user nova-compute[75014]:     <system>
Nov 08 04:04:25 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:04:25 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:04:25 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:04:25 user nova-compute[75014]:       <entry name="serial">36a4109b-f239-48ce-ad49-e640a12a73bf</entry>
Nov 08 04:04:25 user nova-compute[75014]:       <entry name="uuid">36a4109b-f239-48ce-ad49-e640a12a73bf</entry>
Nov 08 04:04:25 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:04:25 user nova-compute[75014]:     </system>
Nov 08 04:04:25 user nova-compute[75014]:   </sysinfo>
Nov 08 04:04:25 user nova-compute[75014]:   <os>
Nov 08 04:04:25 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:04:25 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:04:25 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:04:25 user nova-compute[75014]:   </os>
Nov 08 04:04:25 user nova-compute[75014]:   <features>
Nov 08 04:04:25 user nova-compute[75014]:     <acpi/>
Nov 08 04:04:25 user nova-compute[75014]:     <apic/>
Nov 08 04:04:25 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:04:25 user nova-compute[75014]:   </features>
Nov 08 04:04:25 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:04:25 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:04:25 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:04:25 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:04:25 user nova-compute[75014]:   </clock>
Nov 08 04:04:25 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:04:25 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:04:25 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:04:25 user nova-compute[75014]:   </cpu>
Nov 08 04:04:25 user nova-compute[75014]:   <devices>
Nov 08 04:04:25 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 04:04:25 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 04:04:25 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk"/>
Nov 08 04:04:25 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:04:25 user nova-compute[75014]:     </disk>
Nov 08 04:04:25 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:04:25 user nova-compute[75014]:       <mac address="fa:16:3e:17:47:bd"/>
Nov 08 04:04:25 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:04:25 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:04:25 user nova-compute[75014]:       <target dev="tapa575a382-2b"/>
Nov 08 04:04:25 user nova-compute[75014]:     </interface>
Nov 08 04:04:25 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:04:25 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/console.log" append="off"/>
Nov 08 04:04:25 user nova-compute[75014]:     </serial>
Nov 08 04:04:25 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:04:25 user nova-compute[75014]:     <video>
Nov 08 04:04:25 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:04:25 user nova-compute[75014]:     </video>
Nov 08 04:04:25 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:04:25 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:04:25 user nova-compute[75014]:     </rng>
Nov 08 04:04:25 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:04:25 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:04:25 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:04:25 user nova-compute[75014]:     </memballoon>
Nov 08 04:04:25 user nova-compute[75014]:   </devices>
Nov 08 04:04:25 user nova-compute[75014]: </domain>
Nov 08 04:04:25 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-372983470',display_name='tempest-tempest.common.compute-instance-372983470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-372983470',id=29,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhheGyNzDlKZ2iBJ0DNzi5AYIcLl14TQHCatvNP3avHAzjaEguIvBGcBxNnOYp/JkyWAjVRAHcTHBiFLXLHVGrIzmoaj96sMdyVyHAw+f4ZhavFNOqzCWT3h0YxLOs+7g==',key_name='tempest-keypair-1837241282',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b9ecaed30ba4ad1a9d5eaca02633604',ramdisk_id='',reservation_id='r-prevyyvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-537496863',owner_user_name='tempest-ServerActionsTestOtherA-537496863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:04:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8398fcf62a014e7f943bff6fcc3f72f3',uuid=36a4109b-f239-48ce-ad49-e640a12a73bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a575a382-2b45-4494-b351-0ace52e3588b", "address": "fa:16:3e:17:47:bd", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa575a382-2b", "ovs_interfaceid": "a575a382-2b45-4494-b351-0ace52e3588b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Converting VIF {"id": "a575a382-2b45-4494-b351-0ace52e3588b", "address": "fa:16:3e:17:47:bd", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa575a382-2b", "ovs_interfaceid": "a575a382-2b45-4494-b351-0ace52e3588b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:47:bd,bridge_name='br-int',has_traffic_filtering=True,id=a575a382-2b45-4494-b351-0ace52e3588b,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa575a382-2b') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG os_vif [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:47:bd,bridge_name='br-int',has_traffic_filtering=True,id=a575a382-2b45-4494-b351-0ace52e3588b,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa575a382-2b') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ea095c7-f1bc-5553-96e3-c3f46403154b', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa575a382-2b, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa575a382-2b, col_values=(('qos', UUID('99f20c2a-85ed-4479-9e9a-5f80c1025881')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa575a382-2b, col_values=(('external_ids', {'iface-id': 'a575a382-2b45-4494-b351-0ace52e3588b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:47:bd', 'vm-uuid': '36a4109b-f239-48ce-ad49-e640a12a73bf'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:25 user nova-compute[75014]: INFO os_vif [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:47:bd,bridge_name='br-int',has_traffic_filtering=True,id=a575a382-2b45-4494-b351-0ace52e3588b,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa575a382-2b')
Nov 08 04:04:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] No VIF found with MAC fa:16:3e:17:47:bd, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:04:25 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 44d4794d-91c4-4eb6-a752-37f587f2b420 is timed out.
Nov 08 04:04:25 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Successfully detached device vdb from instance 44d4794d-91c4-4eb6-a752-37f587f2b420 from the live domain config.
Nov 08 04:04:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZwFESguO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:04:25 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:04:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a56fb0-2afd-4cf1-b9af-b96a26c1361a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:04:25 user nova-compute[75014]: No targets found.
Nov 08 04:04:25 user nova-compute[75014]: iSNS:
Nov 08 04:04:25 user nova-compute[75014]: No targets found.
Nov 08 04:04:25 user nova-compute[75014]: STATIC:
Nov 08 04:04:25 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908
Nov 08 04:04:25 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:04:25 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:04:25 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec
Nov 08 04:04:25 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:04:25 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:04:25 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00
Nov 08 04:04:25 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:04:25 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:04:25 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:04:25 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:04:25 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:04:25 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a
Nov 08 04:04:25 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:04:25 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:04:25 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b
Nov 08 04:04:25 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:04:25 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:04:25 user nova-compute[75014]: FIRMWARE:
Nov 08 04:04:25 user nova-compute[75014]: No targets found.
Nov 08 04:04:25 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:04:25 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:04:25 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3a339a-6dbf-47c6-8c91-f4054ce1d432]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93f90b2-bc2d-4204-8995-2e6899edbdf0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:04:25 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:04:25 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:04:25 user nova-compute[75014]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)
Nov 08 04:04:25 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:04:25 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:04:25 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:04:25 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:04:25 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:04:25 user nova-compute[75014]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b (non-flash)
Nov 08 04:04:25 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:04:25 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:04:25 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f040063c1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b'): ({'sdh'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Removing single pathed devices sdh {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ac5b2c-b70d-45b6-9abd-636c99389117]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.031s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d243168-8e28-4bca-ac3b-4f063e989200]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Flushing IO for device /dev/sdh {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b0ff41-0a93-4784-9de9-fb8371ef54df]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.050s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a980dd16-e570-4309-9a78-697b4394207e]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] SCSI volumes sdh have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG nova.network.neutron [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Successfully updated port: 5b680c90-914d-4583-a698-dccacaff9987 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG nova.network.neutron [req-0cd3caca-0d80-464d-808b-cdf675557d9c req-5f3f29d2-d01d-4738-ba59-27e3ee58a924 service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Updated VIF entry in instance network info cache for port a575a382-2b45-4494-b351-0ace52e3588b. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG nova.network.neutron [req-0cd3caca-0d80-464d-808b-cdf675557d9c req-5f3f29d2-d01d-4738-ba59-27e3ee58a924 service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Updating instance_info_cache with network_info: [{"id": "a575a382-2b45-4494-b351-0ace52e3588b", "address": "fa:16:3e:17:47:bd", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa575a382-2b", "ovs_interfaceid": "a575a382-2b45-4494-b351-0ace52e3588b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3587d4-af8a-4c80-9f3d-12d9bf0b71a6]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0cd3caca-0d80-464d-808b-cdf675557d9c req-5f3f29d2-d01d-4738-ba59-27e3ee58a924 service nova] Releasing lock "refresh_cache-36a4109b-f239-48ce-ad49-e640a12a73bf" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "refresh_cache-781932ce-0bea-466f-95e0-066130d6c410" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquired lock "refresh_cache-781932ce-0bea-466f-95e0-066130d6c410" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG nova.network.neutron [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG nova.compute.manager [req-c0abdbb5-c7bb-4bc2-b160-4942ac70557a req-93787ff3-d2dd-4f61-9fee-2a83afae87f4 service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Received event network-changed-5b680c90-914d-4583-a698-dccacaff9987 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG nova.compute.manager [req-c0abdbb5-c7bb-4bc2-b160-4942ac70557a req-93787ff3-d2dd-4f61-9fee-2a83afae87f4 service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Refreshing instance network info cache due to event network-changed-5b680c90-914d-4583-a698-dccacaff9987. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c0abdbb5-c7bb-4bc2-b160-4942ac70557a req-93787ff3-d2dd-4f61-9fee-2a83afae87f4 service nova] Acquiring lock "refresh_cache-781932ce-0bea-466f-95e0-066130d6c410" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4808e2-450f-4d2c-be6f-fae484a14171]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b, portal: 172.16.0.220,3260]
Nov 08 04:04:25 user nova-compute[75014]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b, portal: 172.16.0.220,3260] successful.
Nov 08 04:04:25 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG nova.network.neutron [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d32672-c667-4adb-84b1-0dece53e7d7b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[764db232-c9fe-41ef-9e82-ae179653f3f9]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] <== disconnect_volume: return (405ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG nova.network.neutron [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Updating instance_info_cache with network_info: [{"id": "5b680c90-914d-4583-a698-dccacaff9987", "address": "fa:16:3e:48:9a:fe", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b680c90-91", "ovs_interfaceid": "5b680c90-914d-4583-a698-dccacaff9987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Releasing lock "refresh_cache-781932ce-0bea-466f-95e0-066130d6c410" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Instance network_info: |[{"id": "5b680c90-914d-4583-a698-dccacaff9987", "address": "fa:16:3e:48:9a:fe", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b680c90-91", "ovs_interfaceid": "5b680c90-914d-4583-a698-dccacaff9987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c0abdbb5-c7bb-4bc2-b160-4942ac70557a req-93787ff3-d2dd-4f61-9fee-2a83afae87f4 service nova] Acquired lock "refresh_cache-781932ce-0bea-466f-95e0-066130d6c410" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG nova.network.neutron [req-c0abdbb5-c7bb-4bc2-b160-4942ac70557a req-93787ff3-d2dd-4f61-9fee-2a83afae87f4 service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Refreshing network info cache for port 5b680c90-914d-4583-a698-dccacaff9987 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Start _get_guest_xml network_info=[{"id": "5b680c90-914d-4583-a698-dccacaff9987", "address": "fa:16:3e:48:9a:fe", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b680c90-91", "ovs_interfaceid": "5b680c90-914d-4583-a698-dccacaff9987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:04:25 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:04:25 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:04:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:04:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:04:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1668777333',display_name='tempest-AttachVolumeTestJSON-server-1668777333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1668777333',id=30,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6mnajMRsnB5A1jMf0Mqu/aGiRIJo9flQ+tedJW4Ejb4b/2emSY8dSQLEz7A16dKqzr7/OWo32j5VNwQAstah+AeC8v3Pb8Vhpq9T/r/uwJR3q73i8uI1OSr10mvZVNRA==',key_name='tempest-keypair-919667976',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b61b5c5a54c743f78e97623c26050864',ramdisk_id='',reservation_id='r-k47t6zf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1095291946',owner_user_name='tempest-AttachVolumeTestJSON-1095291946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8794d413cb745f2b855a808c052c8fd',uuid=781932ce-0bea-466f-95e0-066130d6c410,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b680c90-914d-4583-a698-dccacaff9987", "address": "fa:16:3e:48:9a:fe", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b680c90-91", "ovs_interfaceid": "5b680c90-914d-4583-a698-dccacaff9987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Converting VIF {"id": "5b680c90-914d-4583-a698-dccacaff9987", "address": "fa:16:3e:48:9a:fe", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b680c90-91", "ovs_interfaceid": "5b680c90-914d-4583-a698-dccacaff9987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:9a:fe,bridge_name='br-int',has_traffic_filtering=True,id=5b680c90-914d-4583-a698-dccacaff9987,network=Network(b7df3975-2e50-4d96-8a34-26abf02bea76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b680c90-91') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG nova.objects.instance [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lazy-loading 'pci_devices' on Instance uuid 781932ce-0bea-466f-95e0-066130d6c410 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:04:26 user nova-compute[75014]:   <uuid>781932ce-0bea-466f-95e0-066130d6c410</uuid>
Nov 08 04:04:26 user nova-compute[75014]:   <name>instance-0000001e</name>
Nov 08 04:04:26 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:04:26 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:04:26 user nova-compute[75014]:   <metadata>
Nov 08 04:04:26 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:04:26 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:04:26 user nova-compute[75014]:       <nova:name>tempest-AttachVolumeTestJSON-server-1668777333</nova:name>
Nov 08 04:04:26 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:04:25</nova:creationTime>
Nov 08 04:04:26 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:04:26 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:04:26 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:04:26 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:04:26 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:04:26 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:04:26 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:04:26 user nova-compute[75014]:       <nova:owner>
Nov 08 04:04:26 user nova-compute[75014]:         <nova:user uuid="f8794d413cb745f2b855a808c052c8fd">tempest-AttachVolumeTestJSON-1095291946-project-member</nova:user>
Nov 08 04:04:26 user nova-compute[75014]:         <nova:project uuid="b61b5c5a54c743f78e97623c26050864">tempest-AttachVolumeTestJSON-1095291946</nova:project>
Nov 08 04:04:26 user nova-compute[75014]:       </nova:owner>
Nov 08 04:04:26 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:04:26 user nova-compute[75014]:       <nova:ports>
Nov 08 04:04:26 user nova-compute[75014]:         <nova:port uuid="5b680c90-914d-4583-a698-dccacaff9987">
Nov 08 04:04:26 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 04:04:26 user nova-compute[75014]:         </nova:port>
Nov 08 04:04:26 user nova-compute[75014]:       </nova:ports>
Nov 08 04:04:26 user nova-compute[75014]:     </nova:instance>
Nov 08 04:04:26 user nova-compute[75014]:   </metadata>
Nov 08 04:04:26 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:04:26 user nova-compute[75014]:     <system>
Nov 08 04:04:26 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:04:26 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:04:26 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:04:26 user nova-compute[75014]:       <entry name="serial">781932ce-0bea-466f-95e0-066130d6c410</entry>
Nov 08 04:04:26 user nova-compute[75014]:       <entry name="uuid">781932ce-0bea-466f-95e0-066130d6c410</entry>
Nov 08 04:04:26 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:04:26 user nova-compute[75014]:     </system>
Nov 08 04:04:26 user nova-compute[75014]:   </sysinfo>
Nov 08 04:04:26 user nova-compute[75014]:   <os>
Nov 08 04:04:26 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:04:26 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:04:26 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:04:26 user nova-compute[75014]:   </os>
Nov 08 04:04:26 user nova-compute[75014]:   <features>
Nov 08 04:04:26 user nova-compute[75014]:     <acpi/>
Nov 08 04:04:26 user nova-compute[75014]:     <apic/>
Nov 08 04:04:26 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:04:26 user nova-compute[75014]:   </features>
Nov 08 04:04:26 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:04:26 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:04:26 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:04:26 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:04:26 user nova-compute[75014]:   </clock>
Nov 08 04:04:26 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:04:26 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:04:26 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:04:26 user nova-compute[75014]:   </cpu>
Nov 08 04:04:26 user nova-compute[75014]:   <devices>
Nov 08 04:04:26 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 04:04:26 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 04:04:26 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk"/>
Nov 08 04:04:26 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:04:26 user nova-compute[75014]:     </disk>
Nov 08 04:04:26 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:04:26 user nova-compute[75014]:       <mac address="fa:16:3e:48:9a:fe"/>
Nov 08 04:04:26 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:04:26 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:04:26 user nova-compute[75014]:       <target dev="tap5b680c90-91"/>
Nov 08 04:04:26 user nova-compute[75014]:     </interface>
Nov 08 04:04:26 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:04:26 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/console.log" append="off"/>
Nov 08 04:04:26 user nova-compute[75014]:     </serial>
Nov 08 04:04:26 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:04:26 user nova-compute[75014]:     <video>
Nov 08 04:04:26 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:04:26 user nova-compute[75014]:     </video>
Nov 08 04:04:26 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:04:26 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:04:26 user nova-compute[75014]:     </rng>
Nov 08 04:04:26 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:04:26 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:04:26 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:04:26 user nova-compute[75014]:     </memballoon>
Nov 08 04:04:26 user nova-compute[75014]:   </devices>
Nov 08 04:04:26 user nova-compute[75014]: </domain>
Nov 08 04:04:26 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:04:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1668777333',display_name='tempest-AttachVolumeTestJSON-server-1668777333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1668777333',id=30,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6mnajMRsnB5A1jMf0Mqu/aGiRIJo9flQ+tedJW4Ejb4b/2emSY8dSQLEz7A16dKqzr7/OWo32j5VNwQAstah+AeC8v3Pb8Vhpq9T/r/uwJR3q73i8uI1OSr10mvZVNRA==',key_name='tempest-keypair-919667976',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b61b5c5a54c743f78e97623c26050864',ramdisk_id='',reservation_id='r-k47t6zf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1095291946',owner_user_name='tempest-AttachVolumeTestJSON-1095291946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8794d413cb745f2b855a808c052c8fd',uuid=781932ce-0bea-466f-95e0-066130d6c410,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b680c90-914d-4583-a698-dccacaff9987", "address": "fa:16:3e:48:9a:fe", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b680c90-91", "ovs_interfaceid": "5b680c90-914d-4583-a698-dccacaff9987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Converting VIF {"id": "5b680c90-914d-4583-a698-dccacaff9987", "address": "fa:16:3e:48:9a:fe", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b680c90-91", "ovs_interfaceid": "5b680c90-914d-4583-a698-dccacaff9987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:9a:fe,bridge_name='br-int',has_traffic_filtering=True,id=5b680c90-914d-4583-a698-dccacaff9987,network=Network(b7df3975-2e50-4d96-8a34-26abf02bea76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b680c90-91') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG os_vif [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:9a:fe,bridge_name='br-int',has_traffic_filtering=True,id=5b680c90-914d-4583-a698-dccacaff9987,network=Network(b7df3975-2e50-4d96-8a34-26abf02bea76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b680c90-91') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7dc1abc2-ddd1-5964-9fb6-60149b0dc5e0', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b680c90-91, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b680c90-91, col_values=(('qos', UUID('28dd6e0c-5124-4258-829f-11c48b4833f6')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b680c90-91, col_values=(('external_ids', {'iface-id': '5b680c90-914d-4583-a698-dccacaff9987', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:9a:fe', 'vm-uuid': '781932ce-0bea-466f-95e0-066130d6c410'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:26 user nova-compute[75014]: INFO os_vif [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:9a:fe,bridge_name='br-int',has_traffic_filtering=True,id=5b680c90-914d-4583-a698-dccacaff9987,network=Network(b7df3975-2e50-4d96-8a34-26abf02bea76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b680c90-91')
Nov 08 04:04:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] No VIF found with MAC fa:16:3e:48:9a:fe, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG nova.network.neutron [req-c0abdbb5-c7bb-4bc2-b160-4942ac70557a req-93787ff3-d2dd-4f61-9fee-2a83afae87f4 service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Updated VIF entry in instance network info cache for port 5b680c90-914d-4583-a698-dccacaff9987. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG nova.network.neutron [req-c0abdbb5-c7bb-4bc2-b160-4942ac70557a req-93787ff3-d2dd-4f61-9fee-2a83afae87f4 service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Updating instance_info_cache with network_info: [{"id": "5b680c90-914d-4583-a698-dccacaff9987", "address": "fa:16:3e:48:9a:fe", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b680c90-91", "ovs_interfaceid": "5b680c90-914d-4583-a698-dccacaff9987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c0abdbb5-c7bb-4bc2-b160-4942ac70557a req-93787ff3-d2dd-4f61-9fee-2a83afae87f4 service nova] Releasing lock "refresh_cache-781932ce-0bea-466f-95e0-066130d6c410" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG nova.objects.instance [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lazy-loading 'flavor' on Instance uuid 44d4794d-91c4-4eb6-a752-37f587f2b420 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:04:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-a609c35b-6708-4161-8672-fa2086184520 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "44d4794d-91c4-4eb6-a752-37f587f2b420" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.484s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:04:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:27 user nova-compute[75014]: DEBUG nova.compute.manager [req-d2a7be90-edeb-4d49-8885-20bf58599658 req-80123977-1a69-47b8-96c1-2a227ec3e231 service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Received event network-vif-plugged-a575a382-2b45-4494-b351-0ace52e3588b {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:04:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d2a7be90-edeb-4d49-8885-20bf58599658 req-80123977-1a69-47b8-96c1-2a227ec3e231 service nova] Acquiring lock "36a4109b-f239-48ce-ad49-e640a12a73bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:04:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d2a7be90-edeb-4d49-8885-20bf58599658 req-80123977-1a69-47b8-96c1-2a227ec3e231 service nova] Lock "36a4109b-f239-48ce-ad49-e640a12a73bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:04:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d2a7be90-edeb-4d49-8885-20bf58599658 req-80123977-1a69-47b8-96c1-2a227ec3e231 service nova] Lock "36a4109b-f239-48ce-ad49-e640a12a73bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:04:27 user nova-compute[75014]: DEBUG nova.compute.manager [req-d2a7be90-edeb-4d49-8885-20bf58599658 req-80123977-1a69-47b8-96c1-2a227ec3e231 service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] No waiting events found dispatching network-vif-plugged-a575a382-2b45-4494-b351-0ace52e3588b {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:04:27 user nova-compute[75014]: WARNING nova.compute.manager [req-d2a7be90-edeb-4d49-8885-20bf58599658 req-80123977-1a69-47b8-96c1-2a227ec3e231 service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Received unexpected event network-vif-plugged-a575a382-2b45-4494-b351-0ace52e3588b for instance with vm_state building and task_state spawning.
Nov 08 04:04:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:28 user nova-compute[75014]: DEBUG nova.compute.manager [req-4cb0e9c4-ad82-46d8-b14a-8a0ea8e1dc64 req-631f057b-2b7b-454d-b9f2-c886615f1d9d service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Received event network-vif-plugged-5b680c90-914d-4583-a698-dccacaff9987 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:04:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4cb0e9c4-ad82-46d8-b14a-8a0ea8e1dc64 req-631f057b-2b7b-454d-b9f2-c886615f1d9d service nova] Acquiring lock "781932ce-0bea-466f-95e0-066130d6c410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:04:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4cb0e9c4-ad82-46d8-b14a-8a0ea8e1dc64 req-631f057b-2b7b-454d-b9f2-c886615f1d9d service nova] Lock "781932ce-0bea-466f-95e0-066130d6c410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:04:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4cb0e9c4-ad82-46d8-b14a-8a0ea8e1dc64 req-631f057b-2b7b-454d-b9f2-c886615f1d9d service nova] Lock "781932ce-0bea-466f-95e0-066130d6c410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:04:28 user nova-compute[75014]: DEBUG nova.compute.manager [req-4cb0e9c4-ad82-46d8-b14a-8a0ea8e1dc64 req-631f057b-2b7b-454d-b9f2-c886615f1d9d service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] No waiting events found dispatching network-vif-plugged-5b680c90-914d-4583-a698-dccacaff9987 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:04:28 user nova-compute[75014]: WARNING nova.compute.manager [req-4cb0e9c4-ad82-46d8-b14a-8a0ea8e1dc64 req-631f057b-2b7b-454d-b9f2-c886615f1d9d service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Received unexpected event network-vif-plugged-5b680c90-914d-4583-a698-dccacaff9987 for instance with vm_state building and task_state spawning.
Nov 08 04:04:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:29 user nova-compute[75014]: DEBUG nova.compute.manager [req-bf21c5ac-490a-4fcb-b7c9-0eb202e1a185 req-c456ac85-b29a-463f-81ee-b207da99334d service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Received event network-vif-plugged-a575a382-2b45-4494-b351-0ace52e3588b {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:04:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-bf21c5ac-490a-4fcb-b7c9-0eb202e1a185 req-c456ac85-b29a-463f-81ee-b207da99334d service nova] Acquiring lock "36a4109b-f239-48ce-ad49-e640a12a73bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:04:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-bf21c5ac-490a-4fcb-b7c9-0eb202e1a185 req-c456ac85-b29a-463f-81ee-b207da99334d service nova] Lock "36a4109b-f239-48ce-ad49-e640a12a73bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:04:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-bf21c5ac-490a-4fcb-b7c9-0eb202e1a185 req-c456ac85-b29a-463f-81ee-b207da99334d service nova] Lock "36a4109b-f239-48ce-ad49-e640a12a73bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:04:29 user nova-compute[75014]: DEBUG nova.compute.manager [req-bf21c5ac-490a-4fcb-b7c9-0eb202e1a185 req-c456ac85-b29a-463f-81ee-b207da99334d service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] No waiting events found dispatching network-vif-plugged-a575a382-2b45-4494-b351-0ace52e3588b {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:04:29 user nova-compute[75014]: WARNING nova.compute.manager [req-bf21c5ac-490a-4fcb-b7c9-0eb202e1a185 req-c456ac85-b29a-463f-81ee-b207da99334d service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Received unexpected event network-vif-plugged-a575a382-2b45-4494-b351-0ace52e3588b for instance with vm_state building and task_state spawning.
Nov 08 04:04:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:30 user nova-compute[75014]: DEBUG nova.compute.manager [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:04:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 04:04:30 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Instance spawned successfully.
Nov 08 04:04:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 04:04:30 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:04:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 04:04:30 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Instance spawned successfully.
Nov 08 04:04:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 04:04:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:04:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:04:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:04:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:04:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:04:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:04:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:04:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:04:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:04:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:04:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:04:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:04:31 user nova-compute[75014]: INFO nova.compute.manager [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Took 8.58 seconds to spawn the instance on the hypervisor.
Nov 08 04:04:31 user nova-compute[75014]: DEBUG nova.compute.manager [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:04:31 user nova-compute[75014]: INFO nova.compute.manager [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Took 7.14 seconds to spawn the instance on the hypervisor.
Nov 08 04:04:31 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:04:31 user nova-compute[75014]: DEBUG nova.compute.manager [req-923a7c5d-aa9d-4350-98cb-58006b4f9db6 req-bb99fdc0-0987-482a-9c7c-b4e6f1978542 service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Received event network-vif-plugged-5b680c90-914d-4583-a698-dccacaff9987 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:04:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-923a7c5d-aa9d-4350-98cb-58006b4f9db6 req-bb99fdc0-0987-482a-9c7c-b4e6f1978542 service nova] Acquiring lock "781932ce-0bea-466f-95e0-066130d6c410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:04:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-923a7c5d-aa9d-4350-98cb-58006b4f9db6 req-bb99fdc0-0987-482a-9c7c-b4e6f1978542 service nova] Lock "781932ce-0bea-466f-95e0-066130d6c410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:04:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-923a7c5d-aa9d-4350-98cb-58006b4f9db6 req-bb99fdc0-0987-482a-9c7c-b4e6f1978542 service nova] Lock "781932ce-0bea-466f-95e0-066130d6c410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:04:31 user nova-compute[75014]: DEBUG nova.compute.manager [req-923a7c5d-aa9d-4350-98cb-58006b4f9db6 req-bb99fdc0-0987-482a-9c7c-b4e6f1978542 service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] No waiting events found dispatching network-vif-plugged-5b680c90-914d-4583-a698-dccacaff9987 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:04:31 user nova-compute[75014]: WARNING nova.compute.manager [req-923a7c5d-aa9d-4350-98cb-58006b4f9db6 req-bb99fdc0-0987-482a-9c7c-b4e6f1978542 service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Received unexpected event network-vif-plugged-5b680c90-914d-4583-a698-dccacaff9987 for instance with vm_state building and task_state spawning.
Nov 08 04:04:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:31 user nova-compute[75014]: INFO nova.compute.manager [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Took 8.73 seconds to build instance.
Nov 08 04:04:31 user nova-compute[75014]: INFO nova.compute.manager [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Took 10.15 seconds to build instance.
Nov 08 04:04:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7fec8ed6-2515-4659-aa0d-b5f94327f476 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "781932ce-0bea-466f-95e0-066130d6c410" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.879s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:04:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8d948f36-0075-4597-ab02-89a28fccf2db tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "36a4109b-f239-48ce-ad49-e640a12a73bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.258s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:04:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:33 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:04:33 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:04:33 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:04:33 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:04:33 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:04:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-655fe5eb-1271-4b9f-a5a6-6342bd012a69" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:04:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-655fe5eb-1271-4b9f-a5a6-6342bd012a69" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:04:33 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 04:04:34 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Updating instance_info_cache with network_info: [{"id": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "address": "fa:16:3e:65:33:45", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9034975-10", "ovs_interfaceid": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:04:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-655fe5eb-1271-4b9f-a5a6-6342bd012a69" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:04:34 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 04:04:34 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:04:34 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:04:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:37 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:04:37 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:04:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "75d85e9b-5364-4838-bd6a-c044b6290e7f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:04:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "75d85e9b-5364-4838-bd6a-c044b6290e7f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:04:38 user nova-compute[75014]: DEBUG nova.compute.manager [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 04:04:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:04:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:04:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 04:04:38 user nova-compute[75014]: INFO nova.compute.claims [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Claim successful on node user
Nov 08 04:04:38 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:04:38 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:04:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:04:38 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:04:38 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:04:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.639s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:04:38 user nova-compute[75014]: DEBUG nova.compute.manager [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 04:04:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.561s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:04:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:04:38 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:04:39 user nova-compute[75014]: DEBUG nova.compute.manager [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 04:04:39 user nova-compute[75014]: DEBUG nova.network.neutron [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 04:04:39 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 04:04:39 user nova-compute[75014]: DEBUG nova.compute.manager [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 04:04:39 user nova-compute[75014]: DEBUG nova.policy [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c8c674d8b2cf49c08cf254a8095ef8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c9753cb588478a8a93182be3256674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 04:04:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:39 user nova-compute[75014]: DEBUG nova.compute.manager [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 04:04:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 04:04:39 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Creating image(s)
Nov 08 04:04:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "/opt/stack/data/nova/instances/75d85e9b-5364-4838-bd6a-c044b6290e7f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:04:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "/opt/stack/data/nova/instances/75d85e9b-5364-4838-bd6a-c044b6290e7f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:04:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "/opt/stack/data/nova/instances/75d85e9b-5364-4838-bd6a-c044b6290e7f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:04:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.220s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:04:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:04:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:04:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.219s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/75d85e9b-5364-4838-bd6a-c044b6290e7f/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/75d85e9b-5364-4838-bd6a-c044b6290e7f/disk 1073741824" returned: 0 in 0.059s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:04:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:39 user nova-compute[75014]: DEBUG nova.network.neutron [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Successfully created port: a54f4128-8b08-4c5a-baea-5e8de62a98d9 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 04:04:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.248s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:40 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Checking if we can resize image /opt/stack/data/nova/instances/75d85e9b-5364-4838-bd6a-c044b6290e7f/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 04:04:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75d85e9b-5364-4838-bd6a-c044b6290e7f/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75d85e9b-5364-4838-bd6a-c044b6290e7f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:40 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Cannot resize image /opt/stack/data/nova/instances/75d85e9b-5364-4838-bd6a-c044b6290e7f/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 04:04:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 04:04:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Ensure instance console log exists: /opt/stack/data/nova/instances/75d85e9b-5364-4838-bd6a-c044b6290e7f/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:04:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:04:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:04:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:04:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:40 user nova-compute[75014]: DEBUG nova.network.neutron [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Successfully updated port: a54f4128-8b08-4c5a-baea-5e8de62a98d9 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 04:04:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:40 user nova-compute[75014]: DEBUG nova.compute.manager [req-1a1dcaa2-46c7-4955-bdd9-64a31ceee0dd req-17e4e783-2201-4302-a4cc-76d253400af3 service nova] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Received event network-changed-a54f4128-8b08-4c5a-baea-5e8de62a98d9 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:04:40 user nova-compute[75014]: DEBUG nova.compute.manager [req-1a1dcaa2-46c7-4955-bdd9-64a31ceee0dd req-17e4e783-2201-4302-a4cc-76d253400af3 service nova] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Refreshing instance network info cache due to event network-changed-a54f4128-8b08-4c5a-baea-5e8de62a98d9. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:04:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1a1dcaa2-46c7-4955-bdd9-64a31ceee0dd req-17e4e783-2201-4302-a4cc-76d253400af3 service nova] Acquiring lock "refresh_cache-75d85e9b-5364-4838-bd6a-c044b6290e7f" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:04:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1a1dcaa2-46c7-4955-bdd9-64a31ceee0dd req-17e4e783-2201-4302-a4cc-76d253400af3 service nova] Acquired lock "refresh_cache-75d85e9b-5364-4838-bd6a-c044b6290e7f" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:04:40 user nova-compute[75014]: DEBUG nova.network.neutron [req-1a1dcaa2-46c7-4955-bdd9-64a31ceee0dd req-17e4e783-2201-4302-a4cc-76d253400af3 service nova] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Refreshing network info cache for port a54f4128-8b08-4c5a-baea-5e8de62a98d9 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:04:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "refresh_cache-75d85e9b-5364-4838-bd6a-c044b6290e7f" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:04:40 user nova-compute[75014]: DEBUG nova.network.neutron [req-1a1dcaa2-46c7-4955-bdd9-64a31ceee0dd req-17e4e783-2201-4302-a4cc-76d253400af3 service nova] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 04:04:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:40 user nova-compute[75014]: DEBUG nova.network.neutron [req-1a1dcaa2-46c7-4955-bdd9-64a31ceee0dd req-17e4e783-2201-4302-a4cc-76d253400af3 service nova] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1a1dcaa2-46c7-4955-bdd9-64a31ceee0dd req-17e4e783-2201-4302-a4cc-76d253400af3 service nova] Releasing lock "refresh_cache-75d85e9b-5364-4838-bd6a-c044b6290e7f" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquired lock "refresh_cache-75d85e9b-5364-4838-bd6a-c044b6290e7f" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG nova.network.neutron [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG nova.network.neutron [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG nova.network.neutron [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Updating instance_info_cache with network_info: [{"id": "a54f4128-8b08-4c5a-baea-5e8de62a98d9", "address": "fa:16:3e:95:e6:b4", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54f4128-8b", "ovs_interfaceid": "a54f4128-8b08-4c5a-baea-5e8de62a98d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Releasing lock "refresh_cache-75d85e9b-5364-4838-bd6a-c044b6290e7f" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG nova.compute.manager [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Instance network_info: |[{"id": "a54f4128-8b08-4c5a-baea-5e8de62a98d9", "address": "fa:16:3e:95:e6:b4", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54f4128-8b", "ovs_interfaceid": "a54f4128-8b08-4c5a-baea-5e8de62a98d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Start _get_guest_xml network_info=[{"id": "a54f4128-8b08-4c5a-baea-5e8de62a98d9", "address": "fa:16:3e:95:e6:b4", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54f4128-8b", "ovs_interfaceid": "a54f4128-8b08-4c5a-baea-5e8de62a98d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:04:41 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:04:41 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:04:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1234113545',display_name='tempest-AttachVolumeNegativeTest-server-1234113545',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1234113545',id=31,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOeu2AtvLK6FrNETpJ5N4KQZiSzu+6vZ4iYUzjnLvoLydQHcxdk+CvQJnRuhBw3dTRfgcNSpeNrwPowXSo8olNqcxCgAPsX73D8is+UqwWwetmKy3h5P9GJ4CQHbN19Fg==',key_name='tempest-keypair-454069840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1c9753cb588478a8a93182be3256674',ramdisk_id='',reservation_id='r-jjg004tq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1215701914',owner_user_name='tempest-AttachVolumeNegativeTest-1215701914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:04:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8c674d8b2cf49c08cf254a8095ef8ea',uuid=75d85e9b-5364-4838-bd6a-c044b6290e7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a54f4128-8b08-4c5a-baea-5e8de62a98d9", "address": "fa:16:3e:95:e6:b4", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54f4128-8b", "ovs_interfaceid": "a54f4128-8b08-4c5a-baea-5e8de62a98d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Converting VIF {"id": "a54f4128-8b08-4c5a-baea-5e8de62a98d9", "address": "fa:16:3e:95:e6:b4", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54f4128-8b", "ovs_interfaceid": "a54f4128-8b08-4c5a-baea-5e8de62a98d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:e6:b4,bridge_name='br-int',has_traffic_filtering=True,id=a54f4128-8b08-4c5a-baea-5e8de62a98d9,network=Network(f3d67270-d525-45d9-958c-a901d121d510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54f4128-8b') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG nova.objects.instance [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lazy-loading 'pci_devices' on Instance uuid 75d85e9b-5364-4838-bd6a-c044b6290e7f {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:04:41 user nova-compute[75014]:   <uuid>75d85e9b-5364-4838-bd6a-c044b6290e7f</uuid>
Nov 08 04:04:41 user nova-compute[75014]:   <name>instance-0000001f</name>
Nov 08 04:04:41 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:04:41 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:04:41 user nova-compute[75014]:   <metadata>
Nov 08 04:04:41 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:04:41 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:04:41 user nova-compute[75014]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1234113545</nova:name>
Nov 08 04:04:41 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:04:41</nova:creationTime>
Nov 08 04:04:41 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:04:41 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:04:41 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:04:41 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:04:41 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:04:41 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:04:41 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:04:41 user nova-compute[75014]:       <nova:owner>
Nov 08 04:04:41 user nova-compute[75014]:         <nova:user uuid="c8c674d8b2cf49c08cf254a8095ef8ea">tempest-AttachVolumeNegativeTest-1215701914-project-member</nova:user>
Nov 08 04:04:41 user nova-compute[75014]:         <nova:project uuid="f1c9753cb588478a8a93182be3256674">tempest-AttachVolumeNegativeTest-1215701914</nova:project>
Nov 08 04:04:41 user nova-compute[75014]:       </nova:owner>
Nov 08 04:04:41 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:04:41 user nova-compute[75014]:       <nova:ports>
Nov 08 04:04:41 user nova-compute[75014]:         <nova:port uuid="a54f4128-8b08-4c5a-baea-5e8de62a98d9">
Nov 08 04:04:41 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 04:04:41 user nova-compute[75014]:         </nova:port>
Nov 08 04:04:41 user nova-compute[75014]:       </nova:ports>
Nov 08 04:04:41 user nova-compute[75014]:     </nova:instance>
Nov 08 04:04:41 user nova-compute[75014]:   </metadata>
Nov 08 04:04:41 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:04:41 user nova-compute[75014]:     <system>
Nov 08 04:04:41 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:04:41 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:04:41 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:04:41 user nova-compute[75014]:       <entry name="serial">75d85e9b-5364-4838-bd6a-c044b6290e7f</entry>
Nov 08 04:04:41 user nova-compute[75014]:       <entry name="uuid">75d85e9b-5364-4838-bd6a-c044b6290e7f</entry>
Nov 08 04:04:41 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:04:41 user nova-compute[75014]:     </system>
Nov 08 04:04:41 user nova-compute[75014]:   </sysinfo>
Nov 08 04:04:41 user nova-compute[75014]:   <os>
Nov 08 04:04:41 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:04:41 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:04:41 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:04:41 user nova-compute[75014]:   </os>
Nov 08 04:04:41 user nova-compute[75014]:   <features>
Nov 08 04:04:41 user nova-compute[75014]:     <acpi/>
Nov 08 04:04:41 user nova-compute[75014]:     <apic/>
Nov 08 04:04:41 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:04:41 user nova-compute[75014]:   </features>
Nov 08 04:04:41 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:04:41 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:04:41 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:04:41 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:04:41 user nova-compute[75014]:   </clock>
Nov 08 04:04:41 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:04:41 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:04:41 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:04:41 user nova-compute[75014]:   </cpu>
Nov 08 04:04:41 user nova-compute[75014]:   <devices>
Nov 08 04:04:41 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 04:04:41 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 04:04:41 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/75d85e9b-5364-4838-bd6a-c044b6290e7f/disk"/>
Nov 08 04:04:41 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:04:41 user nova-compute[75014]:     </disk>
Nov 08 04:04:41 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:04:41 user nova-compute[75014]:       <mac address="fa:16:3e:95:e6:b4"/>
Nov 08 04:04:41 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:04:41 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:04:41 user nova-compute[75014]:       <target dev="tapa54f4128-8b"/>
Nov 08 04:04:41 user nova-compute[75014]:     </interface>
Nov 08 04:04:41 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:04:41 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/75d85e9b-5364-4838-bd6a-c044b6290e7f/console.log" append="off"/>
Nov 08 04:04:41 user nova-compute[75014]:     </serial>
Nov 08 04:04:41 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:04:41 user nova-compute[75014]:     <video>
Nov 08 04:04:41 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:04:41 user nova-compute[75014]:     </video>
Nov 08 04:04:41 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:04:41 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:04:41 user nova-compute[75014]:     </rng>
Nov 08 04:04:41 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:04:41 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:04:41 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:04:41 user nova-compute[75014]:     </memballoon>
Nov 08 04:04:41 user nova-compute[75014]:   </devices>
Nov 08 04:04:41 user nova-compute[75014]: </domain>
Nov 08 04:04:41 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1234113545',display_name='tempest-AttachVolumeNegativeTest-server-1234113545',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1234113545',id=31,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOeu2AtvLK6FrNETpJ5N4KQZiSzu+6vZ4iYUzjnLvoLydQHcxdk+CvQJnRuhBw3dTRfgcNSpeNrwPowXSo8olNqcxCgAPsX73D8is+UqwWwetmKy3h5P9GJ4CQHbN19Fg==',key_name='tempest-keypair-454069840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1c9753cb588478a8a93182be3256674',ramdisk_id='',reservation_id='r-jjg004tq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1215701914',owner_user_name='tempest-AttachVolumeNegativeTest-1215701914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:04:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8c674d8b2cf49c08cf254a8095ef8ea',uuid=75d85e9b-5364-4838-bd6a-c044b6290e7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a54f4128-8b08-4c5a-baea-5e8de62a98d9", "address": "fa:16:3e:95:e6:b4", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54f4128-8b", "ovs_interfaceid": "a54f4128-8b08-4c5a-baea-5e8de62a98d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Converting VIF {"id": "a54f4128-8b08-4c5a-baea-5e8de62a98d9", "address": "fa:16:3e:95:e6:b4", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54f4128-8b", "ovs_interfaceid": "a54f4128-8b08-4c5a-baea-5e8de62a98d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:e6:b4,bridge_name='br-int',has_traffic_filtering=True,id=a54f4128-8b08-4c5a-baea-5e8de62a98d9,network=Network(f3d67270-d525-45d9-958c-a901d121d510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54f4128-8b') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG os_vif [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:e6:b4,bridge_name='br-int',has_traffic_filtering=True,id=a54f4128-8b08-4c5a-baea-5e8de62a98d9,network=Network(f3d67270-d525-45d9-958c-a901d121d510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54f4128-8b') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cc311ff5-2ca3-5fed-9b4b-955ee2373242', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa54f4128-8b, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa54f4128-8b, col_values=(('qos', UUID('14fba53c-fbc1-48b0-9a12-9f4f57f1ed7c')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa54f4128-8b, col_values=(('external_ids', {'iface-id': 'a54f4128-8b08-4c5a-baea-5e8de62a98d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:e6:b4', 'vm-uuid': '75d85e9b-5364-4838-bd6a-c044b6290e7f'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:41 user nova-compute[75014]: INFO os_vif [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:e6:b4,bridge_name='br-int',has_traffic_filtering=True,id=a54f4128-8b08-4c5a-baea-5e8de62a98d9,network=Network(f3d67270-d525-45d9-958c-a901d121d510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54f4128-8b')
Nov 08 04:04:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] No VIF found with MAC fa:16:3e:95:e6:b4, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:04:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:04:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:04:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-926421ca-b308-4f6e-b35d-fcdffcb14a3d req-6f32e9a7-7460-4be9-9253-e62b262ba456 service nova] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Received event network-vif-plugged-a54f4128-8b08-4c5a-baea-5e8de62a98d9 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:04:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-926421ca-b308-4f6e-b35d-fcdffcb14a3d req-6f32e9a7-7460-4be9-9253-e62b262ba456 service nova] Acquiring lock "75d85e9b-5364-4838-bd6a-c044b6290e7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:04:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-926421ca-b308-4f6e-b35d-fcdffcb14a3d req-6f32e9a7-7460-4be9-9253-e62b262ba456 service nova] Lock "75d85e9b-5364-4838-bd6a-c044b6290e7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:04:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-926421ca-b308-4f6e-b35d-fcdffcb14a3d req-6f32e9a7-7460-4be9-9253-e62b262ba456 service nova] Lock "75d85e9b-5364-4838-bd6a-c044b6290e7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:04:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-926421ca-b308-4f6e-b35d-fcdffcb14a3d req-6f32e9a7-7460-4be9-9253-e62b262ba456 service nova] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] No waiting events found dispatching network-vif-plugged-a54f4128-8b08-4c5a-baea-5e8de62a98d9 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:04:43 user nova-compute[75014]: WARNING nova.compute.manager [req-926421ca-b308-4f6e-b35d-fcdffcb14a3d req-6f32e9a7-7460-4be9-9253-e62b262ba456 service nova] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Received unexpected event network-vif-plugged-a54f4128-8b08-4c5a-baea-5e8de62a98d9 for instance with vm_state building and task_state spawning.
Nov 08 04:04:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:44 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:04:44 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:04:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=7324MB free_disk=24.745529174804688GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:04:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:04:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:04:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9f205fe5-576f-4ef0-874b-1544c0307a7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:04:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 5bfa6580-e0fe-46b0-b497-8db67806113a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:04:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 8527ee40-fb8a-469b-9696-d7bde8cc96f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:04:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 655fe5eb-1271-4b9f-a5a6-6342bd012a69 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:04:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance bd153f84-98cd-4c6d-a7ab-5759b0b5bf55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:04:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:04:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance d4726cd1-51ea-41e2-ad36-be12b4d4c26b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:04:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 44d4794d-91c4-4eb6-a752-37f587f2b420 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:04:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance d555b6b3-86ec-40ae-aa20-48846b5157d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:04:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance c23c9e00-b782-4530-bb01-a7a167951c1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:04:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 0b3b62d9-2543-402b-bdb5-cac994b755c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:04:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 36a4109b-f239-48ce-ad49-e640a12a73bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:04:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 781932ce-0bea-466f-95e0-066130d6c410 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:04:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 75d85e9b-5364-4838-bd6a-c044b6290e7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:04:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:04:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:04:45 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:04:45 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:04:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:04:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.657s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:04:45 user nova-compute[75014]: DEBUG nova.compute.manager [req-950cc206-05be-4b8e-8145-0a981c788305 req-d8cd8a47-c106-4f81-9df6-5e161087e965 service nova] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Received event network-vif-plugged-a54f4128-8b08-4c5a-baea-5e8de62a98d9 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:04:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-950cc206-05be-4b8e-8145-0a981c788305 req-d8cd8a47-c106-4f81-9df6-5e161087e965 service nova] Acquiring lock "75d85e9b-5364-4838-bd6a-c044b6290e7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:04:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-950cc206-05be-4b8e-8145-0a981c788305 req-d8cd8a47-c106-4f81-9df6-5e161087e965 service nova] Lock "75d85e9b-5364-4838-bd6a-c044b6290e7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:04:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-950cc206-05be-4b8e-8145-0a981c788305 req-d8cd8a47-c106-4f81-9df6-5e161087e965 service nova] Lock "75d85e9b-5364-4838-bd6a-c044b6290e7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:04:45 user nova-compute[75014]: DEBUG nova.compute.manager [req-950cc206-05be-4b8e-8145-0a981c788305 req-d8cd8a47-c106-4f81-9df6-5e161087e965 service nova] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] No waiting events found dispatching network-vif-plugged-a54f4128-8b08-4c5a-baea-5e8de62a98d9 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:04:45 user nova-compute[75014]: WARNING nova.compute.manager [req-950cc206-05be-4b8e-8145-0a981c788305 req-d8cd8a47-c106-4f81-9df6-5e161087e965 service nova] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Received unexpected event network-vif-plugged-a54f4128-8b08-4c5a-baea-5e8de62a98d9 for instance with vm_state building and task_state spawning.
Nov 08 04:04:45 user nova-compute[75014]: DEBUG nova.compute.manager [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:04:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 04:04:45 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Instance spawned successfully.
Nov 08 04:04:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 04:04:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:04:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:04:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:04:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:04:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:04:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:04:45 user nova-compute[75014]: INFO nova.compute.manager [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Took 6.71 seconds to spawn the instance on the hypervisor.
Nov 08 04:04:45 user nova-compute[75014]: DEBUG nova.compute.manager [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:04:46 user nova-compute[75014]: INFO nova.compute.manager [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Took 7.80 seconds to build instance.
Nov 08 04:04:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b2789890-19ca-4c26-a0f6-6dd002a89d7f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "75d85e9b-5364-4838-bd6a-c044b6290e7f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.946s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:04:46 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgCGolzv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:04:50 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:04:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:04:50 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:04:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:04:50 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:04:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eecf152-0a34-45c3-960f-a27e64f13e68]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:04:50 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cc45d6-d2db-426b-8c07-b133c109ab64]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e] added
Nov 08 04:04:50 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67424a2-6745-454e-82ef-7e2b71a4d7db]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51ce1fd-7d25-4926-989a-8d2f3c8715f6]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pgCGolzv {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pgCGolzv" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62ae510-d80b-48b8-a8be-74a40dd9775f]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pgCGolzv'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[db906623-798b-4342-9159-1e73282f0c2d]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17a6b6a-a5a0-4d27-aa5e-df057f5404a3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:04:50 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:04:50 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:04:50 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:04:50 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:04:50 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:04:50 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:04:50 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:04:50 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:04:50 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:04:50 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:04:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:51 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9283953f-94c4-4c91-9275-ad53e3747c38]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:04:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e, portal: 172.16.0.220,3260]
Nov 08 04:04:51 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e, portal: 172.16.0.220,3260] successful.
Nov 08 04:04:51 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:04:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:51 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d851bc-959e-4a21-bb51-fbf3bdbc87ba]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:04:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:04:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:51 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[115d00f1-7f4d-453e-95c7-51779617f0c6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:04:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:04:51 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:04:51 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:04:51 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:04:51 user nova-compute[75014]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e (non-flash)
Nov 08 04:04:51 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:04:51 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:04:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:04:51 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:04:51 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:04:51 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:04:51 user nova-compute[75014]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e (non-flash)
Nov 08 04:04:51 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:04:51 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:04:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:04:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:04:51 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:04:51 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:04:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:51 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f967218a-ba60-4c7a-9d09-5a052490b6f7]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:04:51 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:04:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgCGolzv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:04:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:52 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:04:52 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '23364313263663533', 'path': '/dev/sdd'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:04:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364313263663533', 'path': '/dev/sdd'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:04:52 user nova-compute[75014]: DEBUG nova.objects.instance [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lazy-loading 'flavor' on Instance uuid 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:04:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 04:04:52 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:04:52 user nova-compute[75014]:   <source dev="/dev/sdd"/>
Nov 08 04:04:52 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:04:52 user nova-compute[75014]:   <serial>d2ac70b3-9ed2-426e-b818-09cb2dbe759e</serial>
Nov 08 04:04:52 user nova-compute[75014]: </disk>
Nov 08 04:04:52 user nova-compute[75014]:  {{(pid=75014) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 04:04:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:04:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:04:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] No VIF found with MAC fa:16:3e:8f:4a:4b, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:04:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-fb9b42c1-da10-4cf0-87b0-bcdd1ea111d1 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.445s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:04:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:04:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:04:55 user nova-compute[75014]: INFO nova.compute.manager [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Detaching volume d2ac70b3-9ed2-426e-b818-09cb2dbe759e
Nov 08 04:04:55 user nova-compute[75014]: INFO nova.virt.block_device [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Attempting to driver detach volume d2ac70b3-9ed2-426e-b818-09cb2dbe759e from mountpoint /dev/vdb
Nov 08 04:04:55 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Attempting to detach device vdb from instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d from the persistent domain config. {{(pid=75014) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 04:04:55 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:04:55 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:04:55 user nova-compute[75014]:   <source dev="/dev/sdd"/>
Nov 08 04:04:55 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:04:55 user nova-compute[75014]:   <serial>d2ac70b3-9ed2-426e-b818-09cb2dbe759e</serial>
Nov 08 04:04:55 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:04:55 user nova-compute[75014]: </disk>
Nov 08 04:04:55 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:04:55 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Successfully detached device vdb from instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d from the persistent domain config.
Nov 08 04:04:55 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d from the live domain config. {{(pid=75014) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 04:04:55 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:04:55 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:04:55 user nova-compute[75014]:   <source dev="/dev/sdd"/>
Nov 08 04:04:55 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:04:55 user nova-compute[75014]:   <serial>d2ac70b3-9ed2-426e-b818-09cb2dbe759e</serial>
Nov 08 04:04:55 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:04:55 user nova-compute[75014]: </disk>
Nov 08 04:04:55 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:04:55 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d {{(pid=75014) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 04:04:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:04:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquiring lock "1cb11358-b4c4-47f4-ba30-d967d523f98a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:04:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "1cb11358-b4c4-47f4-ba30-d967d523f98a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:04:58 user nova-compute[75014]: DEBUG nova.compute.manager [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 04:04:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:04:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:04:58 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 04:04:58 user nova-compute[75014]: INFO nova.compute.claims [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Claim successful on node user
Nov 08 04:04:59 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:04:59 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:04:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.772s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:04:59 user nova-compute[75014]: DEBUG nova.compute.manager [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 04:04:59 user nova-compute[75014]: DEBUG nova.compute.manager [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 04:04:59 user nova-compute[75014]: DEBUG nova.network.neutron [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 04:04:59 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 04:04:59 user nova-compute[75014]: DEBUG nova.compute.manager [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 04:04:59 user nova-compute[75014]: DEBUG nova.policy [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74a3234564994ff7a7c7fc6166e16aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5003c0e79d42248cd1ff8be29fe3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 04:04:59 user nova-compute[75014]: DEBUG nova.compute.manager [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 04:04:59 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 04:04:59 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Creating image(s)
Nov 08 04:04:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquiring lock "/opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:04:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "/opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:04:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "/opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:04:59 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:04:59 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.200s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:04:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:04:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:04:59 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.185s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a/disk 1073741824" returned: 0 in 0.067s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:05:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:00 user nova-compute[75014]: DEBUG nova.network.neutron [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Successfully created port: fa9015d5-2c52-4575-a315-a082c02593eb {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 04:05:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.221s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:00 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 04:05:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:00 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Cannot resize image /opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 04:05:00 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 04:05:00 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Ensure instance console log exists: /opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:05:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:05:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:05:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:05:00 user nova-compute[75014]: DEBUG nova.network.neutron [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Successfully updated port: fa9015d5-2c52-4575-a315-a082c02593eb {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 04:05:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquiring lock "refresh_cache-1cb11358-b4c4-47f4-ba30-d967d523f98a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:05:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquired lock "refresh_cache-1cb11358-b4c4-47f4-ba30-d967d523f98a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:05:00 user nova-compute[75014]: DEBUG nova.network.neutron [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.compute.manager [req-9286e74c-ba3f-4b72-abc4-22b2ae0628b8 req-90a946bd-4faf-459e-89de-4a5245e10c74 service nova] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Received event network-changed-fa9015d5-2c52-4575-a315-a082c02593eb {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.compute.manager [req-9286e74c-ba3f-4b72-abc4-22b2ae0628b8 req-90a946bd-4faf-459e-89de-4a5245e10c74 service nova] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Refreshing instance network info cache due to event network-changed-fa9015d5-2c52-4575-a315-a082c02593eb. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-9286e74c-ba3f-4b72-abc4-22b2ae0628b8 req-90a946bd-4faf-459e-89de-4a5245e10c74 service nova] Acquiring lock "refresh_cache-1cb11358-b4c4-47f4-ba30-d967d523f98a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.network.neutron [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.network.neutron [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Updating instance_info_cache with network_info: [{"id": "fa9015d5-2c52-4575-a315-a082c02593eb", "address": "fa:16:3e:3c:38:9c", "network": {"id": "25bc77a0-1460-485f-a61a-a43843631782", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-430613931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e5003c0e79d42248cd1ff8be29fe3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa9015d5-2c", "ovs_interfaceid": "fa9015d5-2c52-4575-a315-a082c02593eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Releasing lock "refresh_cache-1cb11358-b4c4-47f4-ba30-d967d523f98a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.compute.manager [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Instance network_info: |[{"id": "fa9015d5-2c52-4575-a315-a082c02593eb", "address": "fa:16:3e:3c:38:9c", "network": {"id": "25bc77a0-1460-485f-a61a-a43843631782", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-430613931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e5003c0e79d42248cd1ff8be29fe3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa9015d5-2c", "ovs_interfaceid": "fa9015d5-2c52-4575-a315-a082c02593eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-9286e74c-ba3f-4b72-abc4-22b2ae0628b8 req-90a946bd-4faf-459e-89de-4a5245e10c74 service nova] Acquired lock "refresh_cache-1cb11358-b4c4-47f4-ba30-d967d523f98a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.network.neutron [req-9286e74c-ba3f-4b72-abc4-22b2ae0628b8 req-90a946bd-4faf-459e-89de-4a5245e10c74 service nova] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Refreshing network info cache for port fa9015d5-2c52-4575-a315-a082c02593eb {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Start _get_guest_xml network_info=[{"id": "fa9015d5-2c52-4575-a315-a082c02593eb", "address": "fa:16:3e:3c:38:9c", "network": {"id": "25bc77a0-1460-485f-a61a-a43843631782", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-430613931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e5003c0e79d42248cd1ff8be29fe3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa9015d5-2c", "ovs_interfaceid": "fa9015d5-2c52-4575-a315-a082c02593eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:05:01 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:05:01 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:04:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-590403129',display_name='tempest-VolumesSnapshotTestJSON-instance-590403129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-590403129',id=32,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApwxl/mV6D1jStTryfmCuT7MAnpPlgePGA85/dzLF5MWHoUHVI1tIXZQUCSRXX3Ii4AS0IiTpCqTqIzf5+d4hwBDeNcdKfVCSV9GeeBTZFFBQoBFTkZ2SvAV9ZYlQmdQw==',key_name='tempest-keypair-47994009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e5003c0e79d42248cd1ff8be29fe3b0',ramdisk_id='',reservation_id='r-8jumx3qd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-334487690',owner_user_name='tempest-VolumesSnapshotTestJSON-334487690-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:05:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74a3234564994ff7a7c7fc6166e16aef',uuid=1cb11358-b4c4-47f4-ba30-d967d523f98a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa9015d5-2c52-4575-a315-a082c02593eb", "address": "fa:16:3e:3c:38:9c", "network": {"id": "25bc77a0-1460-485f-a61a-a43843631782", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-430613931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e5003c0e79d42248cd1ff8be29fe3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa9015d5-2c", "ovs_interfaceid": "fa9015d5-2c52-4575-a315-a082c02593eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Converting VIF {"id": "fa9015d5-2c52-4575-a315-a082c02593eb", "address": "fa:16:3e:3c:38:9c", "network": {"id": "25bc77a0-1460-485f-a61a-a43843631782", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-430613931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e5003c0e79d42248cd1ff8be29fe3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa9015d5-2c", "ovs_interfaceid": "fa9015d5-2c52-4575-a315-a082c02593eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:38:9c,bridge_name='br-int',has_traffic_filtering=True,id=fa9015d5-2c52-4575-a315-a082c02593eb,network=Network(25bc77a0-1460-485f-a61a-a43843631782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa9015d5-2c') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.objects.instance [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lazy-loading 'pci_devices' on Instance uuid 1cb11358-b4c4-47f4-ba30-d967d523f98a {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:05:01 user nova-compute[75014]:   <uuid>1cb11358-b4c4-47f4-ba30-d967d523f98a</uuid>
Nov 08 04:05:01 user nova-compute[75014]:   <name>instance-00000020</name>
Nov 08 04:05:01 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:05:01 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:05:01 user nova-compute[75014]:   <metadata>
Nov 08 04:05:01 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:05:01 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:05:01 user nova-compute[75014]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-590403129</nova:name>
Nov 08 04:05:01 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:05:01</nova:creationTime>
Nov 08 04:05:01 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:05:01 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:05:01 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:05:01 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:05:01 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:05:01 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:05:01 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:05:01 user nova-compute[75014]:       <nova:owner>
Nov 08 04:05:01 user nova-compute[75014]:         <nova:user uuid="74a3234564994ff7a7c7fc6166e16aef">tempest-VolumesSnapshotTestJSON-334487690-project-member</nova:user>
Nov 08 04:05:01 user nova-compute[75014]:         <nova:project uuid="9e5003c0e79d42248cd1ff8be29fe3b0">tempest-VolumesSnapshotTestJSON-334487690</nova:project>
Nov 08 04:05:01 user nova-compute[75014]:       </nova:owner>
Nov 08 04:05:01 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:05:01 user nova-compute[75014]:       <nova:ports>
Nov 08 04:05:01 user nova-compute[75014]:         <nova:port uuid="fa9015d5-2c52-4575-a315-a082c02593eb">
Nov 08 04:05:01 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 04:05:01 user nova-compute[75014]:         </nova:port>
Nov 08 04:05:01 user nova-compute[75014]:       </nova:ports>
Nov 08 04:05:01 user nova-compute[75014]:     </nova:instance>
Nov 08 04:05:01 user nova-compute[75014]:   </metadata>
Nov 08 04:05:01 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:05:01 user nova-compute[75014]:     <system>
Nov 08 04:05:01 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:05:01 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:05:01 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:05:01 user nova-compute[75014]:       <entry name="serial">1cb11358-b4c4-47f4-ba30-d967d523f98a</entry>
Nov 08 04:05:01 user nova-compute[75014]:       <entry name="uuid">1cb11358-b4c4-47f4-ba30-d967d523f98a</entry>
Nov 08 04:05:01 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:05:01 user nova-compute[75014]:     </system>
Nov 08 04:05:01 user nova-compute[75014]:   </sysinfo>
Nov 08 04:05:01 user nova-compute[75014]:   <os>
Nov 08 04:05:01 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:05:01 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:05:01 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:05:01 user nova-compute[75014]:   </os>
Nov 08 04:05:01 user nova-compute[75014]:   <features>
Nov 08 04:05:01 user nova-compute[75014]:     <acpi/>
Nov 08 04:05:01 user nova-compute[75014]:     <apic/>
Nov 08 04:05:01 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:05:01 user nova-compute[75014]:   </features>
Nov 08 04:05:01 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:05:01 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:05:01 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:05:01 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:05:01 user nova-compute[75014]:   </clock>
Nov 08 04:05:01 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:05:01 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:05:01 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:05:01 user nova-compute[75014]:   </cpu>
Nov 08 04:05:01 user nova-compute[75014]:   <devices>
Nov 08 04:05:01 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 04:05:01 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 04:05:01 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a/disk"/>
Nov 08 04:05:01 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:05:01 user nova-compute[75014]:     </disk>
Nov 08 04:05:01 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:05:01 user nova-compute[75014]:       <mac address="fa:16:3e:3c:38:9c"/>
Nov 08 04:05:01 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:05:01 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:05:01 user nova-compute[75014]:       <target dev="tapfa9015d5-2c"/>
Nov 08 04:05:01 user nova-compute[75014]:     </interface>
Nov 08 04:05:01 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:05:01 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a/console.log" append="off"/>
Nov 08 04:05:01 user nova-compute[75014]:     </serial>
Nov 08 04:05:01 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:05:01 user nova-compute[75014]:     <video>
Nov 08 04:05:01 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:05:01 user nova-compute[75014]:     </video>
Nov 08 04:05:01 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:05:01 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:05:01 user nova-compute[75014]:     </rng>
Nov 08 04:05:01 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:05:01 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:05:01 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:05:01 user nova-compute[75014]:     </memballoon>
Nov 08 04:05:01 user nova-compute[75014]:   </devices>
Nov 08 04:05:01 user nova-compute[75014]: </domain>
Nov 08 04:05:01 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:04:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-590403129',display_name='tempest-VolumesSnapshotTestJSON-instance-590403129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-590403129',id=32,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApwxl/mV6D1jStTryfmCuT7MAnpPlgePGA85/dzLF5MWHoUHVI1tIXZQUCSRXX3Ii4AS0IiTpCqTqIzf5+d4hwBDeNcdKfVCSV9GeeBTZFFBQoBFTkZ2SvAV9ZYlQmdQw==',key_name='tempest-keypair-47994009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e5003c0e79d42248cd1ff8be29fe3b0',ramdisk_id='',reservation_id='r-8jumx3qd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-334487690',owner_user_name='tempest-VolumesSnapshotTestJSON-334487690-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:05:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74a3234564994ff7a7c7fc6166e16aef',uuid=1cb11358-b4c4-47f4-ba30-d967d523f98a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa9015d5-2c52-4575-a315-a082c02593eb", "address": "fa:16:3e:3c:38:9c", "network": {"id": "25bc77a0-1460-485f-a61a-a43843631782", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-430613931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e5003c0e79d42248cd1ff8be29fe3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa9015d5-2c", "ovs_interfaceid": "fa9015d5-2c52-4575-a315-a082c02593eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Converting VIF {"id": "fa9015d5-2c52-4575-a315-a082c02593eb", "address": "fa:16:3e:3c:38:9c", "network": {"id": "25bc77a0-1460-485f-a61a-a43843631782", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-430613931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e5003c0e79d42248cd1ff8be29fe3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa9015d5-2c", "ovs_interfaceid": "fa9015d5-2c52-4575-a315-a082c02593eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:38:9c,bridge_name='br-int',has_traffic_filtering=True,id=fa9015d5-2c52-4575-a315-a082c02593eb,network=Network(25bc77a0-1460-485f-a61a-a43843631782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa9015d5-2c') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG os_vif [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:38:9c,bridge_name='br-int',has_traffic_filtering=True,id=fa9015d5-2c52-4575-a315-a082c02593eb,network=Network(25bc77a0-1460-485f-a61a-a43843631782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa9015d5-2c') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cbf285ac-5aba-527c-ad5f-3bfcdf275ec0', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa9015d5-2c, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa9015d5-2c, col_values=(('qos', UUID('165e31a8-05ce-4597-b527-fc2eb227e64d')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa9015d5-2c, col_values=(('external_ids', {'iface-id': 'fa9015d5-2c52-4575-a315-a082c02593eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:38:9c', 'vm-uuid': '1cb11358-b4c4-47f4-ba30-d967d523f98a'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:01 user nova-compute[75014]: INFO os_vif [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:38:9c,bridge_name='br-int',has_traffic_filtering=True,id=fa9015d5-2c52-4575-a315-a082c02593eb,network=Network(25bc77a0-1460-485f-a61a-a43843631782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa9015d5-2c')
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] No VIF found with MAC fa:16:3e:3c:38:9c, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.network.neutron [req-9286e74c-ba3f-4b72-abc4-22b2ae0628b8 req-90a946bd-4faf-459e-89de-4a5245e10c74 service nova] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Updated VIF entry in instance network info cache for port fa9015d5-2c52-4575-a315-a082c02593eb. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG nova.network.neutron [req-9286e74c-ba3f-4b72-abc4-22b2ae0628b8 req-90a946bd-4faf-459e-89de-4a5245e10c74 service nova] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Updating instance_info_cache with network_info: [{"id": "fa9015d5-2c52-4575-a315-a082c02593eb", "address": "fa:16:3e:3c:38:9c", "network": {"id": "25bc77a0-1460-485f-a61a-a43843631782", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-430613931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e5003c0e79d42248cd1ff8be29fe3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa9015d5-2c", "ovs_interfaceid": "fa9015d5-2c52-4575-a315-a082c02593eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:05:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-9286e74c-ba3f-4b72-abc4-22b2ae0628b8 req-90a946bd-4faf-459e-89de-4a5245e10c74 service nova] Releasing lock "refresh_cache-1cb11358-b4c4-47f4-ba30-d967d523f98a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:05:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:03 user nova-compute[75014]: DEBUG nova.compute.manager [req-69336e96-41ce-441b-97d6-8bfb62c16a22 req-28f5a90b-150f-4fd8-8f4a-73b49413e2a1 service nova] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Received event network-vif-plugged-fa9015d5-2c52-4575-a315-a082c02593eb {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:05:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-69336e96-41ce-441b-97d6-8bfb62c16a22 req-28f5a90b-150f-4fd8-8f4a-73b49413e2a1 service nova] Acquiring lock "1cb11358-b4c4-47f4-ba30-d967d523f98a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:05:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-69336e96-41ce-441b-97d6-8bfb62c16a22 req-28f5a90b-150f-4fd8-8f4a-73b49413e2a1 service nova] Lock "1cb11358-b4c4-47f4-ba30-d967d523f98a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:05:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-69336e96-41ce-441b-97d6-8bfb62c16a22 req-28f5a90b-150f-4fd8-8f4a-73b49413e2a1 service nova] Lock "1cb11358-b4c4-47f4-ba30-d967d523f98a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:05:03 user nova-compute[75014]: DEBUG nova.compute.manager [req-69336e96-41ce-441b-97d6-8bfb62c16a22 req-28f5a90b-150f-4fd8-8f4a-73b49413e2a1 service nova] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] No waiting events found dispatching network-vif-plugged-fa9015d5-2c52-4575-a315-a082c02593eb {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:05:03 user nova-compute[75014]: WARNING nova.compute.manager [req-69336e96-41ce-441b-97d6-8bfb62c16a22 req-28f5a90b-150f-4fd8-8f4a-73b49413e2a1 service nova] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Received unexpected event network-vif-plugged-fa9015d5-2c52-4575-a315-a082c02593eb for instance with vm_state building and task_state spawning.
Nov 08 04:05:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:04 user nova-compute[75014]: DEBUG nova.compute.manager [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:05:04 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 04:05:04 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Instance spawned successfully.
Nov 08 04:05:04 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 04:05:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:05:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:05:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:05:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:05:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:05:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:05:05 user nova-compute[75014]: INFO nova.compute.manager [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Took 5.40 seconds to spawn the instance on the hypervisor.
Nov 08 04:05:05 user nova-compute[75014]: DEBUG nova.compute.manager [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:05:05 user nova-compute[75014]: DEBUG nova.compute.manager [req-4e5ee90b-6fae-4e15-b01e-e8c181dfd421 req-40456393-203c-465a-b0ff-889abec75a87 service nova] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Received event network-vif-plugged-fa9015d5-2c52-4575-a315-a082c02593eb {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:05:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4e5ee90b-6fae-4e15-b01e-e8c181dfd421 req-40456393-203c-465a-b0ff-889abec75a87 service nova] Acquiring lock "1cb11358-b4c4-47f4-ba30-d967d523f98a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:05:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4e5ee90b-6fae-4e15-b01e-e8c181dfd421 req-40456393-203c-465a-b0ff-889abec75a87 service nova] Lock "1cb11358-b4c4-47f4-ba30-d967d523f98a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:05:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4e5ee90b-6fae-4e15-b01e-e8c181dfd421 req-40456393-203c-465a-b0ff-889abec75a87 service nova] Lock "1cb11358-b4c4-47f4-ba30-d967d523f98a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:05:05 user nova-compute[75014]: DEBUG nova.compute.manager [req-4e5ee90b-6fae-4e15-b01e-e8c181dfd421 req-40456393-203c-465a-b0ff-889abec75a87 service nova] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] No waiting events found dispatching network-vif-plugged-fa9015d5-2c52-4575-a315-a082c02593eb {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:05:05 user nova-compute[75014]: WARNING nova.compute.manager [req-4e5ee90b-6fae-4e15-b01e-e8c181dfd421 req-40456393-203c-465a-b0ff-889abec75a87 service nova] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Received unexpected event network-vif-plugged-fa9015d5-2c52-4575-a315-a082c02593eb for instance with vm_state building and task_state spawning.
Nov 08 04:05:05 user nova-compute[75014]: INFO nova.compute.manager [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Took 6.57 seconds to build instance.
Nov 08 04:05:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-518b2a55-bae6-4a09-85a5-2a53b4cca11f tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "1cb11358-b4c4-47f4-ba30-d967d523f98a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.703s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:05:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c4725926-1f4a-4fb1-a1f8-e577a2d5a3db tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "44d4794d-91c4-4eb6-a752-37f587f2b420" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:05:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c4725926-1f4a-4fb1-a1f8-e577a2d5a3db tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "44d4794d-91c4-4eb6-a752-37f587f2b420" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:05:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c4725926-1f4a-4fb1-a1f8-e577a2d5a3db tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "44d4794d-91c4-4eb6-a752-37f587f2b420-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:05:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c4725926-1f4a-4fb1-a1f8-e577a2d5a3db tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "44d4794d-91c4-4eb6-a752-37f587f2b420-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:05:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c4725926-1f4a-4fb1-a1f8-e577a2d5a3db tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "44d4794d-91c4-4eb6-a752-37f587f2b420-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:05:06 user nova-compute[75014]: INFO nova.compute.manager [None req-c4725926-1f4a-4fb1-a1f8-e577a2d5a3db tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Terminating instance
Nov 08 04:05:06 user nova-compute[75014]: DEBUG nova.compute.manager [None req-c4725926-1f4a-4fb1-a1f8-e577a2d5a3db tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:05:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:07 user nova-compute[75014]: DEBUG nova.compute.manager [req-0709a93d-d442-471c-8a89-69b5ad6527aa req-8716f5e6-6b59-4396-a241-b4d387e312bf service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Received event network-vif-unplugged-37918aae-d92b-43c0-8477-1355ac936ab0 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:05:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0709a93d-d442-471c-8a89-69b5ad6527aa req-8716f5e6-6b59-4396-a241-b4d387e312bf service nova] Acquiring lock "44d4794d-91c4-4eb6-a752-37f587f2b420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:05:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0709a93d-d442-471c-8a89-69b5ad6527aa req-8716f5e6-6b59-4396-a241-b4d387e312bf service nova] Lock "44d4794d-91c4-4eb6-a752-37f587f2b420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:05:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0709a93d-d442-471c-8a89-69b5ad6527aa req-8716f5e6-6b59-4396-a241-b4d387e312bf service nova] Lock "44d4794d-91c4-4eb6-a752-37f587f2b420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:05:07 user nova-compute[75014]: DEBUG nova.compute.manager [req-0709a93d-d442-471c-8a89-69b5ad6527aa req-8716f5e6-6b59-4396-a241-b4d387e312bf service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] No waiting events found dispatching network-vif-unplugged-37918aae-d92b-43c0-8477-1355ac936ab0 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:05:07 user nova-compute[75014]: DEBUG nova.compute.manager [req-0709a93d-d442-471c-8a89-69b5ad6527aa req-8716f5e6-6b59-4396-a241-b4d387e312bf service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Received event network-vif-unplugged-37918aae-d92b-43c0-8477-1355ac936ab0 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:05:07 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Instance destroyed successfully.
Nov 08 04:05:07 user nova-compute[75014]: DEBUG nova.objects.instance [None req-c4725926-1f4a-4fb1-a1f8-e577a2d5a3db tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lazy-loading 'resources' on Instance uuid 44d4794d-91c4-4eb6-a752-37f587f2b420 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:05:07 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-c4725926-1f4a-4fb1-a1f8-e577a2d5a3db tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:59:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1283389400',display_name='tempest-TestMinimumBasicScenario-server-1283389400',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1283389400',id=22,image_ref='fc883799-3917-4eb3-ad7b-aec0fef4495b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd4W/27RUr/jFVGcD2SSXjFI9PeHAFU2/fUSyG/RGRc5V0x95Y0r91VEtl6T8buh3ZpbGPW38t75T1O0iy+2Qg623tDMYN5y6qvwp2gWJUmqQS0VB/6/qYXbUlezOiduA==',key_name='tempest-TestMinimumBasicScenario-309319752',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:59:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60831c0130424415a7bcf071bba28ab0',ramdisk_id='',reservation_id='r-ykj7rhm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fc883799-3917-4eb3-ad7b-aec0fef4495b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-696617302',owner_user_name='tempest-TestMinimumBasicScenario-696617302-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:02:19Z,user_data=None,user_id='377368f8d9a540aebd8b8760b7130fb5',uuid=44d4794d-91c4-4eb6-a752-37f587f2b420,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37918aae-d92b-43c0-8477-1355ac936ab0", "address": "fa:16:3e:43:25:9f", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37918aae-d9", "ovs_interfaceid": "37918aae-d92b-43c0-8477-1355ac936ab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:05:07 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-c4725926-1f4a-4fb1-a1f8-e577a2d5a3db tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Converting VIF {"id": "37918aae-d92b-43c0-8477-1355ac936ab0", "address": "fa:16:3e:43:25:9f", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37918aae-d9", "ovs_interfaceid": "37918aae-d92b-43c0-8477-1355ac936ab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:05:07 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-c4725926-1f4a-4fb1-a1f8-e577a2d5a3db tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:25:9f,bridge_name='br-int',has_traffic_filtering=True,id=37918aae-d92b-43c0-8477-1355ac936ab0,network=Network(b36b65ee-1443-4741-946a-096b65a4e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37918aae-d9') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:05:07 user nova-compute[75014]: DEBUG os_vif [None req-c4725926-1f4a-4fb1-a1f8-e577a2d5a3db tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:25:9f,bridge_name='br-int',has_traffic_filtering=True,id=37918aae-d92b-43c0-8477-1355ac936ab0,network=Network(b36b65ee-1443-4741-946a-096b65a4e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37918aae-d9') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:05:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37918aae-d9, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:05:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:05:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=76ff64b6-26b7-4b85-948b-ba923face6f7) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:05:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:07 user nova-compute[75014]: INFO os_vif [None req-c4725926-1f4a-4fb1-a1f8-e577a2d5a3db tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:25:9f,bridge_name='br-int',has_traffic_filtering=True,id=37918aae-d92b-43c0-8477-1355ac936ab0,network=Network(b36b65ee-1443-4741-946a-096b65a4e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37918aae-d9')
Nov 08 04:05:07 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-c4725926-1f4a-4fb1-a1f8-e577a2d5a3db tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Deleting instance files /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420_del
Nov 08 04:05:07 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-c4725926-1f4a-4fb1-a1f8-e577a2d5a3db tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Deletion of /opt/stack/data/nova/instances/44d4794d-91c4-4eb6-a752-37f587f2b420_del complete
Nov 08 04:05:07 user nova-compute[75014]: INFO nova.compute.manager [None req-c4725926-1f4a-4fb1-a1f8-e577a2d5a3db tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 08 04:05:07 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-c4725926-1f4a-4fb1-a1f8-e577a2d5a3db tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:05:07 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:05:07 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:05:08 user nova-compute[75014]: DEBUG nova.compute.manager [req-4933cf2a-4a6b-47ad-bb99-8ba0939cca2b req-36d5a6e1-e41c-44ca-ad67-8093dd4d733f service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Received event network-changed-564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:05:08 user nova-compute[75014]: DEBUG nova.compute.manager [req-4933cf2a-4a6b-47ad-bb99-8ba0939cca2b req-36d5a6e1-e41c-44ca-ad67-8093dd4d733f service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Refreshing instance network info cache due to event network-changed-564c15b6-eb02-4a0c-8b00-d611297ac247. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:05:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4933cf2a-4a6b-47ad-bb99-8ba0939cca2b req-36d5a6e1-e41c-44ca-ad67-8093dd4d733f service nova] Acquiring lock "refresh_cache-d4726cd1-51ea-41e2-ad36-be12b4d4c26b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:05:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4933cf2a-4a6b-47ad-bb99-8ba0939cca2b req-36d5a6e1-e41c-44ca-ad67-8093dd4d733f service nova] Acquired lock "refresh_cache-d4726cd1-51ea-41e2-ad36-be12b4d4c26b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:05:08 user nova-compute[75014]: DEBUG nova.network.neutron [req-4933cf2a-4a6b-47ad-bb99-8ba0939cca2b req-36d5a6e1-e41c-44ca-ad67-8093dd4d733f service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Refreshing network info cache for port 564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:05:08 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:05:08 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Took 0.69 seconds to deallocate network for instance.
Nov 08 04:05:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c4725926-1f4a-4fb1-a1f8-e577a2d5a3db tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:05:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c4725926-1f4a-4fb1-a1f8-e577a2d5a3db tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:05:08 user nova-compute[75014]: DEBUG nova.network.neutron [req-4933cf2a-4a6b-47ad-bb99-8ba0939cca2b req-36d5a6e1-e41c-44ca-ad67-8093dd4d733f service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Updated VIF entry in instance network info cache for port 564c15b6-eb02-4a0c-8b00-d611297ac247. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:05:08 user nova-compute[75014]: DEBUG nova.network.neutron [req-4933cf2a-4a6b-47ad-bb99-8ba0939cca2b req-36d5a6e1-e41c-44ca-ad67-8093dd4d733f service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Updating instance_info_cache with network_info: [{"id": "564c15b6-eb02-4a0c-8b00-d611297ac247", "address": "fa:16:3e:60:c7:25", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap564c15b6-eb", "ovs_interfaceid": "564c15b6-eb02-4a0c-8b00-d611297ac247", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:05:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:05:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:05:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4933cf2a-4a6b-47ad-bb99-8ba0939cca2b req-36d5a6e1-e41c-44ca-ad67-8093dd4d733f service nova] Releasing lock "refresh_cache-d4726cd1-51ea-41e2-ad36-be12b4d4c26b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:05:08 user nova-compute[75014]: INFO nova.compute.manager [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Detaching volume c4874793-2dda-4382-8193-78c9540c5908
Nov 08 04:05:08 user nova-compute[75014]: INFO nova.virt.block_device [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Attempting to driver detach volume c4874793-2dda-4382-8193-78c9540c5908 from mountpoint /dev/vdb
Nov 08 04:05:08 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Attempting to detach device vdb from instance d4726cd1-51ea-41e2-ad36-be12b4d4c26b from the persistent domain config. {{(pid=75014) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 04:05:08 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:05:08 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:05:08 user nova-compute[75014]:   <source dev="/dev/sdf"/>
Nov 08 04:05:08 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:05:08 user nova-compute[75014]:   <serial>c4874793-2dda-4382-8193-78c9540c5908</serial>
Nov 08 04:05:08 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:05:08 user nova-compute[75014]: </disk>
Nov 08 04:05:08 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:05:08 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Successfully detached device vdb from instance d4726cd1-51ea-41e2-ad36-be12b4d4c26b from the persistent domain config.
Nov 08 04:05:08 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d4726cd1-51ea-41e2-ad36-be12b4d4c26b from the live domain config. {{(pid=75014) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 04:05:08 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:05:08 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:05:08 user nova-compute[75014]:   <source dev="/dev/sdf"/>
Nov 08 04:05:08 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:05:08 user nova-compute[75014]:   <serial>c4874793-2dda-4382-8193-78c9540c5908</serial>
Nov 08 04:05:08 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:05:08 user nova-compute[75014]: </disk>
Nov 08 04:05:08 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:05:09 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-c4725926-1f4a-4fb1-a1f8-e577a2d5a3db tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:05:09 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-c4725926-1f4a-4fb1-a1f8-e577a2d5a3db tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:05:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c4725926-1f4a-4fb1-a1f8-e577a2d5a3db tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.635s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:05:09 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-c4725926-1f4a-4fb1-a1f8-e577a2d5a3db tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Deleted allocations for instance 44d4794d-91c4-4eb6-a752-37f587f2b420
Nov 08 04:05:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d4726cd1-51ea-41e2-ad36-be12b4d4c26b {{(pid=75014) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 04:05:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c4725926-1f4a-4fb1-a1f8-e577a2d5a3db tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "44d4794d-91c4-4eb6-a752-37f587f2b420" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.490s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:05:09 user nova-compute[75014]: DEBUG nova.compute.manager [req-008eb1a1-31e2-4232-ad95-204aba47c62b req-bed03ade-f9f5-4d3d-91bb-f073ad056343 service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Received event network-vif-plugged-37918aae-d92b-43c0-8477-1355ac936ab0 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:05:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-008eb1a1-31e2-4232-ad95-204aba47c62b req-bed03ade-f9f5-4d3d-91bb-f073ad056343 service nova] Acquiring lock "44d4794d-91c4-4eb6-a752-37f587f2b420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:05:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-008eb1a1-31e2-4232-ad95-204aba47c62b req-bed03ade-f9f5-4d3d-91bb-f073ad056343 service nova] Lock "44d4794d-91c4-4eb6-a752-37f587f2b420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:05:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-008eb1a1-31e2-4232-ad95-204aba47c62b req-bed03ade-f9f5-4d3d-91bb-f073ad056343 service nova] Lock "44d4794d-91c4-4eb6-a752-37f587f2b420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:05:09 user nova-compute[75014]: DEBUG nova.compute.manager [req-008eb1a1-31e2-4232-ad95-204aba47c62b req-bed03ade-f9f5-4d3d-91bb-f073ad056343 service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] No waiting events found dispatching network-vif-plugged-37918aae-d92b-43c0-8477-1355ac936ab0 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:05:09 user nova-compute[75014]: WARNING nova.compute.manager [req-008eb1a1-31e2-4232-ad95-204aba47c62b req-bed03ade-f9f5-4d3d-91bb-f073ad056343 service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Received unexpected event network-vif-plugged-37918aae-d92b-43c0-8477-1355ac936ab0 for instance with vm_state deleted and task_state None.
Nov 08 04:05:10 user nova-compute[75014]: DEBUG nova.compute.manager [req-a2c611fd-715f-4353-a9eb-a03d8eb92150 req-6a79f1ad-7775-408a-a6a7-c01f4b83a71a service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Received event network-changed-564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:05:10 user nova-compute[75014]: DEBUG nova.compute.manager [req-a2c611fd-715f-4353-a9eb-a03d8eb92150 req-6a79f1ad-7775-408a-a6a7-c01f4b83a71a service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Refreshing instance network info cache due to event network-changed-564c15b6-eb02-4a0c-8b00-d611297ac247. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:05:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a2c611fd-715f-4353-a9eb-a03d8eb92150 req-6a79f1ad-7775-408a-a6a7-c01f4b83a71a service nova] Acquiring lock "refresh_cache-d4726cd1-51ea-41e2-ad36-be12b4d4c26b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:05:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a2c611fd-715f-4353-a9eb-a03d8eb92150 req-6a79f1ad-7775-408a-a6a7-c01f4b83a71a service nova] Acquired lock "refresh_cache-d4726cd1-51ea-41e2-ad36-be12b4d4c26b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:05:10 user nova-compute[75014]: DEBUG nova.network.neutron [req-a2c611fd-715f-4353-a9eb-a03d8eb92150 req-6a79f1ad-7775-408a-a6a7-c01f4b83a71a service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Refreshing network info cache for port 564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:05:10 user nova-compute[75014]: DEBUG nova.network.neutron [req-a2c611fd-715f-4353-a9eb-a03d8eb92150 req-6a79f1ad-7775-408a-a6a7-c01f4b83a71a service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Updated VIF entry in instance network info cache for port 564c15b6-eb02-4a0c-8b00-d611297ac247. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:05:10 user nova-compute[75014]: DEBUG nova.network.neutron [req-a2c611fd-715f-4353-a9eb-a03d8eb92150 req-6a79f1ad-7775-408a-a6a7-c01f4b83a71a service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Updating instance_info_cache with network_info: [{"id": "564c15b6-eb02-4a0c-8b00-d611297ac247", "address": "fa:16:3e:60:c7:25", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap564c15b6-eb", "ovs_interfaceid": "564c15b6-eb02-4a0c-8b00-d611297ac247", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:05:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a2c611fd-715f-4353-a9eb-a03d8eb92150 req-6a79f1ad-7775-408a-a6a7-c01f4b83a71a service nova] Releasing lock "refresh_cache-d4726cd1-51ea-41e2-ad36-be12b4d4c26b" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:05:10 user nova-compute[75014]: DEBUG nova.compute.manager [req-a2c611fd-715f-4353-a9eb-a03d8eb92150 req-6a79f1ad-7775-408a-a6a7-c01f4b83a71a service nova] [instance: 44d4794d-91c4-4eb6-a752-37f587f2b420] Received event network-vif-deleted-37918aae-d92b-43c0-8477-1355ac936ab0 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:05:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:13 user nova-compute[75014]: INFO nova.compute.manager [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Rescuing
Nov 08 04:05:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "refresh_cache-0b3b62d9-2543-402b-bdb5-cac994b755c9" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:05:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquired lock "refresh_cache-0b3b62d9-2543-402b-bdb5-cac994b755c9" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:05:13 user nova-compute[75014]: DEBUG nova.network.neutron [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:05:14 user nova-compute[75014]: DEBUG nova.network.neutron [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Updating instance_info_cache with network_info: [{"id": "4b006ecf-b195-4491-8ba7-7109ae8701df", "address": "fa:16:3e:c5:3a:a9", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b006ecf-b1", "ovs_interfaceid": "4b006ecf-b195-4491-8ba7-7109ae8701df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:05:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Releasing lock "refresh_cache-0b3b62d9-2543-402b-bdb5-cac994b755c9" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:05:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:14 user nova-compute[75014]: DEBUG nova.compute.manager [req-9474469c-3569-4aba-96c5-4f22c9d836d6 req-500ffa70-82db-4092-8cd6-6c4ec35e7746 service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Received event network-vif-unplugged-4b006ecf-b195-4491-8ba7-7109ae8701df {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:05:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-9474469c-3569-4aba-96c5-4f22c9d836d6 req-500ffa70-82db-4092-8cd6-6c4ec35e7746 service nova] Acquiring lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:05:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-9474469c-3569-4aba-96c5-4f22c9d836d6 req-500ffa70-82db-4092-8cd6-6c4ec35e7746 service nova] Lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:05:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-9474469c-3569-4aba-96c5-4f22c9d836d6 req-500ffa70-82db-4092-8cd6-6c4ec35e7746 service nova] Lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:05:14 user nova-compute[75014]: DEBUG nova.compute.manager [req-9474469c-3569-4aba-96c5-4f22c9d836d6 req-500ffa70-82db-4092-8cd6-6c4ec35e7746 service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] No waiting events found dispatching network-vif-unplugged-4b006ecf-b195-4491-8ba7-7109ae8701df {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:05:14 user nova-compute[75014]: WARNING nova.compute.manager [req-9474469c-3569-4aba-96c5-4f22c9d836d6 req-500ffa70-82db-4092-8cd6-6c4ec35e7746 service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Received unexpected event network-vif-unplugged-4b006ecf-b195-4491-8ba7-7109ae8701df for instance with vm_state active and task_state rescuing.
Nov 08 04:05:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:14 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Instance destroyed successfully.
Nov 08 04:05:14 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Attempting a stable device rescue
Nov 08 04:05:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75014) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 04:05:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Instance directory exists: not creating {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 04:05:14 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Creating image(s)
Nov 08 04:05:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b3b62d9-2543-402b-bdb5-cac994b755c9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:05:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "/opt/stack/data/nova/instances/0b3b62d9-2543-402b-bdb5-cac994b755c9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:05:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "/opt/stack/data/nova/instances/0b3b62d9-2543-402b-bdb5-cac994b755c9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:05:14 user nova-compute[75014]: DEBUG nova.objects.instance [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0b3b62d9-2543-402b-bdb5-cac994b755c9 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:05:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "728d8288d167f8fe50ca2c4a7d2fa3a2ea959596" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:05:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "728d8288d167f8fe50ca2c4a7d2fa3a2ea959596" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:05:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/728d8288d167f8fe50ca2c4a7d2fa3a2ea959596.part --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:15 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d is timed out.
Nov 08 04:05:15 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Successfully detached device vdb from instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d from the live domain config.
Nov 08 04:05:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:05:15 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgCGolzv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:05:15 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:05:15 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:05:15 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:05:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:15 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8c5d09-618e-432d-b6dc-2779183c8da6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:05:15 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:05:15 user nova-compute[75014]: No targets found.
Nov 08 04:05:15 user nova-compute[75014]: iSNS:
Nov 08 04:05:15 user nova-compute[75014]: No targets found.
Nov 08 04:05:15 user nova-compute[75014]: STATIC:
Nov 08 04:05:15 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908
Nov 08 04:05:15 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:05:15 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:05:15 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec
Nov 08 04:05:15 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:05:15 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:05:15 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00
Nov 08 04:05:15 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:05:15 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:05:15 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:05:15 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:05:15 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:05:15 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a
Nov 08 04:05:15 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:05:15 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:05:15 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e
Nov 08 04:05:15 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:05:15 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:05:15 user nova-compute[75014]: FIRMWARE:
Nov 08 04:05:15 user nova-compute[75014]: No targets found.
Nov 08 04:05:15 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:05:15 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:05:15 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:05:15 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:05:15 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:05:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:15 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ed1062-7fbf-429f-aec6-204a2034211b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:05:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:15 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fae5800-16bc-44dd-b57b-419715a87157]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:05:15 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:05:15 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:05:15 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:05:15 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:05:15 user nova-compute[75014]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e (non-flash)
Nov 08 04:05:15 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:05:15 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:05:15 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:05:15 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:05:15 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:05:15 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:05:15 user nova-compute[75014]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e (non-flash)
Nov 08 04:05:15 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:05:15 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:05:15 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f04001d25f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e'): ({'sdd'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:05:15 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Removing single pathed devices sdd {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:05:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc33f4e-b0c8-4d4d-a938-eca8bd734aec]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/728d8288d167f8fe50ca2c4a7d2fa3a2ea959596.part --force-share --output=json" returned: 0 in 0.188s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG nova.virt.images [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] 811d3e1d-4d35-4da1-b2f0-fea7f5cc27cf was qcow2, converting to raw {{(pid=75014) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG nova.privsep.utils [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75014) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/728d8288d167f8fe50ca2c4a7d2fa3a2ea959596.part /opt/stack/data/nova/instances/_base/728d8288d167f8fe50ca2c4a7d2fa3a2ea959596.converted {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[312e0560-a09d-48f0-94f0-ca5a58c2a13d]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Flushing IO for device /dev/sdd {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bff713-0e7f-4377-9826-38c64318762d]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.072s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a45c94-e54f-402e-826d-4f81b74cc9fa]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] SCSI volumes sdd have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4ad835-c8cd-48d3-9766-ce146b50054b]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/728d8288d167f8fe50ca2c4a7d2fa3a2ea959596.part /opt/stack/data/nova/instances/_base/728d8288d167f8fe50ca2c4a7d2fa3a2ea959596.converted" returned: 0 in 0.224s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/728d8288d167f8fe50ca2c4a7d2fa3a2ea959596.converted --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73ca7d3-82ac-4cd7-97e8-274d6f4160c2]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e, portal: 172.16.0.220,3260]
Nov 08 04:05:16 user nova-compute[75014]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e, portal: 172.16.0.220,3260] successful.
Nov 08 04:05:16 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2ac70b3-9ed2-426e-b818-09cb2dbe759e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a2f42d-c4bc-4632-ae44-1f524345bbf1]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.468s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] <== disconnect_volume: return (470ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/728d8288d167f8fe50ca2c4a7d2fa3a2ea959596.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "728d8288d167f8fe50ca2c4a7d2fa3a2ea959596" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.514s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "728d8288d167f8fe50ca2c4a7d2fa3a2ea959596" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "728d8288d167f8fe50ca2c4a7d2fa3a2ea959596" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/728d8288d167f8fe50ca2c4a7d2fa3a2ea959596 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG nova.compute.manager [req-56ec7e20-153e-4ec3-b76f-95da5697bafb req-22874571-af8f-488a-bf8a-edb998c05f45 service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Received event network-vif-plugged-4b006ecf-b195-4491-8ba7-7109ae8701df {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-56ec7e20-153e-4ec3-b76f-95da5697bafb req-22874571-af8f-488a-bf8a-edb998c05f45 service nova] Acquiring lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-56ec7e20-153e-4ec3-b76f-95da5697bafb req-22874571-af8f-488a-bf8a-edb998c05f45 service nova] Lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-56ec7e20-153e-4ec3-b76f-95da5697bafb req-22874571-af8f-488a-bf8a-edb998c05f45 service nova] Lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG nova.compute.manager [req-56ec7e20-153e-4ec3-b76f-95da5697bafb req-22874571-af8f-488a-bf8a-edb998c05f45 service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] No waiting events found dispatching network-vif-plugged-4b006ecf-b195-4491-8ba7-7109ae8701df {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:05:16 user nova-compute[75014]: WARNING nova.compute.manager [req-56ec7e20-153e-4ec3-b76f-95da5697bafb req-22874571-af8f-488a-bf8a-edb998c05f45 service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Received unexpected event network-vif-plugged-4b006ecf-b195-4491-8ba7-7109ae8701df for instance with vm_state active and task_state rescuing.
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/728d8288d167f8fe50ca2c4a7d2fa3a2ea959596 --force-share --output=json" returned: 0 in 0.190s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/728d8288d167f8fe50ca2c4a7d2fa3a2ea959596,backing_fmt=raw /opt/stack/data/nova/instances/0b3b62d9-2543-402b-bdb5-cac994b755c9/disk.rescue {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/728d8288d167f8fe50ca2c4a7d2fa3a2ea959596,backing_fmt=raw /opt/stack/data/nova/instances/0b3b62d9-2543-402b-bdb5-cac994b755c9/disk.rescue" returned: 0 in 0.053s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "728d8288d167f8fe50ca2c4a7d2fa3a2ea959596" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG nova.objects.instance [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lazy-loading 'migration_context' on Instance uuid 0b3b62d9-2543-402b-bdb5-cac994b755c9 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG nova.objects.base [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Object Instance<0b3b62d9-2543-402b-bdb5-cac994b755c9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Start _get_guest_xml network_info=[{"id": "4b006ecf-b195-4491-8ba7-7109ae8701df", "address": "fa:16:3e:c5:3a:a9", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "vif_mac": "fa:16:3e:c5:3a:a9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b006ecf-b1", "ovs_interfaceid": "4b006ecf-b195-4491-8ba7-7109ae8701df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '811d3e1d-4d35-4da1-b2f0-fea7f5cc27cf', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oPyKNglX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '0b3b62d9-2543-402b-bdb5-cac994b755c9', 'attached_at': '', 'detached_at': '', 'volume_id': '47179dad-70f6-4bbd-afc1-51487445cd00', 'serial': '47179dad-70f6-4bbd-afc1-51487445cd00'}, 'device_type': 'disk', 'attachment_id': 'b6d1a664-93ce-42ff-9fea-2cd63d656d01', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG nova.objects.instance [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lazy-loading 'resources' on Instance uuid 0b3b62d9-2543-402b-bdb5-cac994b755c9 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG nova.objects.base [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Object Instance<0b3b62d9-2543-402b-bdb5-cac994b755c9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG nova.objects.instance [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lazy-loading 'numa_topology' on Instance uuid 0b3b62d9-2543-402b-bdb5-cac994b755c9 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG nova.objects.base [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Object Instance<0b3b62d9-2543-402b-bdb5-cac994b755c9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:05:16 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:05:16 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:05:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG nova.objects.instance [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0b3b62d9-2543-402b-bdb5-cac994b755c9 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG nova.objects.base [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Object Instance<0b3b62d9-2543-402b-bdb5-cac994b755c9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oPyKNglX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:05:16 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:05:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:05:16 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:05:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:05:16 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[65793dcd-51d6-41a2-b099-b4c44f4fb582]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = oPyKNglX\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 08 04:05:16 user nova-compute[75014]: node.name = iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00
Nov 08 04:05:16 user nova-compute[75014]: node.tpgt = -1
Nov 08 04:05:16 user nova-compute[75014]: node.startup = automatic
Nov 08 04:05:16 user nova-compute[75014]: node.leading_login = No
Nov 08 04:05:16 user nova-compute[75014]: iface.iscsi_ifacename = default
Nov 08 04:05:16 user nova-compute[75014]: iface.net_ifacename = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.ipaddress = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.prefix_len = 0
Nov 08 04:05:16 user nova-compute[75014]: iface.hwaddress = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.transport_name = tcp
Nov 08 04:05:16 user nova-compute[75014]: iface.initiatorname = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.state = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.vlan_id = 0
Nov 08 04:05:16 user nova-compute[75014]: iface.vlan_priority = 0
Nov 08 04:05:16 user nova-compute[75014]: iface.vlan_state = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.iface_num = 0
Nov 08 04:05:16 user nova-compute[75014]: iface.mtu = 0
Nov 08 04:05:16 user nova-compute[75014]: iface.port = 0
Nov 08 04:05:16 user nova-compute[75014]: iface.bootproto = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.subnet_mask = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.gateway = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.dhcp_alt_client_id_state = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.dhcp_alt_client_id = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.dhcp_dns = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.dhcp_learn_iqn = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.dhcp_req_vendor_id_state = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.dhcp_vendor_id_state = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.dhcp_vendor_id = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.dhcp_slp_da = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.fragmentation = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.gratuitous_arp = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.incoming_forwarding = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.tos_state = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.tos = 0
Nov 08 04:05:16 user nova-compute[75014]: iface.ttl = 0
Nov 08 04:05:16 user nova-compute[75014]: iface.delayed_ack = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.tcp_nagle = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.tcp_wsf_state = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.tcp_wsf = 0
Nov 08 04:05:16 user nova-compute[75014]: iface.tcp_timer_scale = 0
Nov 08 04:05:16 user nova-compute[75014]: iface.tcp_timestamp = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.redirect = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.def_task_mgmt_timeout = 0
Nov 08 04:05:16 user nova-compute[75014]: iface.header_digest = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.data_digest = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.immediate_data = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.initial_r2t = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.data_seq_inorder = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.data_pdu_inorder = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.erl = 0
Nov 08 04:05:16 user nova-compute[75014]: iface.max_receive_data_len = 0
Nov 08 04:05:16 user nova-compute[75014]: iface.first_burst_len = 0
Nov 08 04:05:16 user nova-compute[75014]: iface.max_outstanding_r2t = 0
Nov 08 04:05:16 user nova-compute[75014]: iface.max_burst_len = 0
Nov 08 04:05:16 user nova-compute[75014]: iface.chap_auth = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.bidi_chap = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.strict_login_compliance = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.discovery_auth = <empty>
Nov 08 04:05:16 user nova-compute[75014]: iface.discovery_logout = <empty>
Nov 08 04:05:16 user nova-compute[75014]: node.discovery_address = <empty>
Nov 08 04:05:16 user nova-compute[75014]: node.discovery_port = 0
Nov 08 04:05:16 user nova-compute[75014]: node.discovery_type = static
Nov 08 04:05:16 user nova-compute[75014]: node.session.initial_cmdsn = 0
Nov 08 04:05:16 user nova-compute[75014]: node.session.initial_login_retry_max = 8
Nov 08 04:05:16 user nova-compute[75014]: node.session.xmit_thread_priority = -20
Nov 08 04:05:16 user nova-compute[75014]: node.session.cmds_max = 128
Nov 08 04:05:16 user nova-compute[75014]: node.session.queue_depth = 32
Nov 08 04:05:16 user nova-compute[75014]: node.session.nr_sessions = 1
Nov 08 04:05:16 user nova-compute[75014]: node.session.auth.authmethod = CHAP
Nov 08 04:05:16 user nova-compute[75014]: node.session.auth.username = oPyKNglX
Nov 08 04:05:16 user nova-compute[75014]: node.session.auth.password = ***
Nov 08 04:05:16 user nova-compute[75014]: node.session.auth.username_in = <empty>
Nov 08 04:05:16 user nova-compute[75014]: node.session.auth.password_in = <empty>
Nov 08 04:05:16 user nova-compute[75014]: node.session.auth.chap_algs = MD5
Nov 08 04:05:16 user nova-compute[75014]: node.session.timeo.replacement_timeout = 120
Nov 08 04:05:16 user nova-compute[75014]: node.session.err_timeo.abort_timeout = 15
Nov 08 04:05:16 user nova-compute[75014]: node.session.err_timeo.lu_reset_timeout = 30
Nov 08 04:05:16 user nova-compute[75014]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 08 04:05:16 user nova-compute[75014]: node.session.err_timeo.host_reset_timeout = 60
Nov 08 04:05:16 user nova-compute[75014]: node.session.iscsi.FastAbort = Yes
Nov 08 04:05:16 user nova-compute[75014]: node.session.iscsi.InitialR2T = No
Nov 08 04:05:16 user nova-compute[75014]: node.session.iscsi.ImmediateData = Yes
Nov 08 04:05:16 user nova-compute[75014]: node.session.iscsi.FirstBurstLength = 262144
Nov 08 04:05:16 user nova-compute[75014]: node.session.iscsi.MaxBurstLength = 16776192
Nov 08 04:05:16 user nova-compute[75014]: node.session.iscsi.DefaultTime2Retain = 0
Nov 08 04:05:16 user nova-compute[75014]: node.session.iscsi.DefaultTime2Wait = 2
Nov 08 04:05:16 user nova-compute[75014]: node.session.iscsi.MaxConnections = 1
Nov 08 04:05:16 user nova-compute[75014]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 08 04:05:16 user nova-compute[75014]: node.session.iscsi.ERL = 0
Nov 08 04:05:16 user nova-compute[75014]: node.session.scan = manual
Nov 08 04:05:16 user nova-compute[75014]: node.session.reopen_max = 0
Nov 08 04:05:16 user nova-compute[75014]: node.conn[0].address = 172.16.0.220
Nov 08 04:05:16 user nova-compute[75014]: node.conn[0].port = 3260
Nov 08 04:05:16 user nova-compute[75014]: node.conn[0].startup = manual
Nov 08 04:05:16 user nova-compute[75014]: node.conn[0].tcp.window_size = 524288
Nov 08 04:05:16 user nova-compute[75014]: node.conn[0].tcp.type_of_service = 0
Nov 08 04:05:16 user nova-compute[75014]: node.conn[0].timeo.logout_timeout = 15
Nov 08 04:05:16 user nova-compute[75014]: node.conn[0].timeo.login_timeout = 15
Nov 08 04:05:16 user nova-compute[75014]: node.conn[0].timeo.auth_timeout = 45
Nov 08 04:05:16 user nova-compute[75014]: node.conn[0].timeo.noop_out_interval = 5
Nov 08 04:05:16 user nova-compute[75014]: node.conn[0].timeo.noop_out_timeout = 5
Nov 08 04:05:16 user nova-compute[75014]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 08 04:05:16 user nova-compute[75014]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 08 04:05:16 user nova-compute[75014]: node.conn[0].iscsi.HeaderDigest = None
Nov 08 04:05:16 user nova-compute[75014]: node.conn[0].iscsi.DataDigest = None
Nov 08 04:05:16 user nova-compute[75014]: node.conn[0].iscsi.IFMarker = No
Nov 08 04:05:16 user nova-compute[75014]: node.conn[0].iscsi.OFMarker = No
Nov 08 04:05:16 user nova-compute[75014]: # END RECORD
Nov 08 04:05:16 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[033ead93-71bb-403b-8ea9-5295cd7ec3c7]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4947d5-ee94-4c7a-9595-ff6ceb6e74d6]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oPyKNglX {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oPyKNglX" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6f428a-6c22-4d10-98ca-ea8580f5d07a]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oPyKNglX'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9123ac2c-8489-472e-a63d-3f295846c8d7]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:05:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:17 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83f500a-a277-4b02-8add-1b9e88bcd481]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:05:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:05:17 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:05:17 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:05:17 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:05:17 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:05:17 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:05:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:05:17 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:05:17 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:05:17 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:05:17 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:05:17 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:05:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.174s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:05:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:05:17 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] HCTL ('40', '0', '0', 0) found on session 24 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:05:17 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Scanning host 40 c: 0, t: 0, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:05:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:17 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77ac9f1-0896-43cf-9fbe-ffe5381526c8]: (4, ('0 0 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:05:17 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Searching for a device in session 24 and hctl ('40', '0', '0', 0) yield: sdi {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:05:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oPyKNglX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:05:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.202s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:05:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] <== connect_volume: return (203ms) {'type': 'block', 'scsi_wwn': '26164636136386338', 'path': '/dev/sdi'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:05:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164636136386338', 'path': '/dev/sdi'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:05:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1905655883',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1905655883',id=28,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:03:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92a182cdeb8543fea1ab24326734991e',ramdisk_id='',reservation_id='r-0igftpd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648299000',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:03:49Z,user_data=None,user_id='630b9ba8f1d9471f9cea51f74106381a',uuid=0b3b62d9-2543-402b-bdb5-cac994b755c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b006ecf-b195-4491-8ba7-7109ae8701df", "address": "fa:16:3e:c5:3a:a9", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "vif_mac": "fa:16:3e:c5:3a:a9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b006ecf-b1", "ovs_interfaceid": "4b006ecf-b195-4491-8ba7-7109ae8701df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:05:17 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Converting VIF {"id": "4b006ecf-b195-4491-8ba7-7109ae8701df", "address": "fa:16:3e:c5:3a:a9", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "vif_mac": "fa:16:3e:c5:3a:a9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b006ecf-b1", "ovs_interfaceid": "4b006ecf-b195-4491-8ba7-7109ae8701df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:05:17 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:3a:a9,bridge_name='br-int',has_traffic_filtering=True,id=4b006ecf-b195-4491-8ba7-7109ae8701df,network=Network(d45dbf14-9570-46c1-91a3-cbe2f7972b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b006ecf-b1') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:05:17 user nova-compute[75014]: DEBUG nova.objects.instance [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b3b62d9-2543-402b-bdb5-cac994b755c9 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:05:17 user nova-compute[75014]: DEBUG nova.objects.base [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Object Instance<0b3b62d9-2543-402b-bdb5-cac994b755c9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:05:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:05:17 user nova-compute[75014]:   <uuid>0b3b62d9-2543-402b-bdb5-cac994b755c9</uuid>
Nov 08 04:05:17 user nova-compute[75014]:   <name>instance-0000001c</name>
Nov 08 04:05:17 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:05:17 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:05:17 user nova-compute[75014]:   <metadata>
Nov 08 04:05:17 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:05:17 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:05:17 user nova-compute[75014]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1905655883</nova:name>
Nov 08 04:05:17 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:05:16</nova:creationTime>
Nov 08 04:05:17 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:05:17 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:05:17 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:05:17 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:05:17 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:05:17 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:05:17 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:05:17 user nova-compute[75014]:       <nova:owner>
Nov 08 04:05:17 user nova-compute[75014]:         <nova:user uuid="630b9ba8f1d9471f9cea51f74106381a">tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member</nova:user>
Nov 08 04:05:17 user nova-compute[75014]:         <nova:project uuid="92a182cdeb8543fea1ab24326734991e">tempest-ServerBootFromVolumeStableRescueTest-1648299000</nova:project>
Nov 08 04:05:17 user nova-compute[75014]:       </nova:owner>
Nov 08 04:05:17 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:05:17 user nova-compute[75014]:       <nova:ports>
Nov 08 04:05:17 user nova-compute[75014]:         <nova:port uuid="4b006ecf-b195-4491-8ba7-7109ae8701df">
Nov 08 04:05:17 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 04:05:17 user nova-compute[75014]:         </nova:port>
Nov 08 04:05:17 user nova-compute[75014]:       </nova:ports>
Nov 08 04:05:17 user nova-compute[75014]:     </nova:instance>
Nov 08 04:05:17 user nova-compute[75014]:   </metadata>
Nov 08 04:05:17 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:05:17 user nova-compute[75014]:     <system>
Nov 08 04:05:17 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:05:17 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:05:17 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:05:17 user nova-compute[75014]:       <entry name="serial">0b3b62d9-2543-402b-bdb5-cac994b755c9</entry>
Nov 08 04:05:17 user nova-compute[75014]:       <entry name="uuid">0b3b62d9-2543-402b-bdb5-cac994b755c9</entry>
Nov 08 04:05:17 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:05:17 user nova-compute[75014]:     </system>
Nov 08 04:05:17 user nova-compute[75014]:   </sysinfo>
Nov 08 04:05:17 user nova-compute[75014]:   <os>
Nov 08 04:05:17 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:05:17 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:05:17 user nova-compute[75014]:   </os>
Nov 08 04:05:17 user nova-compute[75014]:   <features>
Nov 08 04:05:17 user nova-compute[75014]:     <acpi/>
Nov 08 04:05:17 user nova-compute[75014]:     <apic/>
Nov 08 04:05:17 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:05:17 user nova-compute[75014]:   </features>
Nov 08 04:05:17 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:05:17 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:05:17 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:05:17 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:05:17 user nova-compute[75014]:   </clock>
Nov 08 04:05:17 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:05:17 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:05:17 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:05:17 user nova-compute[75014]:   </cpu>
Nov 08 04:05:17 user nova-compute[75014]:   <devices>
Nov 08 04:05:17 user nova-compute[75014]:     <disk type="block" device="disk">
Nov 08 04:05:17 user nova-compute[75014]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:05:17 user nova-compute[75014]:       <source dev="/dev/sdi"/>
Nov 08 04:05:17 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:05:17 user nova-compute[75014]:       <serial>47179dad-70f6-4bbd-afc1-51487445cd00</serial>
Nov 08 04:05:17 user nova-compute[75014]:     </disk>
Nov 08 04:05:17 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 04:05:17 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 04:05:17 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/0b3b62d9-2543-402b-bdb5-cac994b755c9/disk.rescue"/>
Nov 08 04:05:17 user nova-compute[75014]:       <target dev="vdb" bus="virtio"/>
Nov 08 04:05:17 user nova-compute[75014]:       <boot order="1"/>
Nov 08 04:05:17 user nova-compute[75014]:     </disk>
Nov 08 04:05:17 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:05:17 user nova-compute[75014]:       <mac address="fa:16:3e:c5:3a:a9"/>
Nov 08 04:05:17 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:05:17 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:05:17 user nova-compute[75014]:       <target dev="tap4b006ecf-b1"/>
Nov 08 04:05:17 user nova-compute[75014]:     </interface>
Nov 08 04:05:17 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:05:17 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/0b3b62d9-2543-402b-bdb5-cac994b755c9/console.log" append="off"/>
Nov 08 04:05:17 user nova-compute[75014]:     </serial>
Nov 08 04:05:17 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:05:17 user nova-compute[75014]:     <video>
Nov 08 04:05:17 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:05:17 user nova-compute[75014]:     </video>
Nov 08 04:05:17 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:05:17 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:05:17 user nova-compute[75014]:     </rng>
Nov 08 04:05:17 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:05:17 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:05:17 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:05:17 user nova-compute[75014]:     </memballoon>
Nov 08 04:05:17 user nova-compute[75014]:   </devices>
Nov 08 04:05:17 user nova-compute[75014]: </domain>
Nov 08 04:05:17 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:05:17 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Instance destroyed successfully.
Nov 08 04:05:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:05:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:05:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] No VIF found with MAC fa:16:3e:c5:3a:a9, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:05:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:17 user nova-compute[75014]: DEBUG nova.objects.instance [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lazy-loading 'flavor' on Instance uuid 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:05:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-83843b28-0543-4c3f-8b18-57b3f37ee5ef tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.332s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:05:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:18 user nova-compute[75014]: DEBUG nova.compute.manager [req-083780f2-88fa-418b-8a9a-ddf597776d8c req-598c7994-5b18-4938-a50e-e39dcfef72f4 service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Received event network-vif-plugged-4b006ecf-b195-4491-8ba7-7109ae8701df {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:05:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-083780f2-88fa-418b-8a9a-ddf597776d8c req-598c7994-5b18-4938-a50e-e39dcfef72f4 service nova] Acquiring lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:05:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-083780f2-88fa-418b-8a9a-ddf597776d8c req-598c7994-5b18-4938-a50e-e39dcfef72f4 service nova] Lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:05:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-083780f2-88fa-418b-8a9a-ddf597776d8c req-598c7994-5b18-4938-a50e-e39dcfef72f4 service nova] Lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:05:18 user nova-compute[75014]: DEBUG nova.compute.manager [req-083780f2-88fa-418b-8a9a-ddf597776d8c req-598c7994-5b18-4938-a50e-e39dcfef72f4 service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] No waiting events found dispatching network-vif-plugged-4b006ecf-b195-4491-8ba7-7109ae8701df {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:05:18 user nova-compute[75014]: WARNING nova.compute.manager [req-083780f2-88fa-418b-8a9a-ddf597776d8c req-598c7994-5b18-4938-a50e-e39dcfef72f4 service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Received unexpected event network-vif-plugged-4b006ecf-b195-4491-8ba7-7109ae8701df for instance with vm_state active and task_state rescuing.
Nov 08 04:05:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:20 user nova-compute[75014]: DEBUG nova.compute.manager [None req-8eda6093-d2a8-459e-af57-264f66340982 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:05:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-3b5eae18-740f-42ac-81d4-6e0279350ecb req-6d2a5239-7c06-482a-a275-6ffa8535e517 service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Received event network-vif-plugged-4b006ecf-b195-4491-8ba7-7109ae8701df {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:05:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3b5eae18-740f-42ac-81d4-6e0279350ecb req-6d2a5239-7c06-482a-a275-6ffa8535e517 service nova] Acquiring lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:05:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3b5eae18-740f-42ac-81d4-6e0279350ecb req-6d2a5239-7c06-482a-a275-6ffa8535e517 service nova] Lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:05:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3b5eae18-740f-42ac-81d4-6e0279350ecb req-6d2a5239-7c06-482a-a275-6ffa8535e517 service nova] Lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:05:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-3b5eae18-740f-42ac-81d4-6e0279350ecb req-6d2a5239-7c06-482a-a275-6ffa8535e517 service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] No waiting events found dispatching network-vif-plugged-4b006ecf-b195-4491-8ba7-7109ae8701df {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:05:20 user nova-compute[75014]: WARNING nova.compute.manager [req-3b5eae18-740f-42ac-81d4-6e0279350ecb req-6d2a5239-7c06-482a-a275-6ffa8535e517 service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Received unexpected event network-vif-plugged-4b006ecf-b195-4491-8ba7-7109ae8701df for instance with vm_state active and task_state rescuing.
Nov 08 04:05:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:29 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d4726cd1-51ea-41e2-ad36-be12b4d4c26b is timed out.
Nov 08 04:05:29 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Successfully detached device vdb from instance d4726cd1-51ea-41e2-ad36-be12b4d4c26b from the live domain config.
Nov 08 04:05:29 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TlRmnGCu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:05:29 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:05:29 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0ada58-f48d-4003-9acc-948b4472ddd6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:05:29 user nova-compute[75014]: No targets found.
Nov 08 04:05:29 user nova-compute[75014]: iSNS:
Nov 08 04:05:29 user nova-compute[75014]: No targets found.
Nov 08 04:05:29 user nova-compute[75014]: STATIC:
Nov 08 04:05:29 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908
Nov 08 04:05:29 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:05:29 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:05:29 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec
Nov 08 04:05:29 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:05:29 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:05:29 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00
Nov 08 04:05:29 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:05:29 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:05:29 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:05:29 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:05:29 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:05:29 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a
Nov 08 04:05:29 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:05:29 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:05:29 user nova-compute[75014]: FIRMWARE:
Nov 08 04:05:29 user nova-compute[75014]: No targets found.
Nov 08 04:05:29 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:05:29 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:05:29 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9622276-928a-424b-a6fe-c3a33a9db752]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[990be50f-1a27-4bf7-bcc0-a951053ce48b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:05:29 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:05:29 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:05:29 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:05:29 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:05:29 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:05:29 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:05:29 user nova-compute[75014]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 (non-flash)
Nov 08 04:05:29 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:05:29 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:05:29 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0420151990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908'): ({'sdf'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Removing single pathed devices sdf {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[df977ddf-91a1-4f23-b0c6-b488db7a14cf]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d91214c-4e83-4686-9a2e-faea26b46064]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Flushing IO for device /dev/sdf {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a549cf6-0c1d-435b-bd82-4c4a7cfc3d39]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.028s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5831c4-0a71-4418-9d97-898f5b098322]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] SCSI volumes sdf have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b00baa2-c74d-4f7e-9e1c-be71bcc0e861]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2bc62c-e9d0-4cb6-a2de-04b989ab8c6f]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908, portal: 172.16.0.220,3260]
Nov 08 04:05:29 user nova-compute[75014]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908, portal: 172.16.0.220,3260] successful.
Nov 08 04:05:29 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4874793-2dda-4382-8193-78c9540c5908 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4bb62c-49f4-4702-bccf-c2cf9a363df3]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] <== disconnect_volume: return (301ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:05:29 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:05:30 user nova-compute[75014]: DEBUG nova.objects.instance [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lazy-loading 'flavor' on Instance uuid d4726cd1-51ea-41e2-ad36-be12b4d4c26b {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:05:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-16cb70bd-7175-4649-b3cb-732058a6cdbe tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.897s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:05:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:35 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:05:35 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:05:35 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:05:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:05:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:05:35 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 04:05:35 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Updating instance_info_cache with network_info: [{"id": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "address": "fa:16:3e:d8:7a:3e", "network": {"id": "64afeb98-3d7d-4d85-a8ac-2deff17e7463", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-737690621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05de04b5317b4257b434019a2db27f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d19a877-95", "ovs_interfaceid": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:05:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:05:35 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 04:05:35 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:05:35 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:05:35 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:05:35 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:05:35 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:05:36 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:05:36 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=75014) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 04:05:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:37 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:05:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:38 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:05:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:05:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:05:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:05:38 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:05:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:05:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75d85e9b-5364-4838-bd6a-c044b6290e7f/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75d85e9b-5364-4838-bd6a-c044b6290e7f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75d85e9b-5364-4838-bd6a-c044b6290e7f/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75d85e9b-5364-4838-bd6a-c044b6290e7f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:05:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b3b62d9-2543-402b-bdb5-cac994b755c9/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b3b62d9-2543-402b-bdb5-cac994b755c9/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b3b62d9-2543-402b-bdb5-cac994b755c9/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b3b62d9-2543-402b-bdb5-cac994b755c9/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:05:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:44 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:05:44 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:05:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=6962MB free_disk=24.554363250732422GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:05:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:05:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:05:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9f205fe5-576f-4ef0-874b-1544c0307a7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:05:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 5bfa6580-e0fe-46b0-b497-8db67806113a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:05:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 8527ee40-fb8a-469b-9696-d7bde8cc96f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:05:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 655fe5eb-1271-4b9f-a5a6-6342bd012a69 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:05:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance bd153f84-98cd-4c6d-a7ab-5759b0b5bf55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:05:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:05:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance d4726cd1-51ea-41e2-ad36-be12b4d4c26b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:05:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance d555b6b3-86ec-40ae-aa20-48846b5157d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:05:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance c23c9e00-b782-4530-bb01-a7a167951c1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:05:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 0b3b62d9-2543-402b-bdb5-cac994b755c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:05:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 36a4109b-f239-48ce-ad49-e640a12a73bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:05:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 781932ce-0bea-466f-95e0-066130d6c410 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:05:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 75d85e9b-5364-4838-bd6a-c044b6290e7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:05:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 1cb11358-b4c4-47f4-ba30-d967d523f98a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:05:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:05:44 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:05:44 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Refreshing inventories for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 04:05:44 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Updating ProviderTree inventory for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 04:05:44 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Updating inventory in ProviderTree for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 04:05:44 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Refreshing aggregate associations for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0, aggregates: None {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 04:05:44 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Refreshing trait associations for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 04:05:45 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:05:45 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:05:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:05:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.776s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:05:46 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:05:46 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:05:46 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:05:46 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:05:46 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Cleaning up deleted instances {{(pid=75014) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 04:05:46 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] There are 0 instances to clean {{(pid=75014) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 04:05:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:05:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:05:51 user nova-compute[75014]: DEBUG nova.objects.instance [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lazy-loading 'flavor' on Instance uuid 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:05:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:05:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:05:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:05:51 user nova-compute[75014]: INFO nova.compute.manager [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Attaching volume 61141d33-5365-41e4-ac05-660439875401 to /dev/vdb
Nov 08 04:05:51 user nova-compute[75014]: DEBUG os_brick.utils [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:05:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:51 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[451408ce-5381-4541-9c7c-98f2650b5440]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:05:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:51 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3a7d8d-8f95-45d8-8e34-365b3fdd95d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:05:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:05:51 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[504cd6db-163a-4d7d-b68a-4802983403f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:05:51 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bbe324-98f4-44c9-b8af-969377434fc9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:05:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:05:52 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:05:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:05:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:05:52 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:05:52 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c21671-3688-472d-b791-327934128916]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:05:52 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:05:52 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:05:52 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:05:52 user nova-compute[75014]: DEBUG os_brick.utils [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:05:52 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Updating existing volume attachment record: a4d9b005-ac5a-4587-b80c-935197078f4c {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:05:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-35cb9098-b2fc-41d1-b2bb-a7fd1356f9e3 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:05:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-35cb9098-b2fc-41d1-b2bb-a7fd1356f9e3 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:05:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-35cb9098-b2fc-41d1-b2bb-a7fd1356f9e3 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:05:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-35cb9098-b2fc-41d1-b2bb-a7fd1356f9e3 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:05:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-35cb9098-b2fc-41d1-b2bb-a7fd1356f9e3 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:05:59 user nova-compute[75014]: INFO nova.compute.manager [None req-35cb9098-b2fc-41d1-b2bb-a7fd1356f9e3 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Terminating instance
Nov 08 04:05:59 user nova-compute[75014]: DEBUG nova.compute.manager [None req-35cb9098-b2fc-41d1-b2bb-a7fd1356f9e3 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:05:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:59 user nova-compute[75014]: DEBUG nova.compute.manager [req-a409a378-a2a9-4d21-8fca-8148d7a1ac1b req-b145a159-2999-427a-9f16-02d06a3c1439 service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Received event network-vif-unplugged-564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:05:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a409a378-a2a9-4d21-8fca-8148d7a1ac1b req-b145a159-2999-427a-9f16-02d06a3c1439 service nova] Acquiring lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:05:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a409a378-a2a9-4d21-8fca-8148d7a1ac1b req-b145a159-2999-427a-9f16-02d06a3c1439 service nova] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:05:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a409a378-a2a9-4d21-8fca-8148d7a1ac1b req-b145a159-2999-427a-9f16-02d06a3c1439 service nova] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:05:59 user nova-compute[75014]: DEBUG nova.compute.manager [req-a409a378-a2a9-4d21-8fca-8148d7a1ac1b req-b145a159-2999-427a-9f16-02d06a3c1439 service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] No waiting events found dispatching network-vif-unplugged-564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:05:59 user nova-compute[75014]: DEBUG nova.compute.manager [req-a409a378-a2a9-4d21-8fca-8148d7a1ac1b req-b145a159-2999-427a-9f16-02d06a3c1439 service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Received event network-vif-unplugged-564c15b6-eb02-4a0c-8b00-d611297ac247 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:05:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:59 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Instance destroyed successfully.
Nov 08 04:05:59 user nova-compute[75014]: DEBUG nova.objects.instance [None req-35cb9098-b2fc-41d1-b2bb-a7fd1356f9e3 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lazy-loading 'resources' on Instance uuid d4726cd1-51ea-41e2-ad36-be12b4d4c26b {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:05:59 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-35cb9098-b2fc-41d1-b2bb-a7fd1356f9e3 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:59:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1421912526',display_name='tempest-ServerRescueNegativeTestJSON-server-1421912526',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1421912526',id=21,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFwBuDYKBVjyeJogLynZj8+TTisND9lq7izW1C75IPBZUw7A+Avd65fAZEkhYC2Vp028fHOOpOV5PXI6M6n1Bu6VpxGhH8gCkRhrS+3+7bXxUQLK7wqKxJNtOzyYg+8dw==',key_name='tempest-keypair-721990497',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:01:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b48713cc3a8e4082b76fc0408088c607',ramdisk_id='',reservation_id='r-gnos5l9u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1450625183',owner_user_name='tempest-ServerRescueNegativeTestJSON-1450625183-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:03:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffadb91b73464e559344658dd11bf60d',uuid=d4726cd1-51ea-41e2-ad36-be12b4d4c26b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "564c15b6-eb02-4a0c-8b00-d611297ac247", "address": "fa:16:3e:60:c7:25", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap564c15b6-eb", "ovs_interfaceid": "564c15b6-eb02-4a0c-8b00-d611297ac247", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:05:59 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-35cb9098-b2fc-41d1-b2bb-a7fd1356f9e3 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Converting VIF {"id": "564c15b6-eb02-4a0c-8b00-d611297ac247", "address": "fa:16:3e:60:c7:25", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap564c15b6-eb", "ovs_interfaceid": "564c15b6-eb02-4a0c-8b00-d611297ac247", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:05:59 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-35cb9098-b2fc-41d1-b2bb-a7fd1356f9e3 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:c7:25,bridge_name='br-int',has_traffic_filtering=True,id=564c15b6-eb02-4a0c-8b00-d611297ac247,network=Network(982531ca-8a2f-41de-b62e-5b43b6a45a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap564c15b6-eb') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:05:59 user nova-compute[75014]: DEBUG os_vif [None req-35cb9098-b2fc-41d1-b2bb-a7fd1356f9e3 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:c7:25,bridge_name='br-int',has_traffic_filtering=True,id=564c15b6-eb02-4a0c-8b00-d611297ac247,network=Network(982531ca-8a2f-41de-b62e-5b43b6a45a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap564c15b6-eb') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:05:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap564c15b6-eb, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:05:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ec3448a-86ac-4070-98a5-83511363b27d) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:05:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:05:59 user nova-compute[75014]: INFO os_vif [None req-35cb9098-b2fc-41d1-b2bb-a7fd1356f9e3 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:c7:25,bridge_name='br-int',has_traffic_filtering=True,id=564c15b6-eb02-4a0c-8b00-d611297ac247,network=Network(982531ca-8a2f-41de-b62e-5b43b6a45a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap564c15b6-eb')
Nov 08 04:05:59 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-35cb9098-b2fc-41d1-b2bb-a7fd1356f9e3 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Deleting instance files /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b_del
Nov 08 04:05:59 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-35cb9098-b2fc-41d1-b2bb-a7fd1356f9e3 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Deletion of /opt/stack/data/nova/instances/d4726cd1-51ea-41e2-ad36-be12b4d4c26b_del complete
Nov 08 04:06:00 user nova-compute[75014]: INFO nova.compute.manager [None req-35cb9098-b2fc-41d1-b2bb-a7fd1356f9e3 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 08 04:06:00 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-35cb9098-b2fc-41d1-b2bb-a7fd1356f9e3 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:06:00 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:06:00 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:06:01 user nova-compute[75014]: DEBUG nova.compute.manager [req-773d2374-e144-4b59-b2d3-9f921fa3ef8c req-c032b976-a0da-4a6d-8d45-c7a365cbb8cd service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Received event network-vif-plugged-564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:06:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-773d2374-e144-4b59-b2d3-9f921fa3ef8c req-c032b976-a0da-4a6d-8d45-c7a365cbb8cd service nova] Acquiring lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-773d2374-e144-4b59-b2d3-9f921fa3ef8c req-c032b976-a0da-4a6d-8d45-c7a365cbb8cd service nova] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-773d2374-e144-4b59-b2d3-9f921fa3ef8c req-c032b976-a0da-4a6d-8d45-c7a365cbb8cd service nova] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:01 user nova-compute[75014]: DEBUG nova.compute.manager [req-773d2374-e144-4b59-b2d3-9f921fa3ef8c req-c032b976-a0da-4a6d-8d45-c7a365cbb8cd service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] No waiting events found dispatching network-vif-plugged-564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:06:01 user nova-compute[75014]: WARNING nova.compute.manager [req-773d2374-e144-4b59-b2d3-9f921fa3ef8c req-c032b976-a0da-4a6d-8d45-c7a365cbb8cd service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Received unexpected event network-vif-plugged-564c15b6-eb02-4a0c-8b00-d611297ac247 for instance with vm_state active and task_state deleting.
Nov 08 04:06:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:01 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:06:01 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Took 1.63 seconds to deallocate network for instance.
Nov 08 04:06:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "449e9147-efe0-4aa1-af52-557e313bf7fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "449e9147-efe0-4aa1-af52-557e313bf7fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:01 user nova-compute[75014]: DEBUG nova.compute.manager [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 04:06:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-35cb9098-b2fc-41d1-b2bb-a7fd1356f9e3 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-35cb9098-b2fc-41d1-b2bb-a7fd1356f9e3 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:01 user nova-compute[75014]: DEBUG nova.compute.manager [req-094d2303-49af-402f-abdf-efea7ce19a1d req-6f5e604b-ff1d-4e52-b615-96a5bc6d2e3b service nova] [instance: d4726cd1-51ea-41e2-ad36-be12b4d4c26b] Received event network-vif-deleted-564c15b6-eb02-4a0c-8b00-d611297ac247 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:06:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:02 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-35cb9098-b2fc-41d1-b2bb-a7fd1356f9e3 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:06:02 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-35cb9098-b2fc-41d1-b2bb-a7fd1356f9e3 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:06:02 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-35cb9098-b2fc-41d1-b2bb-a7fd1356f9e3 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.537s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:02 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.469s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:02 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 04:06:02 user nova-compute[75014]: INFO nova.compute.claims [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Claim successful on node user
Nov 08 04:06:02 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-35cb9098-b2fc-41d1-b2bb-a7fd1356f9e3 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Deleted allocations for instance d4726cd1-51ea-41e2-ad36-be12b4d4c26b
Nov 08 04:06:02 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-35cb9098-b2fc-41d1-b2bb-a7fd1356f9e3 tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "d4726cd1-51ea-41e2-ad36-be12b4d4c26b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.325s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:02 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:06:02 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:06:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.791s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:03 user nova-compute[75014]: DEBUG nova.compute.manager [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 04:06:03 user nova-compute[75014]: DEBUG nova.compute.manager [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 04:06:03 user nova-compute[75014]: DEBUG nova.network.neutron [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 04:06:03 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 04:06:03 user nova-compute[75014]: DEBUG nova.compute.manager [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 04:06:03 user nova-compute[75014]: DEBUG nova.policy [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '377368f8d9a540aebd8b8760b7130fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60831c0130424415a7bcf071bba28ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 04:06:03 user nova-compute[75014]: DEBUG nova.compute.manager [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 04:06:03 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 04:06:03 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Creating image(s)
Nov 08 04:06:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "/opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "/opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "/opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "0fb68e36341c4b222863c97cccec08b006a88e0b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "0fb68e36341c4b222863c97cccec08b006a88e0b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:03 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fb68e36341c4b222863c97cccec08b006a88e0b.part --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:03 user nova-compute[75014]: DEBUG nova.network.neutron [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Successfully created port: f85faa29-4fe7-4ef1-b746-a1bcad900d9f {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 04:06:03 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fb68e36341c4b222863c97cccec08b006a88e0b.part --force-share --output=json" returned: 0 in 0.196s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:03 user nova-compute[75014]: DEBUG nova.virt.images [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] 99456f5c-cff4-4ad8-afe3-4f5454f6e3ab was qcow2, converting to raw {{(pid=75014) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 04:06:03 user nova-compute[75014]: DEBUG nova.privsep.utils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75014) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 04:06:03 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0fb68e36341c4b222863c97cccec08b006a88e0b.part /opt/stack/data/nova/instances/_base/0fb68e36341c4b222863c97cccec08b006a88e0b.converted {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:04 user nova-compute[75014]: INFO nova.compute.manager [None req-2bddf715-8553-4103-8bc7-af8917757f63 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Get console output
Nov 08 04:06:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0fb68e36341c4b222863c97cccec08b006a88e0b.part /opt/stack/data/nova/instances/_base/0fb68e36341c4b222863c97cccec08b006a88e0b.converted" returned: 0 in 0.421s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fb68e36341c4b222863c97cccec08b006a88e0b.converted --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fb68e36341c4b222863c97cccec08b006a88e0b.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "0fb68e36341c4b222863c97cccec08b006a88e0b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.263s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fb68e36341c4b222863c97cccec08b006a88e0b --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:04 user nova-compute[75014]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 08 04:06:04 user nova-compute[75014]: DEBUG nova.network.neutron [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Successfully updated port: f85faa29-4fe7-4ef1-b746-a1bcad900d9f {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 04:06:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "refresh_cache-449e9147-efe0-4aa1-af52-557e313bf7fe" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:06:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquired lock "refresh_cache-449e9147-efe0-4aa1-af52-557e313bf7fe" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:06:04 user nova-compute[75014]: DEBUG nova.network.neutron [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:06:04 user nova-compute[75014]: DEBUG nova.compute.manager [req-0db2c3c0-0ca7-4a6a-a279-4eadc92d0088 req-0d760122-5a2c-4759-8719-2c7021357d5e service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Received event network-changed-f85faa29-4fe7-4ef1-b746-a1bcad900d9f {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:06:04 user nova-compute[75014]: DEBUG nova.compute.manager [req-0db2c3c0-0ca7-4a6a-a279-4eadc92d0088 req-0d760122-5a2c-4759-8719-2c7021357d5e service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Refreshing instance network info cache due to event network-changed-f85faa29-4fe7-4ef1-b746-a1bcad900d9f. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:06:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0db2c3c0-0ca7-4a6a-a279-4eadc92d0088 req-0d760122-5a2c-4759-8719-2c7021357d5e service nova] Acquiring lock "refresh_cache-449e9147-efe0-4aa1-af52-557e313bf7fe" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:06:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fb68e36341c4b222863c97cccec08b006a88e0b --force-share --output=json" returned: 0 in 0.199s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "0fb68e36341c4b222863c97cccec08b006a88e0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "0fb68e36341c4b222863c97cccec08b006a88e0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fb68e36341c4b222863c97cccec08b006a88e0b --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:04 user nova-compute[75014]: DEBUG nova.network.neutron [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 04:06:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fb68e36341c4b222863c97cccec08b006a88e0b --force-share --output=json" returned: 0 in 0.181s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fb68e36341c4b222863c97cccec08b006a88e0b,backing_fmt=raw /opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fb68e36341c4b222863c97cccec08b006a88e0b,backing_fmt=raw /opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe/disk 1073741824" returned: 0 in 0.060s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "0fb68e36341c4b222863c97cccec08b006a88e0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fb68e36341c4b222863c97cccec08b006a88e0b --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.network.neutron [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Updating instance_info_cache with network_info: [{"id": "f85faa29-4fe7-4ef1-b746-a1bcad900d9f", "address": "fa:16:3e:e3:84:5d", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85faa29-4f", "ovs_interfaceid": "f85faa29-4fe7-4ef1-b746-a1bcad900d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Acquiring lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Releasing lock "refresh_cache-449e9147-efe0-4aa1-af52-557e313bf7fe" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.compute.manager [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Instance network_info: |[{"id": "f85faa29-4fe7-4ef1-b746-a1bcad900d9f", "address": "fa:16:3e:e3:84:5d", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85faa29-4f", "ovs_interfaceid": "f85faa29-4fe7-4ef1-b746-a1bcad900d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0db2c3c0-0ca7-4a6a-a279-4eadc92d0088 req-0d760122-5a2c-4759-8719-2c7021357d5e service nova] Acquired lock "refresh_cache-449e9147-efe0-4aa1-af52-557e313bf7fe" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.network.neutron [req-0db2c3c0-0ca7-4a6a-a279-4eadc92d0088 req-0d760122-5a2c-4759-8719-2c7021357d5e service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Refreshing network info cache for port f85faa29-4fe7-4ef1-b746-a1bcad900d9f {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:06:05 user nova-compute[75014]: INFO nova.compute.manager [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Detaching volume 65b5a229-3d47-4b3c-bfec-b2ea92cb906a
Nov 08 04:06:05 user nova-compute[75014]: INFO nova.virt.block_device [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Attempting to driver detach volume 65b5a229-3d47-4b3c-bfec-b2ea92cb906a from mountpoint /dev/vdb
Nov 08 04:06:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fb68e36341c4b222863c97cccec08b006a88e0b --force-share --output=json" returned: 0 in 0.190s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Checking if we can resize image /opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Attempting to detach device vdb from instance bd153f84-98cd-4c6d-a7ab-5759b0b5bf55 from the persistent domain config. {{(pid=75014) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:06:05 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:06:05 user nova-compute[75014]:   <source dev="/dev/sdb"/>
Nov 08 04:06:05 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:06:05 user nova-compute[75014]:   <serial>65b5a229-3d47-4b3c-bfec-b2ea92cb906a</serial>
Nov 08 04:06:05 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:06:05 user nova-compute[75014]: </disk>
Nov 08 04:06:05 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:06:05 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Successfully detached device vdb from instance bd153f84-98cd-4c6d-a7ab-5759b0b5bf55 from the persistent domain config.
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bd153f84-98cd-4c6d-a7ab-5759b0b5bf55 from the live domain config. {{(pid=75014) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:06:05 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:06:05 user nova-compute[75014]:   <source dev="/dev/sdb"/>
Nov 08 04:06:05 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:06:05 user nova-compute[75014]:   <serial>65b5a229-3d47-4b3c-bfec-b2ea92cb906a</serial>
Nov 08 04:06:05 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:06:05 user nova-compute[75014]: </disk>
Nov 08 04:06:05 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Cannot resize image /opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Ensure instance console log exists: /opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Start _get_guest_xml network_info=[{"id": "f85faa29-4fe7-4ef1-b746-a1bcad900d9f", "address": "fa:16:3e:e3:84:5d", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85faa29-4f", "ovs_interfaceid": "f85faa29-4fe7-4ef1-b746-a1bcad900d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T04:05:58Z,direct_url=<?>,disk_format='qcow2',id=99456f5c-cff4-4ad8-afe3-4f5454f6e3ab,min_disk=0,min_ram=0,name='tempest-scenario-img--859523711',owner='60831c0130424415a7bcf071bba28ab0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T04:06:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '99456f5c-cff4-4ad8-afe3-4f5454f6e3ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:06:05 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:06:05 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T04:05:58Z,direct_url=<?>,disk_format='qcow2',id=99456f5c-cff4-4ad8-afe3-4f5454f6e3ab,min_disk=0,min_ram=0,name='tempest-scenario-img--859523711',owner='60831c0130424415a7bcf071bba28ab0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T04:06:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-947753843',display_name='tempest-TestMinimumBasicScenario-server-947753843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-947753843',id=33,image_ref='99456f5c-cff4-4ad8-afe3-4f5454f6e3ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3nXb/RsyynTT5PUm/7pMaVbxD4C3VjPlxa28BU5xF0dIuRS2NrCPk10dkh/0jcqwT/gsbFXl8ojWfehBZis3ZqP+9JIQ5oyzaX3WITaf2SiIc2xAnIEX2eRQmv+TgEFA==',key_name='tempest-TestMinimumBasicScenario-668009236',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60831c0130424415a7bcf071bba28ab0',ramdisk_id='',reservation_id='r-fulgpybi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='99456f5c-cff4-4ad8-afe3-4f5454f6e3ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-696617302',owner_user_name='tempest-TestMinimumBasicScenario-696617302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:06:03Z,user_data=None,user_id='377368f8d9a540aebd8b8760b7130fb5',uuid=449e9147-efe0-4aa1-af52-557e313bf7fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f85faa29-4fe7-4ef1-b746-a1bcad900d9f", "address": "fa:16:3e:e3:84:5d", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85faa29-4f", "ovs_interfaceid": "f85faa29-4fe7-4ef1-b746-a1bcad900d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Converting VIF {"id": "f85faa29-4fe7-4ef1-b746-a1bcad900d9f", "address": "fa:16:3e:e3:84:5d", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85faa29-4f", "ovs_interfaceid": "f85faa29-4fe7-4ef1-b746-a1bcad900d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:84:5d,bridge_name='br-int',has_traffic_filtering=True,id=f85faa29-4fe7-4ef1-b746-a1bcad900d9f,network=Network(b36b65ee-1443-4741-946a-096b65a4e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85faa29-4f') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.objects.instance [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lazy-loading 'pci_devices' on Instance uuid 449e9147-efe0-4aa1-af52-557e313bf7fe {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.network.neutron [req-0db2c3c0-0ca7-4a6a-a279-4eadc92d0088 req-0d760122-5a2c-4759-8719-2c7021357d5e service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Updated VIF entry in instance network info cache for port f85faa29-4fe7-4ef1-b746-a1bcad900d9f. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.network.neutron [req-0db2c3c0-0ca7-4a6a-a279-4eadc92d0088 req-0d760122-5a2c-4759-8719-2c7021357d5e service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Updating instance_info_cache with network_info: [{"id": "f85faa29-4fe7-4ef1-b746-a1bcad900d9f", "address": "fa:16:3e:e3:84:5d", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85faa29-4f", "ovs_interfaceid": "f85faa29-4fe7-4ef1-b746-a1bcad900d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:06:05 user nova-compute[75014]:   <uuid>449e9147-efe0-4aa1-af52-557e313bf7fe</uuid>
Nov 08 04:06:05 user nova-compute[75014]:   <name>instance-00000021</name>
Nov 08 04:06:05 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:06:05 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:06:05 user nova-compute[75014]:   <metadata>
Nov 08 04:06:05 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:06:05 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:06:05 user nova-compute[75014]:       <nova:name>tempest-TestMinimumBasicScenario-server-947753843</nova:name>
Nov 08 04:06:05 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:06:05</nova:creationTime>
Nov 08 04:06:05 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:06:05 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:06:05 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:06:05 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:06:05 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:06:05 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:06:05 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:06:05 user nova-compute[75014]:       <nova:owner>
Nov 08 04:06:05 user nova-compute[75014]:         <nova:user uuid="377368f8d9a540aebd8b8760b7130fb5">tempest-TestMinimumBasicScenario-696617302-project-member</nova:user>
Nov 08 04:06:05 user nova-compute[75014]:         <nova:project uuid="60831c0130424415a7bcf071bba28ab0">tempest-TestMinimumBasicScenario-696617302</nova:project>
Nov 08 04:06:05 user nova-compute[75014]:       </nova:owner>
Nov 08 04:06:05 user nova-compute[75014]:       <nova:root type="image" uuid="99456f5c-cff4-4ad8-afe3-4f5454f6e3ab"/>
Nov 08 04:06:05 user nova-compute[75014]:       <nova:ports>
Nov 08 04:06:05 user nova-compute[75014]:         <nova:port uuid="f85faa29-4fe7-4ef1-b746-a1bcad900d9f">
Nov 08 04:06:05 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 04:06:05 user nova-compute[75014]:         </nova:port>
Nov 08 04:06:05 user nova-compute[75014]:       </nova:ports>
Nov 08 04:06:05 user nova-compute[75014]:     </nova:instance>
Nov 08 04:06:05 user nova-compute[75014]:   </metadata>
Nov 08 04:06:05 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:06:05 user nova-compute[75014]:     <system>
Nov 08 04:06:05 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:06:05 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:06:05 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:06:05 user nova-compute[75014]:       <entry name="serial">449e9147-efe0-4aa1-af52-557e313bf7fe</entry>
Nov 08 04:06:05 user nova-compute[75014]:       <entry name="uuid">449e9147-efe0-4aa1-af52-557e313bf7fe</entry>
Nov 08 04:06:05 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:06:05 user nova-compute[75014]:     </system>
Nov 08 04:06:05 user nova-compute[75014]:   </sysinfo>
Nov 08 04:06:05 user nova-compute[75014]:   <os>
Nov 08 04:06:05 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:06:05 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:06:05 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:06:05 user nova-compute[75014]:   </os>
Nov 08 04:06:05 user nova-compute[75014]:   <features>
Nov 08 04:06:05 user nova-compute[75014]:     <acpi/>
Nov 08 04:06:05 user nova-compute[75014]:     <apic/>
Nov 08 04:06:05 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:06:05 user nova-compute[75014]:   </features>
Nov 08 04:06:05 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:06:05 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:06:05 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:06:05 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:06:05 user nova-compute[75014]:   </clock>
Nov 08 04:06:05 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:06:05 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:06:05 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:06:05 user nova-compute[75014]:   </cpu>
Nov 08 04:06:05 user nova-compute[75014]:   <devices>
Nov 08 04:06:05 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 04:06:05 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 04:06:05 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe/disk"/>
Nov 08 04:06:05 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:06:05 user nova-compute[75014]:     </disk>
Nov 08 04:06:05 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:06:05 user nova-compute[75014]:       <mac address="fa:16:3e:e3:84:5d"/>
Nov 08 04:06:05 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:06:05 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:06:05 user nova-compute[75014]:       <target dev="tapf85faa29-4f"/>
Nov 08 04:06:05 user nova-compute[75014]:     </interface>
Nov 08 04:06:05 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:06:05 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe/console.log" append="off"/>
Nov 08 04:06:05 user nova-compute[75014]:     </serial>
Nov 08 04:06:05 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:06:05 user nova-compute[75014]:     <video>
Nov 08 04:06:05 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:06:05 user nova-compute[75014]:     </video>
Nov 08 04:06:05 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:06:05 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:06:05 user nova-compute[75014]:     </rng>
Nov 08 04:06:05 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:06:05 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:06:05 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:06:05 user nova-compute[75014]:     </memballoon>
Nov 08 04:06:05 user nova-compute[75014]:   </devices>
Nov 08 04:06:05 user nova-compute[75014]: </domain>
Nov 08 04:06:05 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-947753843',display_name='tempest-TestMinimumBasicScenario-server-947753843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-947753843',id=33,image_ref='99456f5c-cff4-4ad8-afe3-4f5454f6e3ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3nXb/RsyynTT5PUm/7pMaVbxD4C3VjPlxa28BU5xF0dIuRS2NrCPk10dkh/0jcqwT/gsbFXl8ojWfehBZis3ZqP+9JIQ5oyzaX3WITaf2SiIc2xAnIEX2eRQmv+TgEFA==',key_name='tempest-TestMinimumBasicScenario-668009236',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60831c0130424415a7bcf071bba28ab0',ramdisk_id='',reservation_id='r-fulgpybi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='99456f5c-cff4-4ad8-afe3-4f5454f6e3ab',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-696617302',owner_user_name='tempest-TestMinimumBasicScenario-696617302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:06:03Z,user_data=None,user_id='377368f8d9a540aebd8b8760b7130fb5',uuid=449e9147-efe0-4aa1-af52-557e313bf7fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f85faa29-4fe7-4ef1-b746-a1bcad900d9f", "address": "fa:16:3e:e3:84:5d", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85faa29-4f", "ovs_interfaceid": "f85faa29-4fe7-4ef1-b746-a1bcad900d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Converting VIF {"id": "f85faa29-4fe7-4ef1-b746-a1bcad900d9f", "address": "fa:16:3e:e3:84:5d", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85faa29-4f", "ovs_interfaceid": "f85faa29-4fe7-4ef1-b746-a1bcad900d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:84:5d,bridge_name='br-int',has_traffic_filtering=True,id=f85faa29-4fe7-4ef1-b746-a1bcad900d9f,network=Network(b36b65ee-1443-4741-946a-096b65a4e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85faa29-4f') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG os_vif [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:84:5d,bridge_name='br-int',has_traffic_filtering=True,id=f85faa29-4fe7-4ef1-b746-a1bcad900d9f,network=Network(b36b65ee-1443-4741-946a-096b65a4e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85faa29-4f') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a22b1843-df55-531d-aae0-c391324a8ea2', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0db2c3c0-0ca7-4a6a-a279-4eadc92d0088 req-0d760122-5a2c-4759-8719-2c7021357d5e service nova] Releasing lock "refresh_cache-449e9147-efe0-4aa1-af52-557e313bf7fe" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf85faa29-4f, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf85faa29-4f, col_values=(('qos', UUID('36e22727-c4f2-4abc-9355-abe06843d64f')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf85faa29-4f, col_values=(('external_ids', {'iface-id': 'f85faa29-4fe7-4ef1-b746-a1bcad900d9f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:84:5d', 'vm-uuid': '449e9147-efe0-4aa1-af52-557e313bf7fe'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:05 user nova-compute[75014]: INFO os_vif [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:84:5d,bridge_name='br-int',has_traffic_filtering=True,id=f85faa29-4fe7-4ef1-b746-a1bcad900d9f,network=Network(b36b65ee-1443-4741-946a-096b65a4e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85faa29-4f')
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] No VIF found with MAC fa:16:3e:e3:84:5d, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:06:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bd153f84-98cd-4c6d-a7ab-5759b0b5bf55 {{(pid=75014) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 04:06:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:07 user nova-compute[75014]: DEBUG nova.compute.manager [req-de2e7ad2-528e-4f2d-8f7b-580ee9a54153 req-63f0c308-f383-4801-bba4-86cb3bf078c1 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Received event network-vif-plugged-f85faa29-4fe7-4ef1-b746-a1bcad900d9f {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:06:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-de2e7ad2-528e-4f2d-8f7b-580ee9a54153 req-63f0c308-f383-4801-bba4-86cb3bf078c1 service nova] Acquiring lock "449e9147-efe0-4aa1-af52-557e313bf7fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-de2e7ad2-528e-4f2d-8f7b-580ee9a54153 req-63f0c308-f383-4801-bba4-86cb3bf078c1 service nova] Lock "449e9147-efe0-4aa1-af52-557e313bf7fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-de2e7ad2-528e-4f2d-8f7b-580ee9a54153 req-63f0c308-f383-4801-bba4-86cb3bf078c1 service nova] Lock "449e9147-efe0-4aa1-af52-557e313bf7fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:07 user nova-compute[75014]: DEBUG nova.compute.manager [req-de2e7ad2-528e-4f2d-8f7b-580ee9a54153 req-63f0c308-f383-4801-bba4-86cb3bf078c1 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] No waiting events found dispatching network-vif-plugged-f85faa29-4fe7-4ef1-b746-a1bcad900d9f {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:06:07 user nova-compute[75014]: WARNING nova.compute.manager [req-de2e7ad2-528e-4f2d-8f7b-580ee9a54153 req-63f0c308-f383-4801-bba4-86cb3bf078c1 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Received unexpected event network-vif-plugged-f85faa29-4fe7-4ef1-b746-a1bcad900d9f for instance with vm_state building and task_state spawning.
Nov 08 04:06:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:09 user nova-compute[75014]: DEBUG nova.compute.manager [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:06:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 04:06:09 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Instance spawned successfully.
Nov 08 04:06:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 04:06:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:06:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:06:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:06:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:06:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:06:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:06:09 user nova-compute[75014]: DEBUG nova.compute.manager [req-71fda7cc-b83c-4ec0-8374-a4cc2cb9205d req-3d3855ed-68ce-4ab9-8f59-61723461050b service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Received event network-vif-plugged-f85faa29-4fe7-4ef1-b746-a1bcad900d9f {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:06:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-71fda7cc-b83c-4ec0-8374-a4cc2cb9205d req-3d3855ed-68ce-4ab9-8f59-61723461050b service nova] Acquiring lock "449e9147-efe0-4aa1-af52-557e313bf7fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-71fda7cc-b83c-4ec0-8374-a4cc2cb9205d req-3d3855ed-68ce-4ab9-8f59-61723461050b service nova] Lock "449e9147-efe0-4aa1-af52-557e313bf7fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-71fda7cc-b83c-4ec0-8374-a4cc2cb9205d req-3d3855ed-68ce-4ab9-8f59-61723461050b service nova] Lock "449e9147-efe0-4aa1-af52-557e313bf7fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:09 user nova-compute[75014]: DEBUG nova.compute.manager [req-71fda7cc-b83c-4ec0-8374-a4cc2cb9205d req-3d3855ed-68ce-4ab9-8f59-61723461050b service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] No waiting events found dispatching network-vif-plugged-f85faa29-4fe7-4ef1-b746-a1bcad900d9f {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:06:09 user nova-compute[75014]: WARNING nova.compute.manager [req-71fda7cc-b83c-4ec0-8374-a4cc2cb9205d req-3d3855ed-68ce-4ab9-8f59-61723461050b service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Received unexpected event network-vif-plugged-f85faa29-4fe7-4ef1-b746-a1bcad900d9f for instance with vm_state building and task_state spawning.
Nov 08 04:06:09 user nova-compute[75014]: INFO nova.compute.manager [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Took 6.04 seconds to spawn the instance on the hypervisor.
Nov 08 04:06:09 user nova-compute[75014]: DEBUG nova.compute.manager [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:06:09 user nova-compute[75014]: INFO nova.compute.manager [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Took 7.64 seconds to build instance.
Nov 08 04:06:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c22179e0-2c7d-4685-bfb5-9a64ac84d126 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "449e9147-efe0-4aa1-af52-557e313bf7fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.747s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:12 user nova-compute[75014]: DEBUG nova.compute.manager [req-3be92204-b346-4371-acee-2f0d42681e61 req-cd9bdf3b-0fe4-45cf-871d-2d7ad5704a66 service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Received event network-changed-a575a382-2b45-4494-b351-0ace52e3588b {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:06:12 user nova-compute[75014]: DEBUG nova.compute.manager [req-3be92204-b346-4371-acee-2f0d42681e61 req-cd9bdf3b-0fe4-45cf-871d-2d7ad5704a66 service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Refreshing instance network info cache due to event network-changed-a575a382-2b45-4494-b351-0ace52e3588b. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:06:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3be92204-b346-4371-acee-2f0d42681e61 req-cd9bdf3b-0fe4-45cf-871d-2d7ad5704a66 service nova] Acquiring lock "refresh_cache-36a4109b-f239-48ce-ad49-e640a12a73bf" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:06:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3be92204-b346-4371-acee-2f0d42681e61 req-cd9bdf3b-0fe4-45cf-871d-2d7ad5704a66 service nova] Acquired lock "refresh_cache-36a4109b-f239-48ce-ad49-e640a12a73bf" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:06:12 user nova-compute[75014]: DEBUG nova.network.neutron [req-3be92204-b346-4371-acee-2f0d42681e61 req-cd9bdf3b-0fe4-45cf-871d-2d7ad5704a66 service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Refreshing network info cache for port a575a382-2b45-4494-b351-0ace52e3588b {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:06:13 user nova-compute[75014]: DEBUG nova.network.neutron [req-3be92204-b346-4371-acee-2f0d42681e61 req-cd9bdf3b-0fe4-45cf-871d-2d7ad5704a66 service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Updated VIF entry in instance network info cache for port a575a382-2b45-4494-b351-0ace52e3588b. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:06:13 user nova-compute[75014]: DEBUG nova.network.neutron [req-3be92204-b346-4371-acee-2f0d42681e61 req-cd9bdf3b-0fe4-45cf-871d-2d7ad5704a66 service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Updating instance_info_cache with network_info: [{"id": "a575a382-2b45-4494-b351-0ace52e3588b", "address": "fa:16:3e:17:47:bd", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa575a382-2b", "ovs_interfaceid": "a575a382-2b45-4494-b351-0ace52e3588b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:06:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3be92204-b346-4371-acee-2f0d42681e61 req-cd9bdf3b-0fe4-45cf-871d-2d7ad5704a66 service nova] Releasing lock "refresh_cache-36a4109b-f239-48ce-ad49-e640a12a73bf" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:06:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "36a4109b-f239-48ce-ad49-e640a12a73bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "36a4109b-f239-48ce-ad49-e640a12a73bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:13 user nova-compute[75014]: DEBUG nova.objects.instance [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lazy-loading 'flavor' on Instance uuid 36a4109b-f239-48ce-ad49-e640a12a73bf {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:06:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "36a4109b-f239-48ce-ad49-e640a12a73bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "36a4109b-f239-48ce-ad49-e640a12a73bf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "36a4109b-f239-48ce-ad49-e640a12a73bf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:13 user nova-compute[75014]: INFO nova.compute.manager [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Attaching volume d6e20ff7-58e6-4de5-8680-e6b29925cfcb to /dev/vdb
Nov 08 04:06:13 user nova-compute[75014]: DEBUG os_brick.utils [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:06:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53729e8-f0e6-42f3-965d-ad20309f715c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24eb7cb-42a2-4e92-9f70-55cfbb9fd25a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73acdec-cdbf-4503-a7b5-016328236da4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[712475de-d27a-4061-b604-6ca0d79863c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:06:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:06:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:06:13 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:06:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[873f2aa9-f22c-4a6c-bfe6-7c2d95e1fb7f]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:06:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:06:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:06:13 user nova-compute[75014]: DEBUG os_brick.utils [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:06:13 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Updating existing volume attachment record: 3f7a074e-a647-4bdd-b3d4-75ec108bc51d {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:06:14 user nova-compute[75014]: DEBUG nova.compute.manager [req-ccebb036-8851-4c5d-99e7-7c5d590ad2fa req-21a6953b-17d2-45d9-9a2c-fc70ba941813 service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Received event network-changed-5b680c90-914d-4583-a698-dccacaff9987 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:06:14 user nova-compute[75014]: DEBUG nova.compute.manager [req-ccebb036-8851-4c5d-99e7-7c5d590ad2fa req-21a6953b-17d2-45d9-9a2c-fc70ba941813 service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Refreshing instance network info cache due to event network-changed-5b680c90-914d-4583-a698-dccacaff9987. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:06:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ccebb036-8851-4c5d-99e7-7c5d590ad2fa req-21a6953b-17d2-45d9-9a2c-fc70ba941813 service nova] Acquiring lock "refresh_cache-781932ce-0bea-466f-95e0-066130d6c410" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:06:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ccebb036-8851-4c5d-99e7-7c5d590ad2fa req-21a6953b-17d2-45d9-9a2c-fc70ba941813 service nova] Acquired lock "refresh_cache-781932ce-0bea-466f-95e0-066130d6c410" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:06:14 user nova-compute[75014]: DEBUG nova.network.neutron [req-ccebb036-8851-4c5d-99e7-7c5d590ad2fa req-21a6953b-17d2-45d9-9a2c-fc70ba941813 service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Refreshing network info cache for port 5b680c90-914d-4583-a698-dccacaff9987 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:06:15 user nova-compute[75014]: DEBUG nova.network.neutron [req-ccebb036-8851-4c5d-99e7-7c5d590ad2fa req-21a6953b-17d2-45d9-9a2c-fc70ba941813 service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Updated VIF entry in instance network info cache for port 5b680c90-914d-4583-a698-dccacaff9987. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:06:15 user nova-compute[75014]: DEBUG nova.network.neutron [req-ccebb036-8851-4c5d-99e7-7c5d590ad2fa req-21a6953b-17d2-45d9-9a2c-fc70ba941813 service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Updating instance_info_cache with network_info: [{"id": "5b680c90-914d-4583-a698-dccacaff9987", "address": "fa:16:3e:48:9a:fe", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b680c90-91", "ovs_interfaceid": "5b680c90-914d-4583-a698-dccacaff9987", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:06:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ccebb036-8851-4c5d-99e7-7c5d590ad2fa req-21a6953b-17d2-45d9-9a2c-fc70ba941813 service nova] Releasing lock "refresh_cache-781932ce-0bea-466f-95e0-066130d6c410" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:06:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "781932ce-0bea-466f-95e0-066130d6c410" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "781932ce-0bea-466f-95e0-066130d6c410" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:19 user nova-compute[75014]: DEBUG nova.objects.instance [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lazy-loading 'flavor' on Instance uuid 781932ce-0bea-466f-95e0-066130d6c410 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:06:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "781932ce-0bea-466f-95e0-066130d6c410" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "781932ce-0bea-466f-95e0-066130d6c410" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "781932ce-0bea-466f-95e0-066130d6c410" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:20 user nova-compute[75014]: INFO nova.compute.manager [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Attaching volume f251c6de-c866-429b-b113-b67a97cf79f1 to /dev/vdb
Nov 08 04:06:20 user nova-compute[75014]: DEBUG os_brick.utils [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:06:20 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:20 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:20 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2605cd5-f59a-4431-82fa-abf36fa6241f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:20 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:20 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:20 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[669ed222-4557-45f2-9fd1-8f032a7d4348]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:20 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:20 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:20 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b0960b-8845-4b0f-b2b8-cfa34a4b63b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:20 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[99262577-726d-4bfb-a31c-0a70b936f845]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:20 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:20 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:06:20 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:06:20 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:20 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:06:20 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:06:20 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[22afc51b-8b37-415c-b3ba-00defb61cec3]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:20 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:06:20 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:06:20 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:06:20 user nova-compute[75014]: DEBUG os_brick.utils [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:06:20 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Updating existing volume attachment record: 8179ddfb-5fab-4b3d-8c6f-7131c6a14ba2 {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:06:20 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:25 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bd153f84-98cd-4c6d-a7ab-5759b0b5bf55 is timed out.
Nov 08 04:06:25 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Successfully detached device vdb from instance bd153f84-98cd-4c6d-a7ab-5759b0b5bf55 from the live domain config.
Nov 08 04:06:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TecQhnoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:06:25 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:06:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fe6b9c-960b-4cf8-9dbc-fe6f830c335b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:06:25 user nova-compute[75014]: No targets found.
Nov 08 04:06:25 user nova-compute[75014]: iSNS:
Nov 08 04:06:25 user nova-compute[75014]: No targets found.
Nov 08 04:06:25 user nova-compute[75014]: STATIC:
Nov 08 04:06:25 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec
Nov 08 04:06:25 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:06:25 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:06:25 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00
Nov 08 04:06:25 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:06:25 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:06:25 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:06:25 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:06:25 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:06:25 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a
Nov 08 04:06:25 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:06:25 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:06:25 user nova-compute[75014]: FIRMWARE:
Nov 08 04:06:25 user nova-compute[75014]: No targets found.
Nov 08 04:06:25 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:06:25 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:06:25 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[72aca874-aa14-416d-9baf-82088e5f78f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ca43d7-195d-40dd-82d5-e2ca2c6ec06f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:06:25 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:06:25 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:06:25 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:06:25 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:06:25 user nova-compute[75014]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a (non-flash)
Nov 08 04:06:25 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:06:25 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:06:25 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0418361bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a'): ({'sdb'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Removing single pathed devices sdb {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd97340-4655-4fe2-b70a-2e888d54911f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee3fbc4-8197-4d68-ae29-3a505392d23d]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Flushing IO for device /dev/sdb {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbb4726-f02a-44f2-bec0-3f5037f7e8fb]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea30a5c9-4baf-4cd9-816c-76dd198b1b47]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] SCSI volumes sdb have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[66263b2a-43d8-478c-817e-ee9b48602b4b]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd17be3-ad3a-4c45-8d37-2ce8794775e9]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a, portal: 172.16.0.220,3260]
Nov 08 04:06:26 user nova-compute[75014]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a, portal: 172.16.0.220,3260] successful.
Nov 08 04:06:26 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b5a229-3d47-4b3c-bfec-b2ea92cb906a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a086552-ec48-4aea-a6ad-7030267cb19e]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:06:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] <== disconnect_volume: return (326ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:06:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oBjLXIQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:06:27 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:06:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:06:27 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:06:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:06:27 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32149ef-6764-47ec-b626-8bdf2b482675]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:06:27 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[795e6f28-c9cd-496b-9f76-95b5961ab55d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401] added
Nov 08 04:06:27 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9316f1-04f6-4e64-a7c3-3461ebb486c3]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b29957-4789-4b5c-afaf-c0be7f5095ed]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oBjLXIQN {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oBjLXIQN" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b63cc6-379c-4fe9-a0d9-f4c5e1fa4df5]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oBjLXIQN'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[481c2194-09ba-41bc-b916-3c66b7cb5ca9]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a3eeb6-d256-414c-82b8-61923c71da23]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:06:27 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:06:27 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:06:27 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:06:27 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:06:27 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:06:27 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc2dfbe-7924-48a5-9ab9-9dac96ed4f3b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401, portal: 172.16.0.220,3260]
Nov 08 04:06:27 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401, portal: 172.16.0.220,3260] successful.
Nov 08 04:06:27 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[338204f4-24a1-47a9-924e-fb527a882b13]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce7f0d6-f84a-4bb8-aef4-8138e7bdf469]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:06:27 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:06:27 user nova-compute[75014]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 (non-flash)
Nov 08 04:06:27 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:06:27 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:06:27 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:06:27 user nova-compute[75014]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 (non-flash)
Nov 08 04:06:27 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:06:27 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8333b380-97c2-4cb3-add1-91d8a5defa80]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:06:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oBjLXIQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:06:28 user nova-compute[75014]: DEBUG nova.objects.instance [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lazy-loading 'flavor' on Instance uuid bd153f84-98cd-4c6d-a7ab-5759b0b5bf55 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:06:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ff54944c-7a07-435d-ae06-9351a4df1d1b tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.220s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:06:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23535366130386635', 'path': '/dev/sdb'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:06:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535366130386635', 'path': '/dev/sdb'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:06:28 user nova-compute[75014]: DEBUG nova.objects.instance [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lazy-loading 'flavor' on Instance uuid 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:06:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 04:06:28 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:06:28 user nova-compute[75014]:   <source dev="/dev/sdb"/>
Nov 08 04:06:28 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:06:28 user nova-compute[75014]:   <serial>61141d33-5365-41e4-ac05-660439875401</serial>
Nov 08 04:06:28 user nova-compute[75014]: </disk>
Nov 08 04:06:28 user nova-compute[75014]:  {{(pid=75014) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 04:06:28 user nova-compute[75014]: DEBUG nova.compute.manager [req-506b7f63-7b7b-4f32-9d12-b21440993abb req-d1e966e7-48b5-4464-9212-31a148c9a0cf service nova] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Received event network-changed-a54f4128-8b08-4c5a-baea-5e8de62a98d9 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:06:28 user nova-compute[75014]: DEBUG nova.compute.manager [req-506b7f63-7b7b-4f32-9d12-b21440993abb req-d1e966e7-48b5-4464-9212-31a148c9a0cf service nova] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Refreshing instance network info cache due to event network-changed-a54f4128-8b08-4c5a-baea-5e8de62a98d9. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:06:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-506b7f63-7b7b-4f32-9d12-b21440993abb req-d1e966e7-48b5-4464-9212-31a148c9a0cf service nova] Acquiring lock "refresh_cache-75d85e9b-5364-4838-bd6a-c044b6290e7f" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:06:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-506b7f63-7b7b-4f32-9d12-b21440993abb req-d1e966e7-48b5-4464-9212-31a148c9a0cf service nova] Acquired lock "refresh_cache-75d85e9b-5364-4838-bd6a-c044b6290e7f" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:06:28 user nova-compute[75014]: DEBUG nova.network.neutron [req-506b7f63-7b7b-4f32-9d12-b21440993abb req-d1e966e7-48b5-4464-9212-31a148c9a0cf service nova] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Refreshing network info cache for port a54f4128-8b08-4c5a-baea-5e8de62a98d9 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:06:29 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:06:29 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:06:29 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] No VIF found with MAC fa:16:3e:8f:4a:4b, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:06:29 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:06:29 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:06:29 user nova-compute[75014]: DEBUG nova.network.neutron [req-506b7f63-7b7b-4f32-9d12-b21440993abb req-d1e966e7-48b5-4464-9212-31a148c9a0cf service nova] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Updated VIF entry in instance network info cache for port a54f4128-8b08-4c5a-baea-5e8de62a98d9. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:06:29 user nova-compute[75014]: DEBUG nova.network.neutron [req-506b7f63-7b7b-4f32-9d12-b21440993abb req-d1e966e7-48b5-4464-9212-31a148c9a0cf service nova] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Updating instance_info_cache with network_info: [{"id": "a54f4128-8b08-4c5a-baea-5e8de62a98d9", "address": "fa:16:3e:95:e6:b4", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54f4128-8b", "ovs_interfaceid": "a54f4128-8b08-4c5a-baea-5e8de62a98d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:06:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-506b7f63-7b7b-4f32-9d12-b21440993abb req-d1e966e7-48b5-4464-9212-31a148c9a0cf service nova] Releasing lock "refresh_cache-75d85e9b-5364-4838-bd6a-c044b6290e7f" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:06:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-daf109c5-0132-4656-91a9-321a387debfc tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 37.814s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_power_states {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid 9f205fe5-576f-4ef0-874b-1544c0307a7e {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid 5bfa6580-e0fe-46b0-b497-8db67806113a {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid 8527ee40-fb8a-469b-9696-d7bde8cc96f7 {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid 655fe5eb-1271-4b9f-a5a6-6342bd012a69 {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid bd153f84-98cd-4c6d-a7ab-5759b0b5bf55 {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid d555b6b3-86ec-40ae-aa20-48846b5157d5 {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid c23c9e00-b782-4530-bb01-a7a167951c1d {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid 0b3b62d9-2543-402b-bdb5-cac994b755c9 {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid 36a4109b-f239-48ce-ad49-e640a12a73bf {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid 781932ce-0bea-466f-95e0-066130d6c410 {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid 75d85e9b-5364-4838-bd6a-c044b6290e7f {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid 1cb11358-b4c4-47f4-ba30-d967d523f98a {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid 449e9147-efe0-4aa1-af52-557e313bf7fe {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "9f205fe5-576f-4ef0-874b-1544c0307a7e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "5bfa6580-e0fe-46b0-b497-8db67806113a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "5bfa6580-e0fe-46b0-b497-8db67806113a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "d555b6b3-86ec-40ae-aa20-48846b5157d5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "d555b6b3-86ec-40ae-aa20-48846b5157d5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "c23c9e00-b782-4530-bb01-a7a167951c1d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "c23c9e00-b782-4530-bb01-a7a167951c1d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "0b3b62d9-2543-402b-bdb5-cac994b755c9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "0b3b62d9-2543-402b-bdb5-cac994b755c9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "36a4109b-f239-48ce-ad49-e640a12a73bf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "781932ce-0bea-466f-95e0-066130d6c410" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "75d85e9b-5364-4838-bd6a-c044b6290e7f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "75d85e9b-5364-4838-bd6a-c044b6290e7f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "1cb11358-b4c4-47f4-ba30-d967d523f98a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "1cb11358-b4c4-47f4-ba30-d967d523f98a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "449e9147-efe0-4aa1-af52-557e313bf7fe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "449e9147-efe0-4aa1-af52-557e313bf7fe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "5bfa6580-e0fe-46b0-b497-8db67806113a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "d555b6b3-86ec-40ae-aa20-48846b5157d5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "0b3b62d9-2543-402b-bdb5-cac994b755c9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "c23c9e00-b782-4530-bb01-a7a167951c1d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "75d85e9b-5364-4838-bd6a-c044b6290e7f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "449e9147-efe0-4aa1-af52-557e313bf7fe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "1cb11358-b4c4-47f4-ba30-d967d523f98a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:31 user nova-compute[75014]: INFO nova.compute.manager [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Detaching volume 61141d33-5365-41e4-ac05-660439875401
Nov 08 04:06:31 user nova-compute[75014]: INFO nova.virt.block_device [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Attempting to driver detach volume 61141d33-5365-41e4-ac05-660439875401 from mountpoint /dev/vdb
Nov 08 04:06:31 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Attempting to detach device vdb from instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d from the persistent domain config. {{(pid=75014) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 04:06:31 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:06:31 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:06:31 user nova-compute[75014]:   <source dev="/dev/sdb"/>
Nov 08 04:06:31 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:06:31 user nova-compute[75014]:   <serial>61141d33-5365-41e4-ac05-660439875401</serial>
Nov 08 04:06:31 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:06:31 user nova-compute[75014]: </disk>
Nov 08 04:06:31 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:06:31 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Successfully detached device vdb from instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d from the persistent domain config.
Nov 08 04:06:31 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d from the live domain config. {{(pid=75014) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 04:06:31 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:06:31 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:06:31 user nova-compute[75014]:   <source dev="/dev/sdb"/>
Nov 08 04:06:31 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:06:31 user nova-compute[75014]:   <serial>61141d33-5365-41e4-ac05-660439875401</serial>
Nov 08 04:06:31 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:06:31 user nova-compute[75014]: </disk>
Nov 08 04:06:31 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:06:31 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d {{(pid=75014) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 04:06:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:34 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:06:34 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:06:34 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:06:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:06:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:06:34 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 04:06:35 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Updating instance_info_cache with network_info: [{"id": "ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba", "address": "fa:16:3e:8f:4a:4b", "network": {"id": "6e103f9f-8ed5-4e53-ac4a-85f3151d3e9e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-641600740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deb879b910c742f6a0fbf17bf0909da3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf8cfd7-cb", "ovs_interfaceid": "ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:06:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:06:35 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 04:06:35 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:06:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "75d85e9b-5364-4838-bd6a-c044b6290e7f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "75d85e9b-5364-4838-bd6a-c044b6290e7f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:35 user nova-compute[75014]: DEBUG nova.objects.instance [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lazy-loading 'flavor' on Instance uuid 75d85e9b-5364-4838-bd6a-c044b6290e7f {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:06:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "75d85e9b-5364-4838-bd6a-c044b6290e7f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "75d85e9b-5364-4838-bd6a-c044b6290e7f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "75d85e9b-5364-4838-bd6a-c044b6290e7f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:35 user nova-compute[75014]: INFO nova.compute.manager [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Attaching volume 2c2756b5-7b79-4a2b-bf93-19978a744ef9 to /dev/vdb
Nov 08 04:06:36 user nova-compute[75014]: DEBUG os_brick.utils [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:06:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[065a6302-9521-4be4-ae7e-b230e3bbef0d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f55ca8-e185-45b2-baae-7b20df0dda98]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0084237-67ec-4351-a678-426d76ad7fa7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[340df9b4-178e-4d41-b58a-76558412106d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:06:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:06:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:06:36 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:06:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0505f7eb-d529-41f2-8d62-a20d6aa37340]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:06:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:06:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:06:36 user nova-compute[75014]: DEBUG os_brick.utils [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:06:36 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Updating existing volume attachment record: f9972476-99a3-49f1-83d3-9bb04fe52dc3 {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:06:36 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:06:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmyjVSXs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:06:39 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:06:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:06:39 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:06:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:06:39 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b34da4-1585-4ac8-89af-a222bc054c44]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:06:39 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d27497-8122-4d17-a967-e9aa12b407f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb] added
Nov 08 04:06:39 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.103s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[399272f9-8f6a-41bb-b9b7-e5e4e63d1600]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9137404-b77d-4088-a4c4-7bf43a98679c]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HmyjVSXs {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HmyjVSXs" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb8f96a-c439-4b8e-b4b5-e35ac1f179d9]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HmyjVSXs'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6339c4-7d63-4a38-8526-e272daba7696]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabe6c96-2259-4553-9ad1-86a1f44139ef]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:06:39 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:06:39 user nova-compute[75014]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 (non-flash)
Nov 08 04:06:39 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:06:39 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:06:39 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:06:39 user nova-compute[75014]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 (non-flash)
Nov 08 04:06:39 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:06:39 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[53817387-4212-4fa5-be3d-02ce8013be7c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb, portal: 172.16.0.220,3260]
Nov 08 04:06:39 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb, portal: 172.16.0.220,3260] successful.
Nov 08 04:06:39 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53bc986-0e4b-4ce2-82ed-025ee8183b39]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18c5e09-dea7-4381-93c7-f92f0495c6fd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:06:39 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:06:39 user nova-compute[75014]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 (non-flash)
Nov 08 04:06:39 user nova-compute[75014]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:06:39 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:06:39 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:06:39 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:06:39 user nova-compute[75014]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 (non-flash)
Nov 08 04:06:39 user nova-compute[75014]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:06:39 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:06:39 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[16877837-2c9c-471b-b68c-df4c4c9f5aea]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:06:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmyjVSXs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:06:40 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:06:40 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:06:40 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:06:40 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:06:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:40 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:06:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.434s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:06:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] <== connect_volume: return (1436ms) {'type': 'block', 'scsi_wwn': '26236323065643665', 'path': '/dev/sdd'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:06:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236323065643665', 'path': '/dev/sdd'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:06:40 user nova-compute[75014]: DEBUG nova.objects.instance [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lazy-loading 'flavor' on Instance uuid 36a4109b-f239-48ce-ad49-e640a12a73bf {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:06:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:40 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 04:06:40 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:06:40 user nova-compute[75014]:   <source dev="/dev/sdd"/>
Nov 08 04:06:40 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:06:40 user nova-compute[75014]:   <serial>d6e20ff7-58e6-4de5-8680-e6b29925cfcb</serial>
Nov 08 04:06:40 user nova-compute[75014]: </disk>
Nov 08 04:06:40 user nova-compute[75014]:  {{(pid=75014) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 04:06:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75d85e9b-5364-4838-bd6a-c044b6290e7f/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:06:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:06:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] No VIF found with MAC fa:16:3e:17:47:bd, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:06:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75d85e9b-5364-4838-bd6a-c044b6290e7f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75d85e9b-5364-4838-bd6a-c044b6290e7f/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-12e43b29-b442-4a96-99b2-afd8e3055d8a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "36a4109b-f239-48ce-ad49-e640a12a73bf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.590s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "36a4109b-f239-48ce-ad49-e640a12a73bf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 10.637s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "36a4109b-f239-48ce-ad49-e640a12a73bf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75d85e9b-5364-4838-bd6a-c044b6290e7f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:42 user nova-compute[75014]: INFO nova.compute.manager [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Rebuilding instance
Nov 08 04:06:42 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:06:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:06:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-ef2ad2d2-e949-4d0b-b8ea-024f87922b8a req-0f7a6d35-4bb1-468e-b64d-c763ca4ca6ec service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Received event network-vif-unplugged-a575a382-2b45-4494-b351-0ace52e3588b {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:06:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ef2ad2d2-e949-4d0b-b8ea-024f87922b8a req-0f7a6d35-4bb1-468e-b64d-c763ca4ca6ec service nova] Acquiring lock "36a4109b-f239-48ce-ad49-e640a12a73bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ef2ad2d2-e949-4d0b-b8ea-024f87922b8a req-0f7a6d35-4bb1-468e-b64d-c763ca4ca6ec service nova] Lock "36a4109b-f239-48ce-ad49-e640a12a73bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ef2ad2d2-e949-4d0b-b8ea-024f87922b8a req-0f7a6d35-4bb1-468e-b64d-c763ca4ca6ec service nova] Lock "36a4109b-f239-48ce-ad49-e640a12a73bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-ef2ad2d2-e949-4d0b-b8ea-024f87922b8a req-0f7a6d35-4bb1-468e-b64d-c763ca4ca6ec service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] No waiting events found dispatching network-vif-unplugged-a575a382-2b45-4494-b351-0ace52e3588b {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:06:43 user nova-compute[75014]: WARNING nova.compute.manager [req-ef2ad2d2-e949-4d0b-b8ea-024f87922b8a req-0f7a6d35-4bb1-468e-b64d-c763ca4ca6ec service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Received unexpected event network-vif-unplugged-a575a382-2b45-4494-b351-0ace52e3588b for instance with vm_state active and task_state rebuilding.
Nov 08 04:06:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:43 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Instance destroyed successfully.
Nov 08 04:06:43 user nova-compute[75014]: INFO nova.compute.manager [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Detaching volume d6e20ff7-58e6-4de5-8680-e6b29925cfcb
Nov 08 04:06:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:06:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b3b62d9-2543-402b-bdb5-cac994b755c9/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:43 user nova-compute[75014]: INFO nova.virt.block_device [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Attempting to driver detach volume d6e20ff7-58e6-4de5-8680-e6b29925cfcb from mountpoint /dev/vdb
Nov 08 04:06:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Attempting to detach device vdb from instance 36a4109b-f239-48ce-ad49-e640a12a73bf from the persistent domain config. {{(pid=75014) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 04:06:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:06:43 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:06:43 user nova-compute[75014]:   <source dev="/dev/sdd"/>
Nov 08 04:06:43 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:06:43 user nova-compute[75014]:   <serial>d6e20ff7-58e6-4de5-8680-e6b29925cfcb</serial>
Nov 08 04:06:43 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:06:43 user nova-compute[75014]: </disk>
Nov 08 04:06:43 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:06:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b3b62d9-2543-402b-bdb5-cac994b755c9/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b3b62d9-2543-402b-bdb5-cac994b755c9/disk.rescue --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:44 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Successfully detached device vdb from instance 36a4109b-f239-48ce-ad49-e640a12a73bf from the persistent domain config.
Nov 08 04:06:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmyjVSXs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:06:44 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe7c2f4-1872-4bfd-af21-c0fd0d7247db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:06:44 user nova-compute[75014]: No targets found.
Nov 08 04:06:44 user nova-compute[75014]: iSNS:
Nov 08 04:06:44 user nova-compute[75014]: No targets found.
Nov 08 04:06:44 user nova-compute[75014]: STATIC:
Nov 08 04:06:44 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec
Nov 08 04:06:44 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:06:44 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:06:44 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401
Nov 08 04:06:44 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:06:44 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:06:44 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00
Nov 08 04:06:44 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:06:44 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:06:44 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:06:44 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:06:44 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:06:44 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb
Nov 08 04:06:44 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:06:44 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:06:44 user nova-compute[75014]: FIRMWARE:
Nov 08 04:06:44 user nova-compute[75014]: No targets found.
Nov 08 04:06:44 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:06:44 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:06:44 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0a5671-abac-40fa-9ea8-f5f35a1d7a25]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab31d213-79a8-4691-a0c2-fba931be1824]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:06:44 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:06:44 user nova-compute[75014]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 (non-flash)
Nov 08 04:06:44 user nova-compute[75014]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:06:44 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:06:44 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:06:44 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:06:44 user nova-compute[75014]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 (non-flash)
Nov 08 04:06:44 user nova-compute[75014]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:06:44 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:06:44 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f03dc7317e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb'): ({'sdd'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Removing single pathed devices sdd {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a19a0c-7333-48d9-a92d-0ad81286416d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2fd9d7-3c1e-49d9-a20f-29c9fe131a38]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Flushing IO for device /dev/sdd {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b3b62d9-2543-402b-bdb5-cac994b755c9/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfb8b29-4b9a-4196-a2be-a18e0ecceb36]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada00abb-6696-4041-bb1e-955ae28c6211]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] SCSI volumes sdd have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7cb861-ae06-4566-9f70-88e55e72ae14]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb191721-9d23-4373-9e2c-8623223b0a13]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb, portal: 172.16.0.220,3260]
Nov 08 04:06:44 user nova-compute[75014]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb, portal: 172.16.0.220,3260] successful.
Nov 08 04:06:44 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[034fa363-da88-40a1-b81c-862ddf619687]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] <== disconnect_volume: return (356ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crbqawYg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:06:44 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:06:44 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:06:44 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c759ed3f-c5ef-47b9-a468-96f12f8b55c8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:06:44 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7923fff7-0811-4403-af39-bbf99f2e4427]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1] added
Nov 08 04:06:44 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd20d0a-8803-4d41-b0b6-be8009a9e8da]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e69f593-ae22-4e60-8c76-e29a461d7b3b]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v crbqawYg {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v crbqawYg" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f67cc0-bb59-468e-9cb2-3a27bc4039cc]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'crbqawYg'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f48ea85-8e4f-430f-b641-d82d31df518d]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67a9d02-bb98-401a-aa38-2b67ddee1031]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:06:44 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:06:44 user nova-compute[75014]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 (non-flash)
Nov 08 04:06:44 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:06:44 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:06:44 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:06:44 user nova-compute[75014]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 (non-flash)
Nov 08 04:06:44 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:06:44 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27b16a3-4fce-454f-85aa-e5d5bd9875a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1, portal: 172.16.0.220,3260]
Nov 08 04:06:44 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1, portal: 172.16.0.220,3260] successful.
Nov 08 04:06:44 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f647f416-ac4a-45ee-b322-06ebe1bdda5f]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[282c7cd3-7324-4982-9d1d-db4d51784990]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:06:44 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:06:44 user nova-compute[75014]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 (non-flash)
Nov 08 04:06:44 user nova-compute[75014]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:06:44 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:06:44 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:06:44 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:06:44 user nova-compute[75014]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 (non-flash)
Nov 08 04:06:44 user nova-compute[75014]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:06:44 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:06:44 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a2a4c1-aec0-4397-bc02-7ca89ed17eda]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crbqawYg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG nova.compute.manager [req-1d0046c0-57da-44da-a9d9-a56c36ed2674 req-79f63124-14d5-499d-97df-7221848bb666 service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Received event network-vif-plugged-a575a382-2b45-4494-b351-0ace52e3588b {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1d0046c0-57da-44da-a9d9-a56c36ed2674 req-79f63124-14d5-499d-97df-7221848bb666 service nova] Acquiring lock "36a4109b-f239-48ce-ad49-e640a12a73bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1d0046c0-57da-44da-a9d9-a56c36ed2674 req-79f63124-14d5-499d-97df-7221848bb666 service nova] Lock "36a4109b-f239-48ce-ad49-e640a12a73bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1d0046c0-57da-44da-a9d9-a56c36ed2674 req-79f63124-14d5-499d-97df-7221848bb666 service nova] Lock "36a4109b-f239-48ce-ad49-e640a12a73bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG nova.compute.manager [req-1d0046c0-57da-44da-a9d9-a56c36ed2674 req-79f63124-14d5-499d-97df-7221848bb666 service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] No waiting events found dispatching network-vif-plugged-a575a382-2b45-4494-b351-0ace52e3588b {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:06:45 user nova-compute[75014]: WARNING nova.compute.manager [req-1d0046c0-57da-44da-a9d9-a56c36ed2674 req-79f63124-14d5-499d-97df-7221848bb666 service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Received unexpected event network-vif-plugged-a575a382-2b45-4494-b351-0ace52e3588b for instance with vm_state active and task_state rebuilding.
Nov 08 04:06:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:45 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Instance destroyed successfully.
Nov 08 04:06:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-372983470',display_name='tempest-ServerActionsTestOtherA-server-1298346474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-372983470',id=29,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhheGyNzDlKZ2iBJ0DNzi5AYIcLl14TQHCatvNP3avHAzjaEguIvBGcBxNnOYp/JkyWAjVRAHcTHBiFLXLHVGrIzmoaj96sMdyVyHAw+f4ZhavFNOqzCWT3h0YxLOs+7g==',key_name='tempest-keypair-1837241282',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:04:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7b9ecaed30ba4ad1a9d5eaca02633604',ramdisk_id='',reservation_id='r-prevyyvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-537496863',owner_user_name='tempest-ServerActionsTestOtherA-537496863-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:06:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8398fcf62a014e7f943bff6fcc3f72f3',uuid=36a4109b-f239-48ce-ad49-e640a12a73bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a575a382-2b45-4494-b351-0ace52e3588b", "address": "fa:16:3e:17:47:bd", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa575a382-2b", "ovs_interfaceid": "a575a382-2b45-4494-b351-0ace52e3588b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Converting VIF {"id": "a575a382-2b45-4494-b351-0ace52e3588b", "address": "fa:16:3e:17:47:bd", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa575a382-2b", "ovs_interfaceid": "a575a382-2b45-4494-b351-0ace52e3588b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:47:bd,bridge_name='br-int',has_traffic_filtering=True,id=a575a382-2b45-4494-b351-0ace52e3588b,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa575a382-2b') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG os_vif [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:47:bd,bridge_name='br-int',has_traffic_filtering=True,id=a575a382-2b45-4494-b351-0ace52e3588b,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa575a382-2b') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa575a382-2b, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=99f20c2a-85ed-4479-9e9a-5f80c1025881) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:45 user nova-compute[75014]: INFO os_vif [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:47:bd,bridge_name='br-int',has_traffic_filtering=True,id=a575a382-2b45-4494-b351-0ace52e3588b,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa575a382-2b')
Nov 08 04:06:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmyjVSXs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:06:45 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 04:06:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '26237386166643965', 'path': '/dev/sdd'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237386166643965', 'path': '/dev/sdd'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.321s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG nova.objects.instance [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lazy-loading 'flavor' on Instance uuid 781932ce-0bea-466f-95e0-066130d6c410 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[907fa4d6-adbe-49f2-8c6e-c1361e712de2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:06:45 user nova-compute[75014]: No targets found.
Nov 08 04:06:45 user nova-compute[75014]: iSNS:
Nov 08 04:06:45 user nova-compute[75014]: No targets found.
Nov 08 04:06:45 user nova-compute[75014]: STATIC:
Nov 08 04:06:45 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec
Nov 08 04:06:45 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:06:45 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:06:45 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1
Nov 08 04:06:45 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:06:45 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:06:45 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401
Nov 08 04:06:45 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:06:45 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:06:45 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00
Nov 08 04:06:45 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:06:45 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:06:45 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:06:45 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:06:45 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:06:45 user nova-compute[75014]: FIRMWARE:
Nov 08 04:06:45 user nova-compute[75014]: No targets found.
Nov 08 04:06:45 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:06:45 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:06:45 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 04:06:45 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:06:45 user nova-compute[75014]:   <source dev="/dev/sdd"/>
Nov 08 04:06:45 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:06:45 user nova-compute[75014]:   <serial>f251c6de-c866-429b-b113-b67a97cf79f1</serial>
Nov 08 04:06:45 user nova-compute[75014]: </disk>
Nov 08 04:06:45 user nova-compute[75014]:  {{(pid=75014) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2598ce-5e6c-49ac-b0db-5058ce87325d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6078e5-5a5a-49b8-9a2b-a0fca7d2d610]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:06:45 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:06:45 user nova-compute[75014]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 (non-flash)
Nov 08 04:06:45 user nova-compute[75014]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:06:45 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:06:45 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:06:45 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:06:45 user nova-compute[75014]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 (non-flash)
Nov 08 04:06:45 user nova-compute[75014]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:06:45 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:06:45 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f04003c9cf0>, {}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Disconnecting from: [] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.092s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] <== disconnect_volume: return (414ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:06:45 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Deleting instance files /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf_del
Nov 08 04:06:45 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Deletion of /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf_del complete
Nov 08 04:06:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:46 user nova-compute[75014]: INFO nova.virt.block_device [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Booting with volume d6e20ff7-58e6-4de5-8680-e6b29925cfcb at /dev/vdb
Nov 08 04:06:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG os_brick.utils [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3742d23e-0699-4aef-a05e-9a0248500499]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2abdf8b-28f2-4234-9666-0a03ab319549]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:46 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:06:46 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:06:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=7139MB free_disk=24.520519256591797GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2420ad3-13ba-4495-b320-09b541f15063]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[096b98c0-4523-4eb9-a230-c94bbaf24553]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] No VIF found with MAC fa:16:3e:48:9a:fe, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:06:46 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:06:46 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddaf493-fd54-4e85-9d55-b361be4a11fe]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG os_brick.utils [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] <== get_connector_properties: return (525ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Updating existing volume attachment record: 3f5be920-15d7-4a22-bb37-adff4cd860ef {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9f205fe5-576f-4ef0-874b-1544c0307a7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 5bfa6580-e0fe-46b0-b497-8db67806113a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 8527ee40-fb8a-469b-9696-d7bde8cc96f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 655fe5eb-1271-4b9f-a5a6-6342bd012a69 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance bd153f84-98cd-4c6d-a7ab-5759b0b5bf55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance d555b6b3-86ec-40ae-aa20-48846b5157d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance c23c9e00-b782-4530-bb01-a7a167951c1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 0b3b62d9-2543-402b-bdb5-cac994b755c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 36a4109b-f239-48ce-ad49-e640a12a73bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 781932ce-0bea-466f-95e0-066130d6c410 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 75d85e9b-5364-4838-bd6a-c044b6290e7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 1cb11358-b4c4-47f4-ba30-d967d523f98a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 449e9147-efe0-4aa1-af52-557e313bf7fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-30c6f6a6-978b-4d83-aa05-c1c88d897a50 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "781932ce-0bea-466f-95e0-066130d6c410" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.823s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "781932ce-0bea-466f-95e0-066130d6c410" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 16.241s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "781932ce-0bea-466f-95e0-066130d6c410" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:47 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:06:47 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:06:47 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:06:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.714s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7fc4e260-ec83-4489-aec3-341c6e35e85c tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "781932ce-0bea-466f-95e0-066130d6c410" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7fc4e260-ec83-4489-aec3-341c6e35e85c tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "781932ce-0bea-466f-95e0-066130d6c410" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:47 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7fc4e260-ec83-4489-aec3-341c6e35e85c tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:06:47 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7fc4e260-ec83-4489-aec3-341c6e35e85c tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75014) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 08 04:06:47 user nova-compute[75014]: DEBUG nova.objects.instance [None req-7fc4e260-ec83-4489-aec3-341c6e35e85c tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lazy-loading 'flavor' on Instance uuid 781932ce-0bea-466f-95e0-066130d6c410 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:06:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:47 user nova-compute[75014]: DEBUG nova.compute.manager [req-5f310a94-b856-482c-bb49-bc6845e049fb req-40abb3d4-a0aa-4d67-89c7-b41c81df9d5b service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Received event network-vif-unplugged-5b680c90-914d-4583-a698-dccacaff9987 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:06:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5f310a94-b856-482c-bb49-bc6845e049fb req-40abb3d4-a0aa-4d67-89c7-b41c81df9d5b service nova] Acquiring lock "781932ce-0bea-466f-95e0-066130d6c410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5f310a94-b856-482c-bb49-bc6845e049fb req-40abb3d4-a0aa-4d67-89c7-b41c81df9d5b service nova] Lock "781932ce-0bea-466f-95e0-066130d6c410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5f310a94-b856-482c-bb49-bc6845e049fb req-40abb3d4-a0aa-4d67-89c7-b41c81df9d5b service nova] Lock "781932ce-0bea-466f-95e0-066130d6c410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:47 user nova-compute[75014]: DEBUG nova.compute.manager [req-5f310a94-b856-482c-bb49-bc6845e049fb req-40abb3d4-a0aa-4d67-89c7-b41c81df9d5b service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] No waiting events found dispatching network-vif-unplugged-5b680c90-914d-4583-a698-dccacaff9987 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:06:47 user nova-compute[75014]: WARNING nova.compute.manager [req-5f310a94-b856-482c-bb49-bc6845e049fb req-40abb3d4-a0aa-4d67-89c7-b41c81df9d5b service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Received unexpected event network-vif-unplugged-5b680c90-914d-4583-a698-dccacaff9987 for instance with vm_state active and task_state powering-off.
Nov 08 04:06:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:48 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Instance destroyed successfully.
Nov 08 04:06:48 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7fc4e260-ec83-4489-aec3-341c6e35e85c tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:06:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7fc4e260-ec83-4489-aec3-341c6e35e85c tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "781932ce-0bea-466f-95e0-066130d6c410" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.879s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquiring lock "1cb11358-b4c4-47f4-ba30-d967d523f98a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "1cb11358-b4c4-47f4-ba30-d967d523f98a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG nova.objects.instance [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lazy-loading 'flavor' on Instance uuid 1cb11358-b4c4-47f4-ba30-d967d523f98a {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:06:49 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Ignoring supplied device name: /dev/vdb
Nov 08 04:06:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "1cb11358-b4c4-47f4-ba30-d967d523f98a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquiring lock "1cb11358-b4c4-47f4-ba30-d967d523f98a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "1cb11358-b4c4-47f4-ba30-d967d523f98a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:49 user nova-compute[75014]: INFO nova.compute.manager [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Attaching volume c809a55c-75e5-4e8f-950f-845b6594a5b1 to /dev/vdb
Nov 08 04:06:49 user nova-compute[75014]: DEBUG nova.compute.manager [req-84df4ab2-0e33-42d2-8f79-c93520a0db72 req-161b8315-400a-456e-ba80-cbf890bd7e3e service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Received event network-vif-plugged-5b680c90-914d-4583-a698-dccacaff9987 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-84df4ab2-0e33-42d2-8f79-c93520a0db72 req-161b8315-400a-456e-ba80-cbf890bd7e3e service nova] Acquiring lock "781932ce-0bea-466f-95e0-066130d6c410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-84df4ab2-0e33-42d2-8f79-c93520a0db72 req-161b8315-400a-456e-ba80-cbf890bd7e3e service nova] Lock "781932ce-0bea-466f-95e0-066130d6c410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-84df4ab2-0e33-42d2-8f79-c93520a0db72 req-161b8315-400a-456e-ba80-cbf890bd7e3e service nova] Lock "781932ce-0bea-466f-95e0-066130d6c410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG nova.compute.manager [req-84df4ab2-0e33-42d2-8f79-c93520a0db72 req-161b8315-400a-456e-ba80-cbf890bd7e3e service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] No waiting events found dispatching network-vif-plugged-5b680c90-914d-4583-a698-dccacaff9987 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:06:49 user nova-compute[75014]: WARNING nova.compute.manager [req-84df4ab2-0e33-42d2-8f79-c93520a0db72 req-161b8315-400a-456e-ba80-cbf890bd7e3e service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Received unexpected event network-vif-plugged-5b680c90-914d-4583-a698-dccacaff9987 for instance with vm_state stopped and task_state None.
Nov 08 04:06:49 user nova-compute[75014]: DEBUG nova.compute.manager [req-84df4ab2-0e33-42d2-8f79-c93520a0db72 req-161b8315-400a-456e-ba80-cbf890bd7e3e service nova] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Received event network-changed-fa9015d5-2c52-4575-a315-a082c02593eb {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG nova.compute.manager [req-84df4ab2-0e33-42d2-8f79-c93520a0db72 req-161b8315-400a-456e-ba80-cbf890bd7e3e service nova] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Refreshing instance network info cache due to event network-changed-fa9015d5-2c52-4575-a315-a082c02593eb. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-84df4ab2-0e33-42d2-8f79-c93520a0db72 req-161b8315-400a-456e-ba80-cbf890bd7e3e service nova] Acquiring lock "refresh_cache-1cb11358-b4c4-47f4-ba30-d967d523f98a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-84df4ab2-0e33-42d2-8f79-c93520a0db72 req-161b8315-400a-456e-ba80-cbf890bd7e3e service nova] Acquired lock "refresh_cache-1cb11358-b4c4-47f4-ba30-d967d523f98a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG nova.network.neutron [req-84df4ab2-0e33-42d2-8f79-c93520a0db72 req-161b8315-400a-456e-ba80-cbf890bd7e3e service nova] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Refreshing network info cache for port fa9015d5-2c52-4575-a315-a082c02593eb {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG os_brick.utils [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba1a42e-ec6a-4bb4-8431-58c8a704ad8f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc363dd4-0a34-48f1-9850-9615de909e4a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b841ab2-b2f0-49e1-8cf7-e37bbbdfff95]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea4a25c-e589-4abf-a8bb-676cbe820297]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:06:49 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:06:49 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1e349a-c19f-444b-9454-2c481c0881af]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG os_brick.utils [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:06:49 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Updating existing volume attachment record: 96cc4516-39de-4e39-bdd7-828e38bb809f {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:06:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:50 user nova-compute[75014]: DEBUG nova.network.neutron [req-84df4ab2-0e33-42d2-8f79-c93520a0db72 req-161b8315-400a-456e-ba80-cbf890bd7e3e service nova] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Updated VIF entry in instance network info cache for port fa9015d5-2c52-4575-a315-a082c02593eb. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:06:50 user nova-compute[75014]: DEBUG nova.network.neutron [req-84df4ab2-0e33-42d2-8f79-c93520a0db72 req-161b8315-400a-456e-ba80-cbf890bd7e3e service nova] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Updating instance_info_cache with network_info: [{"id": "fa9015d5-2c52-4575-a315-a082c02593eb", "address": "fa:16:3e:3c:38:9c", "network": {"id": "25bc77a0-1460-485f-a61a-a43843631782", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-430613931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e5003c0e79d42248cd1ff8be29fe3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa9015d5-2c", "ovs_interfaceid": "fa9015d5-2c52-4575-a315-a082c02593eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:06:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-84df4ab2-0e33-42d2-8f79-c93520a0db72 req-161b8315-400a-456e-ba80-cbf890bd7e3e service nova] Releasing lock "refresh_cache-1cb11358-b4c4-47f4-ba30-d967d523f98a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:06:51 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d is timed out.
Nov 08 04:06:51 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Successfully detached device vdb from instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d from the live domain config.
Nov 08 04:06:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:06:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oBjLXIQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:06:51 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:06:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:06:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:06:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:51 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded500bd-f145-40d2-a577-97b98b314d5e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:06:51 user nova-compute[75014]: No targets found.
Nov 08 04:06:51 user nova-compute[75014]: iSNS:
Nov 08 04:06:51 user nova-compute[75014]: No targets found.
Nov 08 04:06:51 user nova-compute[75014]: STATIC:
Nov 08 04:06:51 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec
Nov 08 04:06:51 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:06:51 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:06:51 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1
Nov 08 04:06:51 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:06:51 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:06:51 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401
Nov 08 04:06:51 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:06:51 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:06:51 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00
Nov 08 04:06:51 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:06:51 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:06:51 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:06:51 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:06:51 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:06:51 user nova-compute[75014]: FIRMWARE:
Nov 08 04:06:51 user nova-compute[75014]: No targets found.
Nov 08 04:06:51 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:06:52 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:06:52 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1b1505-07df-4cb0-bc43-515b4c2734a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fdc730-b235-44d2-92db-b7c5e02e773a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:06:52 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:06:52 user nova-compute[75014]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 (non-flash)
Nov 08 04:06:52 user nova-compute[75014]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:06:52 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:06:52 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:06:52 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:06:52 user nova-compute[75014]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 (non-flash)
Nov 08 04:06:52 user nova-compute[75014]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:06:52 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:06:52 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f03dc731ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401'): ({'sdb'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Removing single pathed devices sdb {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed14e4bb-0c24-4170-9972-05bd63140ad0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abf9a3f-dcc1-4743-a9d4-179855bfc342]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Flushing IO for device /dev/sdb {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e359869-affd-4c4b-a6aa-e7393d87771d]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa31bfd-da4c-44f2-8c20-0f50c798a8ff]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] SCSI volumes sdb have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[da142a1f-ecb2-4401-bf6a-1b1991bd97d2]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e331304-cd20-443b-a9ab-f6dcc264c18a]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401, portal: 172.16.0.220,3260]
Nov 08 04:06:52 user nova-compute[75014]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401, portal: 172.16.0.220,3260] successful.
Nov 08 04:06:52 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61141d33-5365-41e4-ac05-660439875401 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[55080635-180f-42a5-b184-3fe6e2070b00]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] <== disconnect_volume: return (342ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:06:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:06:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kEHozLdl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:07:01 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:07:01 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:07:01 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:07:01 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:07:01 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9 -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c160d345-0951-4fbd-a524-391660578746]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:07:01 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4d91d5-02f1-4ee7-a6a9-6a2334fa1d4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9] added
Nov 08 04:07:01 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac64f9d1-4faf-419f-9c83-baf1e9905e85]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79d3d0e-1239-40ff-9fa5-79cc183e13f6]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kEHozLdl {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kEHozLdl" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7892d4-a077-4820-9b91-8de6c68b9e85]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kEHozLdl'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded3f164-195a-4481-883e-cbc6f3a2ea5e]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c28e7a-e6fc-4f3e-9d7b-76964dfe0b7c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:07:01 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:07:01 user nova-compute[75014]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:07:01 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:07:01 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:07:01 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:07:01 user nova-compute[75014]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:07:01 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:07:01 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9 -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74551df-6802-43a6-af6e-b80c170b7846]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9, portal: 172.16.0.220,3260]
Nov 08 04:07:01 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9, portal: 172.16.0.220,3260] successful.
Nov 08 04:07:01 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d84c8c-f995-4d41-a993-ce4371def67b]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae3203d-0a54-4cf1-9c28-c6a415a2af6b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:07:01 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:07:01 user nova-compute[75014]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:07:01 user nova-compute[75014]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9 (non-flash)
Nov 08 04:07:01 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:07:01 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:07:01 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:07:01 user nova-compute[75014]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:07:01 user nova-compute[75014]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9 (non-flash)
Nov 08 04:07:01 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:07:01 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6419fda-4095-49d9-8d8f-6f2a2860f87e]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:01 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: None {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:07:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:02 user nova-compute[75014]: DEBUG nova.objects.instance [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lazy-loading 'flavor' on Instance uuid 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:07:02 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-60676c47-b3cd-4639-be03-baab83507172 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 31.283s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:07:02 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:07:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kEHozLdl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:07:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:07:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23765666163363834', 'path': '/dev/sdb'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:07:02 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765666163363834', 'path': '/dev/sdb'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:07:02 user nova-compute[75014]: DEBUG nova.objects.instance [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lazy-loading 'flavor' on Instance uuid 75d85e9b-5364-4838-bd6a-c044b6290e7f {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:07:02 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 04:07:02 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:07:02 user nova-compute[75014]:   <source dev="/dev/sdb"/>
Nov 08 04:07:02 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:07:02 user nova-compute[75014]:   <serial>2c2756b5-7b79-4a2b-bf93-19978a744ef9</serial>
Nov 08 04:07:02 user nova-compute[75014]: </disk>
Nov 08 04:07:02 user nova-compute[75014]:  {{(pid=75014) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] No VIF found with MAC fa:16:3e:95:e6:b4, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7cc786a1-1702-4938-b2e9-b8abefe2ec22 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Acquiring lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7cc786a1-1702-4938-b2e9-b8abefe2ec22 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7cc786a1-1702-4938-b2e9-b8abefe2ec22 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Acquiring lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7cc786a1-1702-4938-b2e9-b8abefe2ec22 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7cc786a1-1702-4938-b2e9-b8abefe2ec22 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:07:03 user nova-compute[75014]: INFO nova.compute.manager [None req-7cc786a1-1702-4938-b2e9-b8abefe2ec22 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Terminating instance
Nov 08 04:07:03 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7cc786a1-1702-4938-b2e9-b8abefe2ec22 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-127d0d35-29a6-4add-967b-06dd7683153f tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "75d85e9b-5364-4838-bd6a-c044b6290e7f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.400s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG nova.compute.manager [req-fb83a612-407f-4734-9c21-1734d7cccc83 req-d8bc2b77-cb1f-4a7e-aa33-11ee49dff65f service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Received event network-vif-unplugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-fb83a612-407f-4734-9c21-1734d7cccc83 req-d8bc2b77-cb1f-4a7e-aa33-11ee49dff65f service nova] Acquiring lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-fb83a612-407f-4734-9c21-1734d7cccc83 req-d8bc2b77-cb1f-4a7e-aa33-11ee49dff65f service nova] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-fb83a612-407f-4734-9c21-1734d7cccc83 req-d8bc2b77-cb1f-4a7e-aa33-11ee49dff65f service nova] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG nova.compute.manager [req-fb83a612-407f-4734-9c21-1734d7cccc83 req-d8bc2b77-cb1f-4a7e-aa33-11ee49dff65f service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] No waiting events found dispatching network-vif-unplugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG nova.compute.manager [req-fb83a612-407f-4734-9c21-1734d7cccc83 req-d8bc2b77-cb1f-4a7e-aa33-11ee49dff65f service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Received event network-vif-unplugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:03 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Instance destroyed successfully.
Nov 08 04:07:03 user nova-compute[75014]: DEBUG nova.objects.instance [None req-7cc786a1-1702-4938-b2e9-b8abefe2ec22 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lazy-loading 'resources' on Instance uuid bd153f84-98cd-4c6d-a7ab-5759b0b5bf55 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-7cc786a1-1702-4938-b2e9-b8abefe2ec22 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-514356008',display_name='tempest-ServerStableDeviceRescueTest-server-514356008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-514356008',id=16,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdDQJUVzJSfwf8EGORwnY5XfvHz/nPlQSVwKWVNMxL13SpO76KX4Hqf7Y0N0SVtjIZCj3Tmkh993LwJ0b5WvZMVqXeJWMWUVI/ttUuEC5MJ6286g6JwsMIVJtb/liLMRQ==',key_name='tempest-keypair-466253599',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:00:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05de04b5317b4257b434019a2db27f18',ramdisk_id='',reservation_id='r-h300xedb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-981631959',owner_user_name='tempest-ServerStableDeviceRescueTest-981631959-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:02:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fe8ccd73ce4d66938868007c49f4a1',uuid=bd153f84-98cd-4c6d-a7ab-5759b0b5bf55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "address": "fa:16:3e:d8:7a:3e", "network": {"id": "64afeb98-3d7d-4d85-a8ac-2deff17e7463", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-737690621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05de04b5317b4257b434019a2db27f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d19a877-95", "ovs_interfaceid": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-7cc786a1-1702-4938-b2e9-b8abefe2ec22 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Converting VIF {"id": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "address": "fa:16:3e:d8:7a:3e", "network": {"id": "64afeb98-3d7d-4d85-a8ac-2deff17e7463", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-737690621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05de04b5317b4257b434019a2db27f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d19a877-95", "ovs_interfaceid": "2d19a877-95a3-4cc5-b98f-c5a097a01304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-7cc786a1-1702-4938-b2e9-b8abefe2ec22 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:7a:3e,bridge_name='br-int',has_traffic_filtering=True,id=2d19a877-95a3-4cc5-b98f-c5a097a01304,network=Network(64afeb98-3d7d-4d85-a8ac-2deff17e7463),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d19a877-95') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG os_vif [None req-7cc786a1-1702-4938-b2e9-b8abefe2ec22 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:7a:3e,bridge_name='br-int',has_traffic_filtering=True,id=2d19a877-95a3-4cc5-b98f-c5a097a01304,network=Network(64afeb98-3d7d-4d85-a8ac-2deff17e7463),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d19a877-95') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d19a877-95, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f53c7a81-3e4a-432a-bcdc-139db4824ef9) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:07:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:03 user nova-compute[75014]: INFO os_vif [None req-7cc786a1-1702-4938-b2e9-b8abefe2ec22 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:7a:3e,bridge_name='br-int',has_traffic_filtering=True,id=2d19a877-95a3-4cc5-b98f-c5a097a01304,network=Network(64afeb98-3d7d-4d85-a8ac-2deff17e7463),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d19a877-95')
Nov 08 04:07:03 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-7cc786a1-1702-4938-b2e9-b8abefe2ec22 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Deleting instance files /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55_del
Nov 08 04:07:03 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-7cc786a1-1702-4938-b2e9-b8abefe2ec22 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Deletion of /opt/stack/data/nova/instances/bd153f84-98cd-4c6d-a7ab-5759b0b5bf55_del complete
Nov 08 04:07:04 user nova-compute[75014]: INFO nova.compute.manager [None req-7cc786a1-1702-4938-b2e9-b8abefe2ec22 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 08 04:07:04 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-7cc786a1-1702-4938-b2e9-b8abefe2ec22 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:07:04 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:07:04 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:07:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "75d85e9b-5364-4838-bd6a-c044b6290e7f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:07:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "75d85e9b-5364-4838-bd6a-c044b6290e7f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:07:04 user nova-compute[75014]: INFO nova.compute.manager [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Detaching volume 2c2756b5-7b79-4a2b-bf93-19978a744ef9
Nov 08 04:07:04 user nova-compute[75014]: INFO nova.virt.block_device [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Attempting to driver detach volume 2c2756b5-7b79-4a2b-bf93-19978a744ef9 from mountpoint /dev/vdb
Nov 08 04:07:04 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Attempting to detach device vdb from instance 75d85e9b-5364-4838-bd6a-c044b6290e7f from the persistent domain config. {{(pid=75014) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 04:07:04 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:07:04 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:07:04 user nova-compute[75014]:   <source dev="/dev/sdb"/>
Nov 08 04:07:04 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:07:04 user nova-compute[75014]:   <serial>2c2756b5-7b79-4a2b-bf93-19978a744ef9</serial>
Nov 08 04:07:04 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:07:04 user nova-compute[75014]: </disk>
Nov 08 04:07:04 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:07:04 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Successfully detached device vdb from instance 75d85e9b-5364-4838-bd6a-c044b6290e7f from the persistent domain config.
Nov 08 04:07:04 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 75d85e9b-5364-4838-bd6a-c044b6290e7f from the live domain config. {{(pid=75014) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 04:07:04 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:07:04 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:07:04 user nova-compute[75014]:   <source dev="/dev/sdb"/>
Nov 08 04:07:04 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:07:04 user nova-compute[75014]:   <serial>2c2756b5-7b79-4a2b-bf93-19978a744ef9</serial>
Nov 08 04:07:04 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:07:04 user nova-compute[75014]: </disk>
Nov 08 04:07:04 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:07:04 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:07:04 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Took 0.69 seconds to deallocate network for instance.
Nov 08 04:07:04 user nova-compute[75014]: INFO nova.compute.manager [None req-5c466582-85dc-4bcc-914d-236abb17ac2d tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Unrescuing
Nov 08 04:07:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5c466582-85dc-4bcc-914d-236abb17ac2d tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "refresh_cache-0b3b62d9-2543-402b-bdb5-cac994b755c9" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:07:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5c466582-85dc-4bcc-914d-236abb17ac2d tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquired lock "refresh_cache-0b3b62d9-2543-402b-bdb5-cac994b755c9" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:07:04 user nova-compute[75014]: DEBUG nova.network.neutron [None req-5c466582-85dc-4bcc-914d-236abb17ac2d tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:07:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7cc786a1-1702-4938-b2e9-b8abefe2ec22 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:07:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7cc786a1-1702-4938-b2e9-b8abefe2ec22 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:07:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 75d85e9b-5364-4838-bd6a-c044b6290e7f {{(pid=75014) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 04:07:05 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-7cc786a1-1702-4938-b2e9-b8abefe2ec22 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:07:05 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-7cc786a1-1702-4938-b2e9-b8abefe2ec22 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:07:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7cc786a1-1702-4938-b2e9-b8abefe2ec22 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.541s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:07:05 user nova-compute[75014]: DEBUG nova.network.neutron [None req-5c466582-85dc-4bcc-914d-236abb17ac2d tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Updating instance_info_cache with network_info: [{"id": "4b006ecf-b195-4491-8ba7-7109ae8701df", "address": "fa:16:3e:c5:3a:a9", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b006ecf-b1", "ovs_interfaceid": "4b006ecf-b195-4491-8ba7-7109ae8701df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:07:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5c466582-85dc-4bcc-914d-236abb17ac2d tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Releasing lock "refresh_cache-0b3b62d9-2543-402b-bdb5-cac994b755c9" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:07:05 user nova-compute[75014]: DEBUG nova.objects.instance [None req-5c466582-85dc-4bcc-914d-236abb17ac2d tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lazy-loading 'flavor' on Instance uuid 0b3b62d9-2543-402b-bdb5-cac994b755c9 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:07:05 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-7cc786a1-1702-4938-b2e9-b8abefe2ec22 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Deleted allocations for instance bd153f84-98cd-4c6d-a7ab-5759b0b5bf55
Nov 08 04:07:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7cc786a1-1702-4938-b2e9-b8abefe2ec22 tempest-ServerStableDeviceRescueTest-981631959 tempest-ServerStableDeviceRescueTest-981631959-project-member] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.440s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:07:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:05 user nova-compute[75014]: DEBUG nova.compute.manager [req-642b1357-3aa8-4b97-815c-e3388d1bd40e req-b81996ed-165e-4919-8d24-b906d0c4c113 service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Received event network-vif-plugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:07:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-642b1357-3aa8-4b97-815c-e3388d1bd40e req-b81996ed-165e-4919-8d24-b906d0c4c113 service nova] Acquiring lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:07:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-642b1357-3aa8-4b97-815c-e3388d1bd40e req-b81996ed-165e-4919-8d24-b906d0c4c113 service nova] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:07:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-642b1357-3aa8-4b97-815c-e3388d1bd40e req-b81996ed-165e-4919-8d24-b906d0c4c113 service nova] Lock "bd153f84-98cd-4c6d-a7ab-5759b0b5bf55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:07:05 user nova-compute[75014]: DEBUG nova.compute.manager [req-642b1357-3aa8-4b97-815c-e3388d1bd40e req-b81996ed-165e-4919-8d24-b906d0c4c113 service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] No waiting events found dispatching network-vif-plugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:07:05 user nova-compute[75014]: WARNING nova.compute.manager [req-642b1357-3aa8-4b97-815c-e3388d1bd40e req-b81996ed-165e-4919-8d24-b906d0c4c113 service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Received unexpected event network-vif-plugged-2d19a877-95a3-4cc5-b98f-c5a097a01304 for instance with vm_state deleted and task_state None.
Nov 08 04:07:05 user nova-compute[75014]: DEBUG nova.compute.manager [req-642b1357-3aa8-4b97-815c-e3388d1bd40e req-b81996ed-165e-4919-8d24-b906d0c4c113 service nova] [instance: bd153f84-98cd-4c6d-a7ab-5759b0b5bf55] Received event network-vif-deleted-2d19a877-95a3-4cc5-b98f-c5a097a01304 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:07:05 user nova-compute[75014]: DEBUG nova.compute.manager [req-ce155115-f1ac-4fbc-9e7f-8d004056364c req-56861568-00c8-47bd-90f7-09e0b4798f99 service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Received event network-vif-unplugged-4b006ecf-b195-4491-8ba7-7109ae8701df {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:07:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ce155115-f1ac-4fbc-9e7f-8d004056364c req-56861568-00c8-47bd-90f7-09e0b4798f99 service nova] Acquiring lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:07:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ce155115-f1ac-4fbc-9e7f-8d004056364c req-56861568-00c8-47bd-90f7-09e0b4798f99 service nova] Lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:07:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ce155115-f1ac-4fbc-9e7f-8d004056364c req-56861568-00c8-47bd-90f7-09e0b4798f99 service nova] Lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:07:05 user nova-compute[75014]: DEBUG nova.compute.manager [req-ce155115-f1ac-4fbc-9e7f-8d004056364c req-56861568-00c8-47bd-90f7-09e0b4798f99 service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] No waiting events found dispatching network-vif-unplugged-4b006ecf-b195-4491-8ba7-7109ae8701df {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:07:05 user nova-compute[75014]: WARNING nova.compute.manager [req-ce155115-f1ac-4fbc-9e7f-8d004056364c req-56861568-00c8-47bd-90f7-09e0b4798f99 service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Received unexpected event network-vif-unplugged-4b006ecf-b195-4491-8ba7-7109ae8701df for instance with vm_state rescued and task_state unrescuing.
Nov 08 04:07:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:06 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Instance destroyed successfully.
Nov 08 04:07:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:07 user nova-compute[75014]: DEBUG nova.compute.manager [req-1c2325e7-b849-421a-9edd-e2cdc3ccdb98 req-7b84b783-a5a2-47ed-91f3-70ac65e65ccd service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Received event network-vif-plugged-4b006ecf-b195-4491-8ba7-7109ae8701df {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:07:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1c2325e7-b849-421a-9edd-e2cdc3ccdb98 req-7b84b783-a5a2-47ed-91f3-70ac65e65ccd service nova] Acquiring lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:07:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1c2325e7-b849-421a-9edd-e2cdc3ccdb98 req-7b84b783-a5a2-47ed-91f3-70ac65e65ccd service nova] Lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:07:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1c2325e7-b849-421a-9edd-e2cdc3ccdb98 req-7b84b783-a5a2-47ed-91f3-70ac65e65ccd service nova] Lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:07:07 user nova-compute[75014]: DEBUG nova.compute.manager [req-1c2325e7-b849-421a-9edd-e2cdc3ccdb98 req-7b84b783-a5a2-47ed-91f3-70ac65e65ccd service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] No waiting events found dispatching network-vif-plugged-4b006ecf-b195-4491-8ba7-7109ae8701df {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:07:07 user nova-compute[75014]: WARNING nova.compute.manager [req-1c2325e7-b849-421a-9edd-e2cdc3ccdb98 req-7b84b783-a5a2-47ed-91f3-70ac65e65ccd service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Received unexpected event network-vif-plugged-4b006ecf-b195-4491-8ba7-7109ae8701df for instance with vm_state rescued and task_state unrescuing.
Nov 08 04:07:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:09 user nova-compute[75014]: DEBUG nova.compute.manager [req-a9716b75-4fc7-47b2-a4ac-a3f2563835c8 req-653a56dd-2bba-4b9b-8f00-c8dc1d3c4fde service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Received event network-vif-plugged-4b006ecf-b195-4491-8ba7-7109ae8701df {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:07:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a9716b75-4fc7-47b2-a4ac-a3f2563835c8 req-653a56dd-2bba-4b9b-8f00-c8dc1d3c4fde service nova] Acquiring lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:07:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a9716b75-4fc7-47b2-a4ac-a3f2563835c8 req-653a56dd-2bba-4b9b-8f00-c8dc1d3c4fde service nova] Lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:07:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a9716b75-4fc7-47b2-a4ac-a3f2563835c8 req-653a56dd-2bba-4b9b-8f00-c8dc1d3c4fde service nova] Lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:07:09 user nova-compute[75014]: DEBUG nova.compute.manager [req-a9716b75-4fc7-47b2-a4ac-a3f2563835c8 req-653a56dd-2bba-4b9b-8f00-c8dc1d3c4fde service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] No waiting events found dispatching network-vif-plugged-4b006ecf-b195-4491-8ba7-7109ae8701df {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:07:09 user nova-compute[75014]: WARNING nova.compute.manager [req-a9716b75-4fc7-47b2-a4ac-a3f2563835c8 req-653a56dd-2bba-4b9b-8f00-c8dc1d3c4fde service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Received unexpected event network-vif-plugged-4b006ecf-b195-4491-8ba7-7109ae8701df for instance with vm_state rescued and task_state unrescuing.
Nov 08 04:07:09 user nova-compute[75014]: DEBUG nova.compute.manager [req-a9716b75-4fc7-47b2-a4ac-a3f2563835c8 req-653a56dd-2bba-4b9b-8f00-c8dc1d3c4fde service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Received event network-vif-plugged-4b006ecf-b195-4491-8ba7-7109ae8701df {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:07:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a9716b75-4fc7-47b2-a4ac-a3f2563835c8 req-653a56dd-2bba-4b9b-8f00-c8dc1d3c4fde service nova] Acquiring lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:07:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a9716b75-4fc7-47b2-a4ac-a3f2563835c8 req-653a56dd-2bba-4b9b-8f00-c8dc1d3c4fde service nova] Lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:07:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a9716b75-4fc7-47b2-a4ac-a3f2563835c8 req-653a56dd-2bba-4b9b-8f00-c8dc1d3c4fde service nova] Lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:07:09 user nova-compute[75014]: DEBUG nova.compute.manager [req-a9716b75-4fc7-47b2-a4ac-a3f2563835c8 req-653a56dd-2bba-4b9b-8f00-c8dc1d3c4fde service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] No waiting events found dispatching network-vif-plugged-4b006ecf-b195-4491-8ba7-7109ae8701df {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:07:09 user nova-compute[75014]: WARNING nova.compute.manager [req-a9716b75-4fc7-47b2-a4ac-a3f2563835c8 req-653a56dd-2bba-4b9b-8f00-c8dc1d3c4fde service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Received unexpected event network-vif-plugged-4b006ecf-b195-4491-8ba7-7109ae8701df for instance with vm_state rescued and task_state unrescuing.
Nov 08 04:07:10 user nova-compute[75014]: DEBUG nova.compute.manager [None req-5c466582-85dc-4bcc-914d-236abb17ac2d tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:07:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:25 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 75d85e9b-5364-4838-bd6a-c044b6290e7f is timed out.
Nov 08 04:07:25 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Successfully detached device vdb from instance 75d85e9b-5364-4838-bd6a-c044b6290e7f from the live domain config.
Nov 08 04:07:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kEHozLdl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:07:25 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:07:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdca6a1-1404-482f-810f-a0389a0f3f86]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:07:25 user nova-compute[75014]: No targets found.
Nov 08 04:07:25 user nova-compute[75014]: iSNS:
Nov 08 04:07:25 user nova-compute[75014]: No targets found.
Nov 08 04:07:25 user nova-compute[75014]: STATIC:
Nov 08 04:07:25 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec
Nov 08 04:07:25 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:07:25 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:07:25 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1
Nov 08 04:07:25 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:07:25 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:07:25 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00
Nov 08 04:07:25 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:07:25 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:07:25 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:07:25 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:07:25 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:07:25 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9
Nov 08 04:07:25 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:07:25 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:07:25 user nova-compute[75014]: FIRMWARE:
Nov 08 04:07:25 user nova-compute[75014]: No targets found.
Nov 08 04:07:25 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:07:25 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:07:25 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a645e788-a37c-483a-9061-8f4ed9846027]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[702eb97a-bc3c-438f-8a15-9c38c7cba3ed]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:07:25 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:07:25 user nova-compute[75014]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:07:25 user nova-compute[75014]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9 (non-flash)
Nov 08 04:07:25 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:07:25 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:07:25 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:07:25 user nova-compute[75014]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:07:25 user nova-compute[75014]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9 (non-flash)
Nov 08 04:07:25 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:07:25 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f04003c8790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9'): ({'sdb'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Removing single pathed devices sdb {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b019b3-3869-4393-ad00-b31fa9ae7544]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[224c04e1-d4c8-4272-9f08-cc2a1357e2eb]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Flushing IO for device /dev/sdb {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[548bbfb4-77ff-4c53-b730-7e1ec659f89f]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b78ff1-1a0d-4251-b1b0-699498ba2d9d]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] SCSI volumes sdb have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64a978e-573f-477a-897a-5d74f80e415f]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9 -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[708c45c1-a900-4b97-b53c-6961f90febdd]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9, portal: 172.16.0.220,3260]
Nov 08 04:07:25 user nova-compute[75014]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9, portal: 172.16.0.220,3260] successful.
Nov 08 04:07:25 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9 -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c2756b5-7b79-4a2b-bf93-19978a744ef9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff163ebf-7941-4805-8ab7-25200bd9c910]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b06965e0-e08e-46cb-8239-762715a7f65a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b06965e0-e08e-46cb-8239-762715a7f65a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b06965e0-e08e-46cb-8239-762715a7f65a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b06965e0-e08e-46cb-8239-762715a7f65a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b06965e0-e08e-46cb-8239-762715a7f65a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] <== disconnect_volume: return (327ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:07:25 user nova-compute[75014]: INFO nova.compute.manager [None req-b06965e0-e08e-46cb-8239-762715a7f65a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Terminating instance
Nov 08 04:07:25 user nova-compute[75014]: DEBUG nova.compute.manager [None req-b06965e0-e08e-46cb-8239-762715a7f65a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG nova.compute.manager [req-8b158ed4-00c7-4b4f-959e-92454d856937 req-bbda0115-36d6-4817-9abd-654d4efe69a9 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Received event network-vif-unplugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8b158ed4-00c7-4b4f-959e-92454d856937 req-bbda0115-36d6-4817-9abd-654d4efe69a9 service nova] Acquiring lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8b158ed4-00c7-4b4f-959e-92454d856937 req-bbda0115-36d6-4817-9abd-654d4efe69a9 service nova] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8b158ed4-00c7-4b4f-959e-92454d856937 req-bbda0115-36d6-4817-9abd-654d4efe69a9 service nova] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG nova.compute.manager [req-8b158ed4-00c7-4b4f-959e-92454d856937 req-bbda0115-36d6-4817-9abd-654d4efe69a9 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] No waiting events found dispatching network-vif-unplugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG nova.compute.manager [req-8b158ed4-00c7-4b4f-959e-92454d856937 req-bbda0115-36d6-4817-9abd-654d4efe69a9 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Received event network-vif-unplugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:26 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Instance destroyed successfully.
Nov 08 04:07:26 user nova-compute[75014]: DEBUG nova.objects.instance [None req-b06965e0-e08e-46cb-8239-762715a7f65a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lazy-loading 'resources' on Instance uuid 8527ee40-fb8a-469b-9696-d7bde8cc96f7 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:07:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-b06965e0-e08e-46cb-8239-762715a7f65a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:49:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1953351529',display_name='tempest-ServerRescueNegativeTestJSON-server-1953351529',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1953351529',id=4,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:51:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b48713cc3a8e4082b76fc0408088c607',ramdisk_id='',reservation_id='r-31tv27la',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1450625183',owner_user_name='tempest-ServerRescueNegativeTestJSON-1450625183-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T03:51:24Z,user_data=None,user_id='ffadb91b73464e559344658dd11bf60d',uuid=8527ee40-fb8a-469b-9696-d7bde8cc96f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "address": "fa:16:3e:eb:34:b6", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa428a2cb-5b", "ovs_interfaceid": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:07:26 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-b06965e0-e08e-46cb-8239-762715a7f65a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Converting VIF {"id": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "address": "fa:16:3e:eb:34:b6", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa428a2cb-5b", "ovs_interfaceid": "a428a2cb-5b9c-44fc-bc45-94488f6812b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:07:26 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-b06965e0-e08e-46cb-8239-762715a7f65a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:34:b6,bridge_name='br-int',has_traffic_filtering=True,id=a428a2cb-5b9c-44fc-bc45-94488f6812b6,network=Network(982531ca-8a2f-41de-b62e-5b43b6a45a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa428a2cb-5b') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:07:26 user nova-compute[75014]: DEBUG os_vif [None req-b06965e0-e08e-46cb-8239-762715a7f65a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:34:b6,bridge_name='br-int',has_traffic_filtering=True,id=a428a2cb-5b9c-44fc-bc45-94488f6812b6,network=Network(982531ca-8a2f-41de-b62e-5b43b6a45a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa428a2cb-5b') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:07:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa428a2cb-5b, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:07:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:07:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b156806-49f2-40f8-8aa8-d1bed3c4006e) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:07:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:07:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:26 user nova-compute[75014]: INFO os_vif [None req-b06965e0-e08e-46cb-8239-762715a7f65a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:34:b6,bridge_name='br-int',has_traffic_filtering=True,id=a428a2cb-5b9c-44fc-bc45-94488f6812b6,network=Network(982531ca-8a2f-41de-b62e-5b43b6a45a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa428a2cb-5b')
Nov 08 04:07:26 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-b06965e0-e08e-46cb-8239-762715a7f65a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Deleting instance files /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7_del
Nov 08 04:07:26 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-b06965e0-e08e-46cb-8239-762715a7f65a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Deletion of /opt/stack/data/nova/instances/8527ee40-fb8a-469b-9696-d7bde8cc96f7_del complete
Nov 08 04:07:26 user nova-compute[75014]: DEBUG nova.objects.instance [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lazy-loading 'flavor' on Instance uuid 75d85e9b-5364-4838-bd6a-c044b6290e7f {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:07:26 user nova-compute[75014]: INFO nova.compute.manager [None req-b06965e0-e08e-46cb-8239-762715a7f65a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 08 04:07:26 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-b06965e0-e08e-46cb-8239-762715a7f65a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:07:26 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:07:26 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:07:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f44cc712-ec12-4a9a-8f88-10eb9e1a25d4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "75d85e9b-5364-4838-bd6a-c044b6290e7f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.989s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:07:26 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:07:26 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Took 0.49 seconds to deallocate network for instance.
Nov 08 04:07:26 user nova-compute[75014]: DEBUG nova.compute.manager [req-df32f45f-afae-420e-ae9d-1b93b073107d req-f3673852-932d-4c41-a200-5ce8b2696f70 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Received event network-vif-deleted-a428a2cb-5b9c-44fc-bc45-94488f6812b6 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:07:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b06965e0-e08e-46cb-8239-762715a7f65a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:07:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b06965e0-e08e-46cb-8239-762715a7f65a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:07:27 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-b06965e0-e08e-46cb-8239-762715a7f65a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:07:27 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-b06965e0-e08e-46cb-8239-762715a7f65a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:07:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b06965e0-e08e-46cb-8239-762715a7f65a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:07:27 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-b06965e0-e08e-46cb-8239-762715a7f65a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Deleted allocations for instance 8527ee40-fb8a-469b-9696-d7bde8cc96f7
Nov 08 04:07:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b06965e0-e08e-46cb-8239-762715a7f65a tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.074s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:07:27 user nova-compute[75014]: DEBUG nova.compute.manager [req-449a563a-47fb-4602-be7f-733bcc94b3a9 req-57e57995-40ea-4fb1-8336-b2c8c1074a51 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Received event network-vif-plugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:07:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-449a563a-47fb-4602-be7f-733bcc94b3a9 req-57e57995-40ea-4fb1-8336-b2c8c1074a51 service nova] Acquiring lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:07:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-449a563a-47fb-4602-be7f-733bcc94b3a9 req-57e57995-40ea-4fb1-8336-b2c8c1074a51 service nova] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:07:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-449a563a-47fb-4602-be7f-733bcc94b3a9 req-57e57995-40ea-4fb1-8336-b2c8c1074a51 service nova] Lock "8527ee40-fb8a-469b-9696-d7bde8cc96f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:07:27 user nova-compute[75014]: DEBUG nova.compute.manager [req-449a563a-47fb-4602-be7f-733bcc94b3a9 req-57e57995-40ea-4fb1-8336-b2c8c1074a51 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] No waiting events found dispatching network-vif-plugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:07:27 user nova-compute[75014]: WARNING nova.compute.manager [req-449a563a-47fb-4602-be7f-733bcc94b3a9 req-57e57995-40ea-4fb1-8336-b2c8c1074a51 service nova] [instance: 8527ee40-fb8a-469b-9696-d7bde8cc96f7] Received unexpected event network-vif-plugged-a428a2cb-5b9c-44fc-bc45-94488f6812b6 for instance with vm_state deleted and task_state None.
Nov 08 04:07:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:35 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 04:07:35 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Creating image(s)
Nov 08 04:07:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "/opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:07:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "/opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:07:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "/opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:07:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.197s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.189s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk 1073741824" returned: 0 in 0.054s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.190s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Checking if we can resize image /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Cannot resize image /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Ensure instance console log exists: /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Start _get_guest_xml network_info=[{"id": "a575a382-2b45-4494-b351-0ace52e3588b", "address": "fa:16:3e:17:47:bd", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa575a382-2b", "ovs_interfaceid": "a575a382-2b45-4494-b351-0ace52e3588b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmyjVSXs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '36a4109b-f239-48ce-ad49-e640a12a73bf', 'attached_at': '', 'detached_at': '', 'volume_id': 'd6e20ff7-58e6-4de5-8680-e6b29925cfcb', 'serial': 'd6e20ff7-58e6-4de5-8680-e6b29925cfcb'}, 'device_type': 'disk', 'attachment_id': '3f5be920-15d7-4a22-bb37-adff4cd860ef', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:07:36 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 08 04:07:36 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 08 04:07:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG nova.objects.instance [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lazy-loading 'vcpu_model' on Instance uuid 36a4109b-f239-48ce-ad49-e640a12a73bf {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmyjVSXs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:07:36 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 04:07:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:07:36 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 04:07:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:07:36 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:07:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9dda73-d8b8-4b35-a688-95dd3352365d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:07:36 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb7da87-fd02-4d63-a1d5-6221e23913f1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb] added
Nov 08 04:07:36 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9099654-f83e-478d-b1e3-ee152885a49b]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb1a6e9-11eb-4acd-8d8a-e6ef56f434f5]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:07:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HmyjVSXs {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HmyjVSXs" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4baed54b-cbe9-4012-8a01-eaa4dafe5554]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HmyjVSXs'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f6d1e2-1ed4-4912-8222-cdd0ba4a1b00]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c76981c-01d9-49b8-ac8c-38d99d3ac027]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:07:37 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:07:37 user nova-compute[75014]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:07:37 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:07:37 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:07:37 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:07:37 user nova-compute[75014]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:07:37 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:07:37 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c383f4-6b32-4904-afdd-23bbfa66c428]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb, portal: 172.16.0.220,3260]
Nov 08 04:07:37 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb, portal: 172.16.0.220,3260] successful.
Nov 08 04:07:37 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a982d8c5-af66-4a73-847b-d988d83839e5]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f2b043-af4a-4016-906b-6164164363e7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:07:37 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:07:37 user nova-compute[75014]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:07:37 user nova-compute[75014]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:07:37 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:07:37 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:07:37 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:07:37 user nova-compute[75014]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:07:37 user nova-compute[75014]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:07:37 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:07:37 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a330fdf-d57e-4584-ad98-ca89c314f305]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: None {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:07:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmyjVSXs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26236323065643665', 'path': '/dev/sdb'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236323065643665', 'path': '/dev/sdb'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T04:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-372983470',display_name='tempest-ServerActionsTestOtherA-server-1298346474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-372983470',id=29,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhheGyNzDlKZ2iBJ0DNzi5AYIcLl14TQHCatvNP3avHAzjaEguIvBGcBxNnOYp/JkyWAjVRAHcTHBiFLXLHVGrIzmoaj96sMdyVyHAw+f4ZhavFNOqzCWT3h0YxLOs+7g==',key_name='tempest-keypair-1837241282',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:04:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7b9ecaed30ba4ad1a9d5eaca02633604',ramdisk_id='',reservation_id='r-prevyyvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-537496863',owner_user_name='tempest-ServerActionsTestOtherA-537496863-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:06:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8398fcf62a014e7f943bff6fcc3f72f3',uuid=36a4109b-f239-48ce-ad49-e640a12a73bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a575a382-2b45-4494-b351-0ace52e3588b", "address": "fa:16:3e:17:47:bd", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa575a382-2b", "ovs_interfaceid": "a575a382-2b45-4494-b351-0ace52e3588b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Converting VIF {"id": "a575a382-2b45-4494-b351-0ace52e3588b", "address": "fa:16:3e:17:47:bd", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa575a382-2b", "ovs_interfaceid": "a575a382-2b45-4494-b351-0ace52e3588b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:47:bd,bridge_name='br-int',has_traffic_filtering=True,id=a575a382-2b45-4494-b351-0ace52e3588b,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa575a382-2b') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:07:38 user nova-compute[75014]:   <uuid>36a4109b-f239-48ce-ad49-e640a12a73bf</uuid>
Nov 08 04:07:38 user nova-compute[75014]:   <name>instance-0000001d</name>
Nov 08 04:07:38 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:07:38 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:07:38 user nova-compute[75014]:   <metadata>
Nov 08 04:07:38 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:07:38 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:07:38 user nova-compute[75014]:       <nova:name>tempest-ServerActionsTestOtherA-server-1298346474</nova:name>
Nov 08 04:07:38 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:07:36</nova:creationTime>
Nov 08 04:07:38 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:07:38 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:07:38 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:07:38 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:07:38 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:07:38 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:07:38 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:07:38 user nova-compute[75014]:       <nova:owner>
Nov 08 04:07:38 user nova-compute[75014]:         <nova:user uuid="8398fcf62a014e7f943bff6fcc3f72f3">tempest-ServerActionsTestOtherA-537496863-project-member</nova:user>
Nov 08 04:07:38 user nova-compute[75014]:         <nova:project uuid="7b9ecaed30ba4ad1a9d5eaca02633604">tempest-ServerActionsTestOtherA-537496863</nova:project>
Nov 08 04:07:38 user nova-compute[75014]:       </nova:owner>
Nov 08 04:07:38 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:07:38 user nova-compute[75014]:       <nova:ports>
Nov 08 04:07:38 user nova-compute[75014]:         <nova:port uuid="a575a382-2b45-4494-b351-0ace52e3588b">
Nov 08 04:07:38 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 04:07:38 user nova-compute[75014]:         </nova:port>
Nov 08 04:07:38 user nova-compute[75014]:       </nova:ports>
Nov 08 04:07:38 user nova-compute[75014]:     </nova:instance>
Nov 08 04:07:38 user nova-compute[75014]:   </metadata>
Nov 08 04:07:38 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:07:38 user nova-compute[75014]:     <system>
Nov 08 04:07:38 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:07:38 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:07:38 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:07:38 user nova-compute[75014]:       <entry name="serial">36a4109b-f239-48ce-ad49-e640a12a73bf</entry>
Nov 08 04:07:38 user nova-compute[75014]:       <entry name="uuid">36a4109b-f239-48ce-ad49-e640a12a73bf</entry>
Nov 08 04:07:38 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:07:38 user nova-compute[75014]:     </system>
Nov 08 04:07:38 user nova-compute[75014]:   </sysinfo>
Nov 08 04:07:38 user nova-compute[75014]:   <os>
Nov 08 04:07:38 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:07:38 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:07:38 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:07:38 user nova-compute[75014]:   </os>
Nov 08 04:07:38 user nova-compute[75014]:   <features>
Nov 08 04:07:38 user nova-compute[75014]:     <acpi/>
Nov 08 04:07:38 user nova-compute[75014]:     <apic/>
Nov 08 04:07:38 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:07:38 user nova-compute[75014]:   </features>
Nov 08 04:07:38 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:07:38 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:07:38 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:07:38 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:07:38 user nova-compute[75014]:   </clock>
Nov 08 04:07:38 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:07:38 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:07:38 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:07:38 user nova-compute[75014]:   </cpu>
Nov 08 04:07:38 user nova-compute[75014]:   <devices>
Nov 08 04:07:38 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 04:07:38 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 04:07:38 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk"/>
Nov 08 04:07:38 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:07:38 user nova-compute[75014]:     </disk>
Nov 08 04:07:38 user nova-compute[75014]:     <disk type="block" device="disk">
Nov 08 04:07:38 user nova-compute[75014]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:07:38 user nova-compute[75014]:       <source dev="/dev/sdb"/>
Nov 08 04:07:38 user nova-compute[75014]:       <target dev="vdb" bus="virtio"/>
Nov 08 04:07:38 user nova-compute[75014]:       <serial>d6e20ff7-58e6-4de5-8680-e6b29925cfcb</serial>
Nov 08 04:07:38 user nova-compute[75014]:     </disk>
Nov 08 04:07:38 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:07:38 user nova-compute[75014]:       <mac address="fa:16:3e:17:47:bd"/>
Nov 08 04:07:38 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:07:38 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:07:38 user nova-compute[75014]:       <target dev="tapa575a382-2b"/>
Nov 08 04:07:38 user nova-compute[75014]:     </interface>
Nov 08 04:07:38 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:07:38 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/console.log" append="off"/>
Nov 08 04:07:38 user nova-compute[75014]:     </serial>
Nov 08 04:07:38 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:07:38 user nova-compute[75014]:     <video>
Nov 08 04:07:38 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:07:38 user nova-compute[75014]:     </video>
Nov 08 04:07:38 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:07:38 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:07:38 user nova-compute[75014]:     </rng>
Nov 08 04:07:38 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:07:38 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:07:38 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:07:38 user nova-compute[75014]:     </memballoon>
Nov 08 04:07:38 user nova-compute[75014]:   </devices>
Nov 08 04:07:38 user nova-compute[75014]: </domain>
Nov 08 04:07:38 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T04:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-372983470',display_name='tempest-ServerActionsTestOtherA-server-1298346474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-372983470',id=29,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhheGyNzDlKZ2iBJ0DNzi5AYIcLl14TQHCatvNP3avHAzjaEguIvBGcBxNnOYp/JkyWAjVRAHcTHBiFLXLHVGrIzmoaj96sMdyVyHAw+f4ZhavFNOqzCWT3h0YxLOs+7g==',key_name='tempest-keypair-1837241282',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:04:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7b9ecaed30ba4ad1a9d5eaca02633604',ramdisk_id='',reservation_id='r-prevyyvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-537496863',owner_user_name='tempest-ServerActionsTestOtherA-537496863-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:06:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8398fcf62a014e7f943bff6fcc3f72f3',uuid=36a4109b-f239-48ce-ad49-e640a12a73bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a575a382-2b45-4494-b351-0ace52e3588b", "address": "fa:16:3e:17:47:bd", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa575a382-2b", "ovs_interfaceid": "a575a382-2b45-4494-b351-0ace52e3588b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Converting VIF {"id": "a575a382-2b45-4494-b351-0ace52e3588b", "address": "fa:16:3e:17:47:bd", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa575a382-2b", "ovs_interfaceid": "a575a382-2b45-4494-b351-0ace52e3588b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:47:bd,bridge_name='br-int',has_traffic_filtering=True,id=a575a382-2b45-4494-b351-0ace52e3588b,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa575a382-2b') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG os_vif [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:47:bd,bridge_name='br-int',has_traffic_filtering=True,id=a575a382-2b45-4494-b351-0ace52e3588b,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa575a382-2b') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ea095c7-f1bc-5553-96e3-c3f46403154b', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa575a382-2b, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa575a382-2b, col_values=(('qos', UUID('27c4c3f2-43cd-4f9a-9f2f-d6cb1ec916f3')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa575a382-2b, col_values=(('external_ids', {'iface-id': 'a575a382-2b45-4494-b351-0ace52e3588b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:47:bd', 'vm-uuid': '36a4109b-f239-48ce-ad49-e640a12a73bf'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:07:38 user nova-compute[75014]: INFO os_vif [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:47:bd,bridge_name='br-int',has_traffic_filtering=True,id=a575a382-2b45-4494-b351-0ace52e3588b,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa575a382-2b')
Nov 08 04:07:38 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] No VIF found with MAC fa:16:3e:17:47:bd, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-d555b6b3-86ec-40ae-aa20-48846b5157d5" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-d555b6b3-86ec-40ae-aa20-48846b5157d5" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Updating instance_info_cache with network_info: [{"id": "611f5c87-6ea2-44f7-95ff-c2a8375bbb76", "address": "fa:16:3e:1b:8a:50", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap611f5c87-6e", "ovs_interfaceid": "611f5c87-6ea2-44f7-95ff-c2a8375bbb76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-d555b6b3-86ec-40ae-aa20-48846b5157d5" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:07:38 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:07:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:40 user nova-compute[75014]: DEBUG nova.compute.manager [req-e9a4b0b2-3bb9-47c3-8494-de11c8eb129b req-f3790e9b-37e2-49b4-b8ae-62fc115b6e48 service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Received event network-vif-plugged-a575a382-2b45-4494-b351-0ace52e3588b {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:07:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e9a4b0b2-3bb9-47c3-8494-de11c8eb129b req-f3790e9b-37e2-49b4-b8ae-62fc115b6e48 service nova] Acquiring lock "36a4109b-f239-48ce-ad49-e640a12a73bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:07:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e9a4b0b2-3bb9-47c3-8494-de11c8eb129b req-f3790e9b-37e2-49b4-b8ae-62fc115b6e48 service nova] Lock "36a4109b-f239-48ce-ad49-e640a12a73bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:07:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e9a4b0b2-3bb9-47c3-8494-de11c8eb129b req-f3790e9b-37e2-49b4-b8ae-62fc115b6e48 service nova] Lock "36a4109b-f239-48ce-ad49-e640a12a73bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:07:40 user nova-compute[75014]: DEBUG nova.compute.manager [req-e9a4b0b2-3bb9-47c3-8494-de11c8eb129b req-f3790e9b-37e2-49b4-b8ae-62fc115b6e48 service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] No waiting events found dispatching network-vif-plugged-a575a382-2b45-4494-b351-0ace52e3588b {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:07:40 user nova-compute[75014]: WARNING nova.compute.manager [req-e9a4b0b2-3bb9-47c3-8494-de11c8eb129b req-f3790e9b-37e2-49b4-b8ae-62fc115b6e48 service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Received unexpected event network-vif-plugged-a575a382-2b45-4494-b351-0ace52e3588b for instance with vm_state active and task_state rebuild_spawning.
Nov 08 04:07:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:41 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:07:41 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:07:41 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:07:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:07:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:07:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:07:41 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:07:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75d85e9b-5364-4838-bd6a-c044b6290e7f/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75d85e9b-5364-4838-bd6a-c044b6290e7f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75d85e9b-5364-4838-bd6a-c044b6290e7f/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75d85e9b-5364-4838-bd6a-c044b6290e7f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:42 user nova-compute[75014]: DEBUG nova.compute.manager [req-bf7d548d-6fda-46aa-84e8-defe8d2e95ad req-6e968ce2-5b38-4828-8b6d-8a129a61fed2 service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Received event network-vif-plugged-a575a382-2b45-4494-b351-0ace52e3588b {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:07:42 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-bf7d548d-6fda-46aa-84e8-defe8d2e95ad req-6e968ce2-5b38-4828-8b6d-8a129a61fed2 service nova] Acquiring lock "36a4109b-f239-48ce-ad49-e640a12a73bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:07:42 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-bf7d548d-6fda-46aa-84e8-defe8d2e95ad req-6e968ce2-5b38-4828-8b6d-8a129a61fed2 service nova] Lock "36a4109b-f239-48ce-ad49-e640a12a73bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:07:42 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-bf7d548d-6fda-46aa-84e8-defe8d2e95ad req-6e968ce2-5b38-4828-8b6d-8a129a61fed2 service nova] Lock "36a4109b-f239-48ce-ad49-e640a12a73bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:07:42 user nova-compute[75014]: DEBUG nova.compute.manager [req-bf7d548d-6fda-46aa-84e8-defe8d2e95ad req-6e968ce2-5b38-4828-8b6d-8a129a61fed2 service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] No waiting events found dispatching network-vif-plugged-a575a382-2b45-4494-b351-0ace52e3588b {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:07:42 user nova-compute[75014]: WARNING nova.compute.manager [req-bf7d548d-6fda-46aa-84e8-defe8d2e95ad req-6e968ce2-5b38-4828-8b6d-8a129a61fed2 service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Received unexpected event network-vif-plugged-a575a382-2b45-4494-b351-0ace52e3588b for instance with vm_state active and task_state rebuild_spawning.
Nov 08 04:07:42 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:07:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 04:07:42 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Instance spawned successfully.
Nov 08 04:07:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 04:07:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:07:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:07:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:07:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:07:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:07:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:07:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:42 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:07:42 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:07:42 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:07:42 user nova-compute[75014]: DEBUG nova.objects.instance [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75014) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 08 04:07:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:42 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f91e306f-cc2a-43f8-bb4d-f3f04595f884 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.119s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:07:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:07:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:07:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:07:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:07:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json" returned: 0 in 0.399s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:46 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:07:46 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:07:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=7667MB free_disk=24.698837280273438GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:07:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:07:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:07:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9f205fe5-576f-4ef0-874b-1544c0307a7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:07:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 5bfa6580-e0fe-46b0-b497-8db67806113a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:07:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 655fe5eb-1271-4b9f-a5a6-6342bd012a69 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:07:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:07:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance d555b6b3-86ec-40ae-aa20-48846b5157d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:07:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance c23c9e00-b782-4530-bb01-a7a167951c1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:07:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 0b3b62d9-2543-402b-bdb5-cac994b755c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:07:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 36a4109b-f239-48ce-ad49-e640a12a73bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:07:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 781932ce-0bea-466f-95e0-066130d6c410 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:07:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 75d85e9b-5364-4838-bd6a-c044b6290e7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:07:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 1cb11358-b4c4-47f4-ba30-d967d523f98a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:07:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 449e9147-efe0-4aa1-af52-557e313bf7fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:07:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:07:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:07:46 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:07:46 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:07:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:07:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.560s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AEvVGDJZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:07:47 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:07:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:07:47 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:07:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:07:47 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a594d2-42a4-4bb8-ad91-f231ebefa2dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:07:47 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e08e425-c37a-42bd-85f8-6884e6a17184]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1] added
Nov 08 04:07:47 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b250eed4-751a-42de-8642-f7a8c849fb96]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b0cc61-09bb-4faa-aaf3-7c9405d9dfdb]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AEvVGDJZ {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AEvVGDJZ" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54ebcc9-1def-4404-ae7e-ea2105a59266]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AEvVGDJZ'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4780fc9e-48ad-4863-9f08-68fdbffd37f0]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ae308d-0b3a-414e-8a3a-f72b7620034d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:07:47 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:07:47 user nova-compute[75014]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:07:47 user nova-compute[75014]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:07:47 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:07:47 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:07:47 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:07:47 user nova-compute[75014]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:07:47 user nova-compute[75014]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:07:47 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:07:47 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3f42ca-b02e-47b8-a0fc-6d225a783b73]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1, portal: 172.16.0.220,3260]
Nov 08 04:07:47 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1, portal: 172.16.0.220,3260] successful.
Nov 08 04:07:47 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bb6a13-a029-44f6-8d6a-cbd322def2a0]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae3682e-d989-48ac-ae10-7724febcce7d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:07:47 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:07:47 user nova-compute[75014]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:07:47 user nova-compute[75014]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:07:47 user nova-compute[75014]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 (non-flash)
Nov 08 04:07:47 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:07:47 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:07:47 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:07:47 user nova-compute[75014]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:07:47 user nova-compute[75014]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:07:47 user nova-compute[75014]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 (non-flash)
Nov 08 04:07:47 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:07:47 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab72e940-b7ba-4717-9981-a8b75d3d2e35]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:47 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: None {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:07:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:07:48 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:07:48 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AEvVGDJZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:07:48 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:07:48 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23864343739626232', 'path': '/dev/sde'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:07:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864343739626232', 'path': '/dev/sde'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:07:48 user nova-compute[75014]: DEBUG nova.objects.instance [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lazy-loading 'flavor' on Instance uuid 1cb11358-b4c4-47f4-ba30-d967d523f98a {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:07:49 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 04:07:49 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:07:49 user nova-compute[75014]:   <source dev="/dev/sde"/>
Nov 08 04:07:49 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:07:49 user nova-compute[75014]:   <serial>c809a55c-75e5-4e8f-950f-845b6594a5b1</serial>
Nov 08 04:07:49 user nova-compute[75014]: </disk>
Nov 08 04:07:49 user nova-compute[75014]:  {{(pid=75014) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 04:07:49 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:07:49 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:07:49 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] No VIF found with MAC fa:16:3e:3c:38:9c, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:07:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-61a34508-8696-4e6a-8ee0-a4e4c0662515 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "1cb11358-b4c4-47f4-ba30-d967d523f98a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 59.848s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:07:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1d1a18c4-4e55-4106-ad51-6a88de1b0365 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "75d85e9b-5364-4838-bd6a-c044b6290e7f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:07:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1d1a18c4-4e55-4106-ad51-6a88de1b0365 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "75d85e9b-5364-4838-bd6a-c044b6290e7f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:07:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1d1a18c4-4e55-4106-ad51-6a88de1b0365 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "75d85e9b-5364-4838-bd6a-c044b6290e7f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:07:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1d1a18c4-4e55-4106-ad51-6a88de1b0365 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "75d85e9b-5364-4838-bd6a-c044b6290e7f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:07:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1d1a18c4-4e55-4106-ad51-6a88de1b0365 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "75d85e9b-5364-4838-bd6a-c044b6290e7f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:07:54 user nova-compute[75014]: INFO nova.compute.manager [None req-1d1a18c4-4e55-4106-ad51-6a88de1b0365 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Terminating instance
Nov 08 04:07:54 user nova-compute[75014]: DEBUG nova.compute.manager [None req-1d1a18c4-4e55-4106-ad51-6a88de1b0365 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:07:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:55 user nova-compute[75014]: DEBUG nova.compute.manager [req-fb28323b-f8f8-4ce2-ba90-cc43b4ac828f req-e2fa5460-9dc1-458e-aa25-bf9bec757905 service nova] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Received event network-vif-unplugged-a54f4128-8b08-4c5a-baea-5e8de62a98d9 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:07:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-fb28323b-f8f8-4ce2-ba90-cc43b4ac828f req-e2fa5460-9dc1-458e-aa25-bf9bec757905 service nova] Acquiring lock "75d85e9b-5364-4838-bd6a-c044b6290e7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:07:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-fb28323b-f8f8-4ce2-ba90-cc43b4ac828f req-e2fa5460-9dc1-458e-aa25-bf9bec757905 service nova] Lock "75d85e9b-5364-4838-bd6a-c044b6290e7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:07:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-fb28323b-f8f8-4ce2-ba90-cc43b4ac828f req-e2fa5460-9dc1-458e-aa25-bf9bec757905 service nova] Lock "75d85e9b-5364-4838-bd6a-c044b6290e7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:07:55 user nova-compute[75014]: DEBUG nova.compute.manager [req-fb28323b-f8f8-4ce2-ba90-cc43b4ac828f req-e2fa5460-9dc1-458e-aa25-bf9bec757905 service nova] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] No waiting events found dispatching network-vif-unplugged-a54f4128-8b08-4c5a-baea-5e8de62a98d9 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:07:55 user nova-compute[75014]: DEBUG nova.compute.manager [req-fb28323b-f8f8-4ce2-ba90-cc43b4ac828f req-e2fa5460-9dc1-458e-aa25-bf9bec757905 service nova] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Received event network-vif-unplugged-a54f4128-8b08-4c5a-baea-5e8de62a98d9 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:07:55 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Instance destroyed successfully.
Nov 08 04:07:55 user nova-compute[75014]: DEBUG nova.objects.instance [None req-1d1a18c4-4e55-4106-ad51-6a88de1b0365 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lazy-loading 'resources' on Instance uuid 75d85e9b-5364-4838-bd6a-c044b6290e7f {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:07:55 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-1d1a18c4-4e55-4106-ad51-6a88de1b0365 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1234113545',display_name='tempest-AttachVolumeNegativeTest-server-1234113545',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1234113545',id=31,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOeu2AtvLK6FrNETpJ5N4KQZiSzu+6vZ4iYUzjnLvoLydQHcxdk+CvQJnRuhBw3dTRfgcNSpeNrwPowXSo8olNqcxCgAPsX73D8is+UqwWwetmKy3h5P9GJ4CQHbN19Fg==',key_name='tempest-keypair-454069840',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:04:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1c9753cb588478a8a93182be3256674',ramdisk_id='',reservation_id='r-jjg004tq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1215701914',owner_user_name='tempest-AttachVolumeNegativeTest-1215701914-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:04:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8c674d8b2cf49c08cf254a8095ef8ea',uuid=75d85e9b-5364-4838-bd6a-c044b6290e7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a54f4128-8b08-4c5a-baea-5e8de62a98d9", "address": "fa:16:3e:95:e6:b4", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54f4128-8b", "ovs_interfaceid": "a54f4128-8b08-4c5a-baea-5e8de62a98d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:07:55 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-1d1a18c4-4e55-4106-ad51-6a88de1b0365 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Converting VIF {"id": "a54f4128-8b08-4c5a-baea-5e8de62a98d9", "address": "fa:16:3e:95:e6:b4", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54f4128-8b", "ovs_interfaceid": "a54f4128-8b08-4c5a-baea-5e8de62a98d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:07:55 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-1d1a18c4-4e55-4106-ad51-6a88de1b0365 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:e6:b4,bridge_name='br-int',has_traffic_filtering=True,id=a54f4128-8b08-4c5a-baea-5e8de62a98d9,network=Network(f3d67270-d525-45d9-958c-a901d121d510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54f4128-8b') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:07:55 user nova-compute[75014]: DEBUG os_vif [None req-1d1a18c4-4e55-4106-ad51-6a88de1b0365 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:e6:b4,bridge_name='br-int',has_traffic_filtering=True,id=a54f4128-8b08-4c5a-baea-5e8de62a98d9,network=Network(f3d67270-d525-45d9-958c-a901d121d510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54f4128-8b') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:07:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa54f4128-8b, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:07:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:07:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=14fba53c-fbc1-48b0-9a12-9f4f57f1ed7c) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:07:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:07:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:55 user nova-compute[75014]: INFO os_vif [None req-1d1a18c4-4e55-4106-ad51-6a88de1b0365 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:e6:b4,bridge_name='br-int',has_traffic_filtering=True,id=a54f4128-8b08-4c5a-baea-5e8de62a98d9,network=Network(f3d67270-d525-45d9-958c-a901d121d510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54f4128-8b')
Nov 08 04:07:55 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-1d1a18c4-4e55-4106-ad51-6a88de1b0365 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Deleting instance files /opt/stack/data/nova/instances/75d85e9b-5364-4838-bd6a-c044b6290e7f_del
Nov 08 04:07:55 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-1d1a18c4-4e55-4106-ad51-6a88de1b0365 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Deletion of /opt/stack/data/nova/instances/75d85e9b-5364-4838-bd6a-c044b6290e7f_del complete
Nov 08 04:07:55 user nova-compute[75014]: INFO nova.compute.manager [None req-1d1a18c4-4e55-4106-ad51-6a88de1b0365 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 08 04:07:55 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-1d1a18c4-4e55-4106-ad51-6a88de1b0365 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:07:55 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:07:55 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:07:56 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:07:56 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Took 1.01 seconds to deallocate network for instance.
Nov 08 04:07:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1d1a18c4-4e55-4106-ad51-6a88de1b0365 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:07:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1d1a18c4-4e55-4106-ad51-6a88de1b0365 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:07:57 user nova-compute[75014]: DEBUG nova.compute.manager [req-d1ec581a-d241-476e-9c3f-7cae8559ec50 req-dd2c0f19-4c80-45ea-84c5-196dafe1026b service nova] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Received event network-vif-plugged-a54f4128-8b08-4c5a-baea-5e8de62a98d9 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:07:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d1ec581a-d241-476e-9c3f-7cae8559ec50 req-dd2c0f19-4c80-45ea-84c5-196dafe1026b service nova] Acquiring lock "75d85e9b-5364-4838-bd6a-c044b6290e7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:07:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d1ec581a-d241-476e-9c3f-7cae8559ec50 req-dd2c0f19-4c80-45ea-84c5-196dafe1026b service nova] Lock "75d85e9b-5364-4838-bd6a-c044b6290e7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:07:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d1ec581a-d241-476e-9c3f-7cae8559ec50 req-dd2c0f19-4c80-45ea-84c5-196dafe1026b service nova] Lock "75d85e9b-5364-4838-bd6a-c044b6290e7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:07:57 user nova-compute[75014]: DEBUG nova.compute.manager [req-d1ec581a-d241-476e-9c3f-7cae8559ec50 req-dd2c0f19-4c80-45ea-84c5-196dafe1026b service nova] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] No waiting events found dispatching network-vif-plugged-a54f4128-8b08-4c5a-baea-5e8de62a98d9 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:07:57 user nova-compute[75014]: WARNING nova.compute.manager [req-d1ec581a-d241-476e-9c3f-7cae8559ec50 req-dd2c0f19-4c80-45ea-84c5-196dafe1026b service nova] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Received unexpected event network-vif-plugged-a54f4128-8b08-4c5a-baea-5e8de62a98d9 for instance with vm_state deleted and task_state None.
Nov 08 04:07:57 user nova-compute[75014]: DEBUG nova.compute.manager [req-d1ec581a-d241-476e-9c3f-7cae8559ec50 req-dd2c0f19-4c80-45ea-84c5-196dafe1026b service nova] [instance: 75d85e9b-5364-4838-bd6a-c044b6290e7f] Received event network-vif-deleted-a54f4128-8b08-4c5a-baea-5e8de62a98d9 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:07:57 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-1d1a18c4-4e55-4106-ad51-6a88de1b0365 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:07:57 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-1d1a18c4-4e55-4106-ad51-6a88de1b0365 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:07:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1d1a18c4-4e55-4106-ad51-6a88de1b0365 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.426s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:07:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:07:57 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-1d1a18c4-4e55-4106-ad51-6a88de1b0365 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Deleted allocations for instance 75d85e9b-5364-4838-bd6a-c044b6290e7f
Nov 08 04:07:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1d1a18c4-4e55-4106-ad51-6a88de1b0365 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "75d85e9b-5364-4838-bd6a-c044b6290e7f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.625s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:07:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "449e9147-efe0-4aa1-af52-557e313bf7fe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:07:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "449e9147-efe0-4aa1-af52-557e313bf7fe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:07:59 user nova-compute[75014]: DEBUG nova.objects.instance [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lazy-loading 'flavor' on Instance uuid 449e9147-efe0-4aa1-af52-557e313bf7fe {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:07:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "449e9147-efe0-4aa1-af52-557e313bf7fe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:07:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "449e9147-efe0-4aa1-af52-557e313bf7fe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:07:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "449e9147-efe0-4aa1-af52-557e313bf7fe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:07:59 user nova-compute[75014]: INFO nova.compute.manager [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Attaching volume 9adf5c03-4d4d-44d3-ac4e-835bc141e45c to /dev/vdb
Nov 08 04:07:59 user nova-compute[75014]: DEBUG os_brick.utils [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:07:59 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:59 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:59 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[47eb7c1d-f003-4692-bd96-1774b8f752af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:59 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:59 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:59 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e74d04-8db8-4c02-840c-97a29df7e8e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:59 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:59 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:07:59 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bac1eb4-5277-495c-8993-84264a261281]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:59 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb13f670-e720-4bf0-a19d-3d7dbc102e06]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:07:59 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:07:59 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:07:59 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:08:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:08:00 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:08:00 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c5c143-bde8-4a0e-905c-f2a43c3fe941]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:00 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:08:00 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:08:00 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:08:00 user nova-compute[75014]: DEBUG os_brick.utils [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:08:00 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Updating existing volume attachment record: 4cf5837e-7db2-419a-88e1-8e836825c1c2 {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:08:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f5773a3-0dc7-4457-a151-0444811527ad tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "9f205fe5-576f-4ef0-874b-1544c0307a7e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:08:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f5773a3-0dc7-4457-a151-0444811527ad tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:08:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f5773a3-0dc7-4457-a151-0444811527ad tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:08:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f5773a3-0dc7-4457-a151-0444811527ad tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:08:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f5773a3-0dc7-4457-a151-0444811527ad tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:08:15 user nova-compute[75014]: INFO nova.compute.manager [None req-4f5773a3-0dc7-4457-a151-0444811527ad tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Terminating instance
Nov 08 04:08:15 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f5773a3-0dc7-4457-a151-0444811527ad tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:08:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:16 user nova-compute[75014]: DEBUG nova.compute.manager [req-0bd2eb85-4d0f-4952-be36-18f05d39f9d1 req-11042758-8859-40d3-abca-894305288bd4 service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Received event network-vif-unplugged-4979eddc-54c6-46e4-987a-640c4ccade99 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:08:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0bd2eb85-4d0f-4952-be36-18f05d39f9d1 req-11042758-8859-40d3-abca-894305288bd4 service nova] Acquiring lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:08:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0bd2eb85-4d0f-4952-be36-18f05d39f9d1 req-11042758-8859-40d3-abca-894305288bd4 service nova] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:08:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0bd2eb85-4d0f-4952-be36-18f05d39f9d1 req-11042758-8859-40d3-abca-894305288bd4 service nova] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:08:16 user nova-compute[75014]: DEBUG nova.compute.manager [req-0bd2eb85-4d0f-4952-be36-18f05d39f9d1 req-11042758-8859-40d3-abca-894305288bd4 service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] No waiting events found dispatching network-vif-unplugged-4979eddc-54c6-46e4-987a-640c4ccade99 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:08:16 user nova-compute[75014]: DEBUG nova.compute.manager [req-0bd2eb85-4d0f-4952-be36-18f05d39f9d1 req-11042758-8859-40d3-abca-894305288bd4 service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Received event network-vif-unplugged-4979eddc-54c6-46e4-987a-640c4ccade99 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:08:16 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Instance destroyed successfully.
Nov 08 04:08:16 user nova-compute[75014]: DEBUG nova.objects.instance [None req-4f5773a3-0dc7-4457-a151-0444811527ad tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lazy-loading 'resources' on Instance uuid 9f205fe5-576f-4ef0-874b-1544c0307a7e {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:08:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-4f5773a3-0dc7-4457-a151-0444811527ad tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-577890555',display_name='tempest-ServerRescueNegativeTestJSON-server-577890555',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-577890555',id=1,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:55:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b48713cc3a8e4082b76fc0408088c607',ramdisk_id='',reservation_id='r-wy8e0crs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1450625183',owner_user_name='tempest-ServerRescueNegativeTestJSON-1450625183-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T03:57:09Z,user_data=None,user_id='ffadb91b73464e559344658dd11bf60d',uuid=9f205fe5-576f-4ef0-874b-1544c0307a7e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4979eddc-54c6-46e4-987a-640c4ccade99", "address": "fa:16:3e:4c:b6:69", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4979eddc-54", "ovs_interfaceid": "4979eddc-54c6-46e4-987a-640c4ccade99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:08:16 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-4f5773a3-0dc7-4457-a151-0444811527ad tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Converting VIF {"id": "4979eddc-54c6-46e4-987a-640c4ccade99", "address": "fa:16:3e:4c:b6:69", "network": {"id": "982531ca-8a2f-41de-b62e-5b43b6a45a7f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1005339032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48713cc3a8e4082b76fc0408088c607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4979eddc-54", "ovs_interfaceid": "4979eddc-54c6-46e4-987a-640c4ccade99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:08:16 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-4f5773a3-0dc7-4457-a151-0444811527ad tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:b6:69,bridge_name='br-int',has_traffic_filtering=True,id=4979eddc-54c6-46e4-987a-640c4ccade99,network=Network(982531ca-8a2f-41de-b62e-5b43b6a45a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4979eddc-54') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:08:16 user nova-compute[75014]: DEBUG os_vif [None req-4f5773a3-0dc7-4457-a151-0444811527ad tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:b6:69,bridge_name='br-int',has_traffic_filtering=True,id=4979eddc-54c6-46e4-987a-640c4ccade99,network=Network(982531ca-8a2f-41de-b62e-5b43b6a45a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4979eddc-54') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:08:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4979eddc-54, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:08:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:08:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=352c2593-d3d9-48e3-ae5c-986b97e9b2cb) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:08:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:08:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:16 user nova-compute[75014]: INFO os_vif [None req-4f5773a3-0dc7-4457-a151-0444811527ad tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:b6:69,bridge_name='br-int',has_traffic_filtering=True,id=4979eddc-54c6-46e4-987a-640c4ccade99,network=Network(982531ca-8a2f-41de-b62e-5b43b6a45a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4979eddc-54')
Nov 08 04:08:16 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-4f5773a3-0dc7-4457-a151-0444811527ad tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Deleting instance files /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e_del
Nov 08 04:08:16 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-4f5773a3-0dc7-4457-a151-0444811527ad tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Deletion of /opt/stack/data/nova/instances/9f205fe5-576f-4ef0-874b-1544c0307a7e_del complete
Nov 08 04:08:16 user nova-compute[75014]: INFO nova.compute.manager [None req-4f5773a3-0dc7-4457-a151-0444811527ad tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 08 04:08:16 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-4f5773a3-0dc7-4457-a151-0444811527ad tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:08:16 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:08:16 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:08:17 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:08:17 user nova-compute[75014]: DEBUG nova.compute.manager [req-cd2d75ae-ba6d-4a06-ad0b-5409b5d88e98 req-3ccac060-11b1-47b7-8b75-3d26aa065b62 service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Received event network-vif-deleted-4979eddc-54c6-46e4-987a-640c4ccade99 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:08:17 user nova-compute[75014]: INFO nova.compute.manager [req-cd2d75ae-ba6d-4a06-ad0b-5409b5d88e98 req-3ccac060-11b1-47b7-8b75-3d26aa065b62 service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Neutron deleted interface 4979eddc-54c6-46e4-987a-640c4ccade99; detaching it from the instance and deleting it from the info cache
Nov 08 04:08:17 user nova-compute[75014]: DEBUG nova.network.neutron [req-cd2d75ae-ba6d-4a06-ad0b-5409b5d88e98 req-3ccac060-11b1-47b7-8b75-3d26aa065b62 service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:08:17 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Took 0.63 seconds to deallocate network for instance.
Nov 08 04:08:17 user nova-compute[75014]: DEBUG nova.compute.manager [req-cd2d75ae-ba6d-4a06-ad0b-5409b5d88e98 req-3ccac060-11b1-47b7-8b75-3d26aa065b62 service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Detach interface failed, port_id=4979eddc-54c6-46e4-987a-640c4ccade99, reason: Instance 9f205fe5-576f-4ef0-874b-1544c0307a7e could not be found. {{(pid=75014) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 04:08:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f5773a3-0dc7-4457-a151-0444811527ad tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:08:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f5773a3-0dc7-4457-a151-0444811527ad tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:08:17 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f5773a3-0dc7-4457-a151-0444811527ad tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:08:17 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f5773a3-0dc7-4457-a151-0444811527ad tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:08:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f5773a3-0dc7-4457-a151-0444811527ad tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:08:17 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-4f5773a3-0dc7-4457-a151-0444811527ad tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Deleted allocations for instance 9f205fe5-576f-4ef0-874b-1544c0307a7e
Nov 08 04:08:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f5773a3-0dc7-4457-a151-0444811527ad tempest-ServerRescueNegativeTestJSON-1450625183 tempest-ServerRescueNegativeTestJSON-1450625183-project-member] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.941s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:08:18 user nova-compute[75014]: DEBUG nova.compute.manager [req-3e5eb58f-9c3d-4344-b9c1-45c9b772640d req-06b64116-fdee-4e4c-aaa9-5231788c668a service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Received event network-vif-plugged-4979eddc-54c6-46e4-987a-640c4ccade99 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:08:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3e5eb58f-9c3d-4344-b9c1-45c9b772640d req-06b64116-fdee-4e4c-aaa9-5231788c668a service nova] Acquiring lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:08:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3e5eb58f-9c3d-4344-b9c1-45c9b772640d req-06b64116-fdee-4e4c-aaa9-5231788c668a service nova] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:08:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3e5eb58f-9c3d-4344-b9c1-45c9b772640d req-06b64116-fdee-4e4c-aaa9-5231788c668a service nova] Lock "9f205fe5-576f-4ef0-874b-1544c0307a7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:08:18 user nova-compute[75014]: DEBUG nova.compute.manager [req-3e5eb58f-9c3d-4344-b9c1-45c9b772640d req-06b64116-fdee-4e4c-aaa9-5231788c668a service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] No waiting events found dispatching network-vif-plugged-4979eddc-54c6-46e4-987a-640c4ccade99 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:08:18 user nova-compute[75014]: WARNING nova.compute.manager [req-3e5eb58f-9c3d-4344-b9c1-45c9b772640d req-06b64116-fdee-4e4c-aaa9-5231788c668a service nova] [instance: 9f205fe5-576f-4ef0-874b-1544c0307a7e] Received unexpected event network-vif-plugged-4979eddc-54c6-46e4-987a-640c4ccade99 for instance with vm_state deleted and task_state None.
Nov 08 04:08:21 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YjfxARiX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:08:24 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:08:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:08:24 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:08:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:08:24 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea5880d-66f3-41c5-9a16-62b27ee9b8a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:08:24 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c380f63-69b7-4b22-bafe-a6d72101b58f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c] added
Nov 08 04:08:24 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4d352a-615c-4a1c-a72a-2f4161165f11]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa49483-733e-413a-9808-03ce75173bcf]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YjfxARiX {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YjfxARiX" returned: 0 in 0.045s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[95af58b7-705c-4f0a-8d86-3fe7a1ca27b6]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YjfxARiX'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d502ad76-e63a-4aaa-90b4-22df8bc89e32]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a185625-cdb0-4cd6-a7c1-5f01ebd56d65]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:08:24 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:08:24 user nova-compute[75014]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:08:24 user nova-compute[75014]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:08:24 user nova-compute[75014]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 (non-flash)
Nov 08 04:08:24 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:08:24 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:08:24 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:08:24 user nova-compute[75014]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:08:24 user nova-compute[75014]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:08:24 user nova-compute[75014]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 (non-flash)
Nov 08 04:08:24 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:08:24 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd8faac-337a-4e3a-acfe-4c2dd3f44518]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c, portal: 172.16.0.220,3260]
Nov 08 04:08:24 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c, portal: 172.16.0.220,3260] successful.
Nov 08 04:08:24 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ac6ffb-ab03-4e7d-b753-364571456a5c]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[510dcf37-299b-42e2-b677-765a10bc55f9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:08:24 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:08:24 user nova-compute[75014]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:08:24 user nova-compute[75014]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:08:24 user nova-compute[75014]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 (non-flash)
Nov 08 04:08:24 user nova-compute[75014]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)
Nov 08 04:08:24 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:08:24 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:08:24 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:08:24 user nova-compute[75014]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:08:24 user nova-compute[75014]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:08:24 user nova-compute[75014]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 (non-flash)
Nov 08 04:08:24 user nova-compute[75014]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)
Nov 08 04:08:24 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:08:24 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] HCTL ('37', '-', '-', 0) found on session 32 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aaf5465-b32d-422c-872a-0dc10d988a13]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:08:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YjfxARiX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:08:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:08:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '23032656466333865', 'path': '/dev/sdf'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:08:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032656466333865', 'path': '/dev/sdf'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:08:25 user nova-compute[75014]: DEBUG nova.objects.instance [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lazy-loading 'flavor' on Instance uuid 449e9147-efe0-4aa1-af52-557e313bf7fe {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:08:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 04:08:25 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:08:25 user nova-compute[75014]:   <source dev="/dev/sdf"/>
Nov 08 04:08:25 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:08:25 user nova-compute[75014]:   <serial>9adf5c03-4d4d-44d3-ac4e-835bc141e45c</serial>
Nov 08 04:08:25 user nova-compute[75014]: </disk>
Nov 08 04:08:25 user nova-compute[75014]:  {{(pid=75014) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 04:08:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:08:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:08:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] No VIF found with MAC fa:16:3e:e3:84:5d, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:08:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-56b8c6e6-81e5-4129-872d-ac98beb094ca tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "449e9147-efe0-4aa1-af52-557e313bf7fe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.705s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:08:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:28 user nova-compute[75014]: DEBUG nova.compute.manager [req-16317461-96e3-4cbc-bf67-ec4dc16451a1 req-beccadc5-15c7-424a-92c4-9ba91d95ec28 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Received event network-changed-f85faa29-4fe7-4ef1-b746-a1bcad900d9f {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:08:28 user nova-compute[75014]: DEBUG nova.compute.manager [req-16317461-96e3-4cbc-bf67-ec4dc16451a1 req-beccadc5-15c7-424a-92c4-9ba91d95ec28 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Refreshing instance network info cache due to event network-changed-f85faa29-4fe7-4ef1-b746-a1bcad900d9f. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:08:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-16317461-96e3-4cbc-bf67-ec4dc16451a1 req-beccadc5-15c7-424a-92c4-9ba91d95ec28 service nova] Acquiring lock "refresh_cache-449e9147-efe0-4aa1-af52-557e313bf7fe" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:08:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-16317461-96e3-4cbc-bf67-ec4dc16451a1 req-beccadc5-15c7-424a-92c4-9ba91d95ec28 service nova] Acquired lock "refresh_cache-449e9147-efe0-4aa1-af52-557e313bf7fe" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:08:28 user nova-compute[75014]: DEBUG nova.network.neutron [req-16317461-96e3-4cbc-bf67-ec4dc16451a1 req-beccadc5-15c7-424a-92c4-9ba91d95ec28 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Refreshing network info cache for port f85faa29-4fe7-4ef1-b746-a1bcad900d9f {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:08:29 user nova-compute[75014]: DEBUG nova.network.neutron [req-16317461-96e3-4cbc-bf67-ec4dc16451a1 req-beccadc5-15c7-424a-92c4-9ba91d95ec28 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Updated VIF entry in instance network info cache for port f85faa29-4fe7-4ef1-b746-a1bcad900d9f. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:08:29 user nova-compute[75014]: DEBUG nova.network.neutron [req-16317461-96e3-4cbc-bf67-ec4dc16451a1 req-beccadc5-15c7-424a-92c4-9ba91d95ec28 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Updating instance_info_cache with network_info: [{"id": "f85faa29-4fe7-4ef1-b746-a1bcad900d9f", "address": "fa:16:3e:e3:84:5d", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85faa29-4f", "ovs_interfaceid": "f85faa29-4fe7-4ef1-b746-a1bcad900d9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:08:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-16317461-96e3-4cbc-bf67-ec4dc16451a1 req-beccadc5-15c7-424a-92c4-9ba91d95ec28 service nova] Releasing lock "refresh_cache-449e9147-efe0-4aa1-af52-557e313bf7fe" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:08:31 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:08:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:08:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:08:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:08:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:08:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:08:31 user nova-compute[75014]: DEBUG nova.compute.manager [req-354006d0-df94-4a64-b0ae-9422b74f2e2f req-67133936-56cb-4b3b-a01f-979d82e75f2f service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Received event network-changed-f85faa29-4fe7-4ef1-b746-a1bcad900d9f {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:08:31 user nova-compute[75014]: DEBUG nova.compute.manager [req-354006d0-df94-4a64-b0ae-9422b74f2e2f req-67133936-56cb-4b3b-a01f-979d82e75f2f service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Refreshing instance network info cache due to event network-changed-f85faa29-4fe7-4ef1-b746-a1bcad900d9f. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:08:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-354006d0-df94-4a64-b0ae-9422b74f2e2f req-67133936-56cb-4b3b-a01f-979d82e75f2f service nova] Acquiring lock "refresh_cache-449e9147-efe0-4aa1-af52-557e313bf7fe" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:08:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-354006d0-df94-4a64-b0ae-9422b74f2e2f req-67133936-56cb-4b3b-a01f-979d82e75f2f service nova] Acquired lock "refresh_cache-449e9147-efe0-4aa1-af52-557e313bf7fe" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:08:31 user nova-compute[75014]: DEBUG nova.network.neutron [req-354006d0-df94-4a64-b0ae-9422b74f2e2f req-67133936-56cb-4b3b-a01f-979d82e75f2f service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Refreshing network info cache for port f85faa29-4fe7-4ef1-b746-a1bcad900d9f {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:08:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:32 user nova-compute[75014]: DEBUG nova.network.neutron [req-354006d0-df94-4a64-b0ae-9422b74f2e2f req-67133936-56cb-4b3b-a01f-979d82e75f2f service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Updated VIF entry in instance network info cache for port f85faa29-4fe7-4ef1-b746-a1bcad900d9f. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:08:32 user nova-compute[75014]: DEBUG nova.network.neutron [req-354006d0-df94-4a64-b0ae-9422b74f2e2f req-67133936-56cb-4b3b-a01f-979d82e75f2f service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Updating instance_info_cache with network_info: [{"id": "f85faa29-4fe7-4ef1-b746-a1bcad900d9f", "address": "fa:16:3e:e3:84:5d", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85faa29-4f", "ovs_interfaceid": "f85faa29-4fe7-4ef1-b746-a1bcad900d9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:08:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e83cdc9e-6d49-42b4-90dd-8ed955971383 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "449e9147-efe0-4aa1-af52-557e313bf7fe" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:08:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e83cdc9e-6d49-42b4-90dd-8ed955971383 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "449e9147-efe0-4aa1-af52-557e313bf7fe" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:08:32 user nova-compute[75014]: INFO nova.compute.manager [None req-e83cdc9e-6d49-42b4-90dd-8ed955971383 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Rebooting instance
Nov 08 04:08:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-354006d0-df94-4a64-b0ae-9422b74f2e2f req-67133936-56cb-4b3b-a01f-979d82e75f2f service nova] Releasing lock "refresh_cache-449e9147-efe0-4aa1-af52-557e313bf7fe" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:08:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e83cdc9e-6d49-42b4-90dd-8ed955971383 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "refresh_cache-449e9147-efe0-4aa1-af52-557e313bf7fe" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:08:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e83cdc9e-6d49-42b4-90dd-8ed955971383 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquired lock "refresh_cache-449e9147-efe0-4aa1-af52-557e313bf7fe" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:08:32 user nova-compute[75014]: DEBUG nova.network.neutron [None req-e83cdc9e-6d49-42b4-90dd-8ed955971383 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:08:33 user nova-compute[75014]: DEBUG nova.network.neutron [None req-e83cdc9e-6d49-42b4-90dd-8ed955971383 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Updating instance_info_cache with network_info: [{"id": "f85faa29-4fe7-4ef1-b746-a1bcad900d9f", "address": "fa:16:3e:e3:84:5d", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85faa29-4f", "ovs_interfaceid": "f85faa29-4fe7-4ef1-b746-a1bcad900d9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:08:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e83cdc9e-6d49-42b4-90dd-8ed955971383 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Releasing lock "refresh_cache-449e9147-efe0-4aa1-af52-557e313bf7fe" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:08:33 user nova-compute[75014]: DEBUG nova.compute.manager [None req-e83cdc9e-6d49-42b4-90dd-8ed955971383 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:08:33 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:08:35 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:08:35 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:08:35 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:08:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-c23c9e00-b782-4530-bb01-a7a167951c1d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:08:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-c23c9e00-b782-4530-bb01-a7a167951c1d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:08:35 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 04:08:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:35 user nova-compute[75014]: DEBUG nova.compute.manager [req-608bce4e-692f-48f6-9992-f652dda6ef38 req-076fab88-ba44-400a-b65c-ed91e28ea7b2 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Received event network-vif-unplugged-f85faa29-4fe7-4ef1-b746-a1bcad900d9f {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:08:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-608bce4e-692f-48f6-9992-f652dda6ef38 req-076fab88-ba44-400a-b65c-ed91e28ea7b2 service nova] Acquiring lock "449e9147-efe0-4aa1-af52-557e313bf7fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:08:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-608bce4e-692f-48f6-9992-f652dda6ef38 req-076fab88-ba44-400a-b65c-ed91e28ea7b2 service nova] Lock "449e9147-efe0-4aa1-af52-557e313bf7fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:08:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-608bce4e-692f-48f6-9992-f652dda6ef38 req-076fab88-ba44-400a-b65c-ed91e28ea7b2 service nova] Lock "449e9147-efe0-4aa1-af52-557e313bf7fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:08:35 user nova-compute[75014]: DEBUG nova.compute.manager [req-608bce4e-692f-48f6-9992-f652dda6ef38 req-076fab88-ba44-400a-b65c-ed91e28ea7b2 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] No waiting events found dispatching network-vif-unplugged-f85faa29-4fe7-4ef1-b746-a1bcad900d9f {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:08:35 user nova-compute[75014]: WARNING nova.compute.manager [req-608bce4e-692f-48f6-9992-f652dda6ef38 req-076fab88-ba44-400a-b65c-ed91e28ea7b2 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Received unexpected event network-vif-unplugged-f85faa29-4fe7-4ef1-b746-a1bcad900d9f for instance with vm_state active and task_state reboot_started.
Nov 08 04:08:35 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Updating instance_info_cache with network_info: [{"id": "4f3b192f-a567-463a-b120-1b328e11feaa", "address": "fa:16:3e:70:b6:a1", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3b192f-a5", "ovs_interfaceid": "4f3b192f-a567-463a-b120-1b328e11feaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:08:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-c23c9e00-b782-4530-bb01-a7a167951c1d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:08:35 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 04:08:36 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-e83cdc9e-6d49-42b4-90dd-8ed955971383 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Instance shutdown successfully.
Nov 08 04:08:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:37 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:08:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:37 user nova-compute[75014]: DEBUG nova.compute.manager [req-82860c18-4aa9-4beb-acd6-b69b5fcce465 req-afabd147-4097-44bc-bfe0-230a6f2deba0 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Received event network-vif-plugged-f85faa29-4fe7-4ef1-b746-a1bcad900d9f {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:08:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-82860c18-4aa9-4beb-acd6-b69b5fcce465 req-afabd147-4097-44bc-bfe0-230a6f2deba0 service nova] Acquiring lock "449e9147-efe0-4aa1-af52-557e313bf7fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:08:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-82860c18-4aa9-4beb-acd6-b69b5fcce465 req-afabd147-4097-44bc-bfe0-230a6f2deba0 service nova] Lock "449e9147-efe0-4aa1-af52-557e313bf7fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:08:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-82860c18-4aa9-4beb-acd6-b69b5fcce465 req-afabd147-4097-44bc-bfe0-230a6f2deba0 service nova] Lock "449e9147-efe0-4aa1-af52-557e313bf7fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:08:37 user nova-compute[75014]: DEBUG nova.compute.manager [req-82860c18-4aa9-4beb-acd6-b69b5fcce465 req-afabd147-4097-44bc-bfe0-230a6f2deba0 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] No waiting events found dispatching network-vif-plugged-f85faa29-4fe7-4ef1-b746-a1bcad900d9f {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:08:37 user nova-compute[75014]: WARNING nova.compute.manager [req-82860c18-4aa9-4beb-acd6-b69b5fcce465 req-afabd147-4097-44bc-bfe0-230a6f2deba0 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Received unexpected event network-vif-plugged-f85faa29-4fe7-4ef1-b746-a1bcad900d9f for instance with vm_state active and task_state reboot_started.
Nov 08 04:08:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:38 user nova-compute[75014]: DEBUG nova.objects.instance [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lazy-loading 'flavor' on Instance uuid 781932ce-0bea-466f-95e0-066130d6c410 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:08:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "refresh_cache-781932ce-0bea-466f-95e0-066130d6c410" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:08:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquired lock "refresh_cache-781932ce-0bea-466f-95e0-066130d6c410" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:08:38 user nova-compute[75014]: DEBUG nova.network.neutron [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:08:38 user nova-compute[75014]: DEBUG nova.objects.instance [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lazy-loading 'info_cache' on Instance uuid 781932ce-0bea-466f-95e0-066130d6c410 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:08:38 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:08:38 user nova-compute[75014]: DEBUG nova.objects.base [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Object Instance<781932ce-0bea-466f-95e0-066130d6c410> lazy-loaded attributes: flavor,info_cache {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:08:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:38 user nova-compute[75014]: DEBUG nova.network.neutron [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Updating instance_info_cache with network_info: [{"id": "5b680c90-914d-4583-a698-dccacaff9987", "address": "fa:16:3e:48:9a:fe", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b680c90-91", "ovs_interfaceid": "5b680c90-914d-4583-a698-dccacaff9987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:08:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Releasing lock "refresh_cache-781932ce-0bea-466f-95e0-066130d6c410" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:08:38 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Instance destroyed successfully.
Nov 08 04:08:38 user nova-compute[75014]: DEBUG nova.objects.instance [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lazy-loading 'resources' on Instance uuid 781932ce-0bea-466f-95e0-066130d6c410 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:08:38 user nova-compute[75014]: DEBUG nova.objects.base [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Object Instance<781932ce-0bea-466f-95e0-066130d6c410> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:08:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:04:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1668777333',display_name='tempest-AttachVolumeTestJSON-server-1668777333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1668777333',id=30,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6mnajMRsnB5A1jMf0Mqu/aGiRIJo9flQ+tedJW4Ejb4b/2emSY8dSQLEz7A16dKqzr7/OWo32j5VNwQAstah+AeC8v3Pb8Vhpq9T/r/uwJR3q73i8uI1OSr10mvZVNRA==',key_name='tempest-keypair-919667976',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:04:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b61b5c5a54c743f78e97623c26050864',ramdisk_id='',reservation_id='r-k47t6zf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1095291946',owner_user_name='tempest-AttachVolumeTestJSON-1095291946-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:06:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8794d413cb745f2b855a808c052c8fd',uuid=781932ce-0bea-466f-95e0-066130d6c410,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5b680c90-914d-4583-a698-dccacaff9987", "address": "fa:16:3e:48:9a:fe", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b680c90-91", "ovs_interfaceid": "5b680c90-914d-4583-a698-dccacaff9987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:08:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Converting VIF {"id": "5b680c90-914d-4583-a698-dccacaff9987", "address": "fa:16:3e:48:9a:fe", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b680c90-91", "ovs_interfaceid": "5b680c90-914d-4583-a698-dccacaff9987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:08:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:9a:fe,bridge_name='br-int',has_traffic_filtering=True,id=5b680c90-914d-4583-a698-dccacaff9987,network=Network(b7df3975-2e50-4d96-8a34-26abf02bea76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b680c90-91') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:08:38 user nova-compute[75014]: DEBUG os_vif [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:9a:fe,bridge_name='br-int',has_traffic_filtering=True,id=5b680c90-914d-4583-a698-dccacaff9987,network=Network(b7df3975-2e50-4d96-8a34-26abf02bea76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b680c90-91') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:08:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b680c90-91, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:08:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28dd6e0c-5124-4258-829f-11c48b4833f6) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:08:39 user nova-compute[75014]: INFO os_vif [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:9a:fe,bridge_name='br-int',has_traffic_filtering=True,id=5b680c90-914d-4583-a698-dccacaff9987,network=Network(b7df3975-2e50-4d96-8a34-26abf02bea76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b680c90-91')
Nov 08 04:08:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crbqawYg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:08:39 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1fc69c-c588-46a0-97a7-219b4ee21930]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:08:39 user nova-compute[75014]: No targets found.
Nov 08 04:08:39 user nova-compute[75014]: iSNS:
Nov 08 04:08:39 user nova-compute[75014]: No targets found.
Nov 08 04:08:39 user nova-compute[75014]: STATIC:
Nov 08 04:08:39 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1
Nov 08 04:08:39 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:08:39 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:08:39 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec
Nov 08 04:08:39 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:08:39 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:08:39 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1
Nov 08 04:08:39 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:08:39 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:08:39 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00
Nov 08 04:08:39 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:08:39 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:08:39 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:08:39 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:08:39 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:08:39 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb
Nov 08 04:08:39 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:08:39 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:08:39 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c
Nov 08 04:08:39 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:08:39 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:08:39 user nova-compute[75014]: FIRMWARE:
Nov 08 04:08:39 user nova-compute[75014]: No targets found.
Nov 08 04:08:39 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:08:39 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:08:39 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5b8073-7674-4026-ac60-7640c0d074b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[549f8ba1-6184-4718-8129-69f7c8d3fea9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:08:39 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:08:39 user nova-compute[75014]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:08:39 user nova-compute[75014]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:08:39 user nova-compute[75014]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 (non-flash)
Nov 08 04:08:39 user nova-compute[75014]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)
Nov 08 04:08:39 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:08:39 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:08:39 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:08:39 user nova-compute[75014]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:08:39 user nova-compute[75014]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:08:39 user nova-compute[75014]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 (non-flash)
Nov 08 04:08:39 user nova-compute[75014]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)
Nov 08 04:08:39 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:08:39 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f03dc7332e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1'): ({'sdd'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Removing single pathed devices sdd {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8214828e-afa2-41a9-9855-a161f82cd047]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba50bfa-2118-40d8-9ed5-71220f4ae19d]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Flushing IO for device /dev/sdd {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e1c82e-8c64-4c97-9ecf-6b875d398f91]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc2f2e4-5be9-4fc1-a8c7-3d342389ca84]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] SCSI volumes sdd have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abeea83-0087-4ca1-b502-2b03b92c23fc]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[545f7deb-4f85-4cf5-813e-53efdf247a67]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1, portal: 172.16.0.220,3260]
Nov 08 04:08:39 user nova-compute[75014]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1, portal: 172.16.0.220,3260] successful.
Nov 08 04:08:39 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe579070-e5ce-43fa-84ef-ca98b0cc472f]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.649s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] <== disconnect_volume: return (651ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Start _get_guest_xml network_info=[{"id": "5b680c90-914d-4583-a698-dccacaff9987", "address": "fa:16:3e:48:9a:fe", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b680c90-91", "ovs_interfaceid": "5b680c90-914d-4583-a698-dccacaff9987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crbqawYg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '781932ce-0bea-466f-95e0-066130d6c410', 'attached_at': '', 'detached_at': '', 'volume_id': 'f251c6de-c866-429b-b113-b67a97cf79f1', 'serial': 'f251c6de-c866-429b-b113-b67a97cf79f1'}, 'device_type': 'disk', 'attachment_id': '8179ddfb-5fab-4b3d-8c6f-7131c6a14ba2', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG nova.objects.instance [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lazy-loading 'numa_topology' on Instance uuid 781932ce-0bea-466f-95e0-066130d6c410 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG nova.objects.base [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Object Instance<781932ce-0bea-466f-95e0-066130d6c410> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:08:39 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:08:39 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:08:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG nova.objects.instance [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lazy-loading 'vcpu_model' on Instance uuid 781932ce-0bea-466f-95e0-066130d6c410 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG nova.objects.base [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Object Instance<781932ce-0bea-466f-95e0-066130d6c410> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crbqawYg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:08:39 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:08:39 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:08:39 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[38739607-84f0-4564-964d-f43a144f5c88]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:08:39 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[020e4c17-d620-4e9c-90af-8a66648019e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1] added
Nov 08 04:08:39 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fe0814-14ca-44dd-88c0-942788d7a29a]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG nova.compute.manager [req-969eae12-fd0c-40ea-a2f5-34d9b5592a4b req-31e80f95-1243-43df-8105-3aff4c1b1857 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Received event network-vif-plugged-f85faa29-4fe7-4ef1-b746-a1bcad900d9f {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-969eae12-fd0c-40ea-a2f5-34d9b5592a4b req-31e80f95-1243-43df-8105-3aff4c1b1857 service nova] Acquiring lock "449e9147-efe0-4aa1-af52-557e313bf7fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-969eae12-fd0c-40ea-a2f5-34d9b5592a4b req-31e80f95-1243-43df-8105-3aff4c1b1857 service nova] Lock "449e9147-efe0-4aa1-af52-557e313bf7fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-969eae12-fd0c-40ea-a2f5-34d9b5592a4b req-31e80f95-1243-43df-8105-3aff4c1b1857 service nova] Lock "449e9147-efe0-4aa1-af52-557e313bf7fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG nova.compute.manager [req-969eae12-fd0c-40ea-a2f5-34d9b5592a4b req-31e80f95-1243-43df-8105-3aff4c1b1857 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] No waiting events found dispatching network-vif-plugged-f85faa29-4fe7-4ef1-b746-a1bcad900d9f {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:08:39 user nova-compute[75014]: WARNING nova.compute.manager [req-969eae12-fd0c-40ea-a2f5-34d9b5592a4b req-31e80f95-1243-43df-8105-3aff4c1b1857 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Received unexpected event network-vif-plugged-f85faa29-4fe7-4ef1-b746-a1bcad900d9f for instance with vm_state active and task_state reboot_started.
Nov 08 04:08:39 user nova-compute[75014]: DEBUG nova.compute.manager [req-969eae12-fd0c-40ea-a2f5-34d9b5592a4b req-31e80f95-1243-43df-8105-3aff4c1b1857 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Received event network-vif-plugged-f85faa29-4fe7-4ef1-b746-a1bcad900d9f {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-969eae12-fd0c-40ea-a2f5-34d9b5592a4b req-31e80f95-1243-43df-8105-3aff4c1b1857 service nova] Acquiring lock "449e9147-efe0-4aa1-af52-557e313bf7fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-969eae12-fd0c-40ea-a2f5-34d9b5592a4b req-31e80f95-1243-43df-8105-3aff4c1b1857 service nova] Lock "449e9147-efe0-4aa1-af52-557e313bf7fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-969eae12-fd0c-40ea-a2f5-34d9b5592a4b req-31e80f95-1243-43df-8105-3aff4c1b1857 service nova] Lock "449e9147-efe0-4aa1-af52-557e313bf7fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG nova.compute.manager [req-969eae12-fd0c-40ea-a2f5-34d9b5592a4b req-31e80f95-1243-43df-8105-3aff4c1b1857 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] No waiting events found dispatching network-vif-plugged-f85faa29-4fe7-4ef1-b746-a1bcad900d9f {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:08:39 user nova-compute[75014]: WARNING nova.compute.manager [req-969eae12-fd0c-40ea-a2f5-34d9b5592a4b req-31e80f95-1243-43df-8105-3aff4c1b1857 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Received unexpected event network-vif-plugged-f85faa29-4fe7-4ef1-b746-a1bcad900d9f for instance with vm_state active and task_state reboot_started.
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[74706956-8883-467c-a68d-58ec571da11e]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v crbqawYg {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v crbqawYg" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a29d1fe-dcef-4dbf-86db-f8edceba5805]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'crbqawYg'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1988b4b-7d5d-43c2-bacf-2ebba2ea18d5]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb45ad0-b9ff-4cad-8517-5ee6c180451c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:08:39 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:08:39 user nova-compute[75014]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:08:39 user nova-compute[75014]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 (non-flash)
Nov 08 04:08:39 user nova-compute[75014]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)
Nov 08 04:08:39 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:08:39 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:08:39 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:08:39 user nova-compute[75014]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:08:39 user nova-compute[75014]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 (non-flash)
Nov 08 04:08:39 user nova-compute[75014]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)
Nov 08 04:08:39 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:08:39 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:08:39 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:40 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ee65a1-974f-4dce-a04d-099bd13c0fae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1, portal: 172.16.0.220,3260]
Nov 08 04:08:40 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1, portal: 172.16.0.220,3260] successful.
Nov 08 04:08:40 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:08:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:40 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3bc83f-8917-41ea-b46a-370b03a1e520]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:08:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:40 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b752a47-b507-494b-b917-b391990cd3a6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:08:40 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:08:40 user nova-compute[75014]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:08:40 user nova-compute[75014]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 (non-flash)
Nov 08 04:08:40 user nova-compute[75014]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)
Nov 08 04:08:40 user nova-compute[75014]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:08:40 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:08:40 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:08:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:08:40 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:08:40 user nova-compute[75014]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:08:40 user nova-compute[75014]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 (non-flash)
Nov 08 04:08:40 user nova-compute[75014]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)
Nov 08 04:08:40 user nova-compute[75014]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:08:40 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:08:40 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:08:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:08:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:08:40 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:08:40 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:08:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:40 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1921b5a-8ef4-424f-8f54-57b211b24729]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:40 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:08:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crbqawYg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:08:40 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Instance running successfully.
Nov 08 04:08:40 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-e83cdc9e-6d49-42b4-90dd-8ed955971383 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Instance soft rebooted successfully.
Nov 08 04:08:40 user nova-compute[75014]: DEBUG nova.compute.manager [None req-e83cdc9e-6d49-42b4-90dd-8ed955971383 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:08:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e83cdc9e-6d49-42b4-90dd-8ed955971383 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "449e9147-efe0-4aa1-af52-557e313bf7fe" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.796s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:08:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:08:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '26237386166643965', 'path': '/dev/sdd'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:08:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237386166643965', 'path': '/dev/sdd'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:08:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:04:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1668777333',display_name='tempest-AttachVolumeTestJSON-server-1668777333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1668777333',id=30,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6mnajMRsnB5A1jMf0Mqu/aGiRIJo9flQ+tedJW4Ejb4b/2emSY8dSQLEz7A16dKqzr7/OWo32j5VNwQAstah+AeC8v3Pb8Vhpq9T/r/uwJR3q73i8uI1OSr10mvZVNRA==',key_name='tempest-keypair-919667976',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:04:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b61b5c5a54c743f78e97623c26050864',ramdisk_id='',reservation_id='r-k47t6zf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1095291946',owner_user_name='tempest-AttachVolumeTestJSON-1095291946-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:06:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8794d413cb745f2b855a808c052c8fd',uuid=781932ce-0bea-466f-95e0-066130d6c410,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5b680c90-914d-4583-a698-dccacaff9987", "address": "fa:16:3e:48:9a:fe", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b680c90-91", "ovs_interfaceid": "5b680c90-914d-4583-a698-dccacaff9987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:08:41 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Converting VIF {"id": "5b680c90-914d-4583-a698-dccacaff9987", "address": "fa:16:3e:48:9a:fe", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b680c90-91", "ovs_interfaceid": "5b680c90-914d-4583-a698-dccacaff9987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:08:41 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:9a:fe,bridge_name='br-int',has_traffic_filtering=True,id=5b680c90-914d-4583-a698-dccacaff9987,network=Network(b7df3975-2e50-4d96-8a34-26abf02bea76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b680c90-91') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:08:41 user nova-compute[75014]: DEBUG nova.objects.instance [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lazy-loading 'pci_devices' on Instance uuid 781932ce-0bea-466f-95e0-066130d6c410 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:08:41 user nova-compute[75014]: DEBUG nova.objects.base [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Object Instance<781932ce-0bea-466f-95e0-066130d6c410> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:08:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:08:41 user nova-compute[75014]:   <uuid>781932ce-0bea-466f-95e0-066130d6c410</uuid>
Nov 08 04:08:41 user nova-compute[75014]:   <name>instance-0000001e</name>
Nov 08 04:08:41 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:08:41 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:08:41 user nova-compute[75014]:   <metadata>
Nov 08 04:08:41 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:08:41 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:08:41 user nova-compute[75014]:       <nova:name>tempest-AttachVolumeTestJSON-server-1668777333</nova:name>
Nov 08 04:08:41 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:08:39</nova:creationTime>
Nov 08 04:08:41 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:08:41 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:08:41 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:08:41 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:08:41 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:08:41 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:08:41 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:08:41 user nova-compute[75014]:       <nova:owner>
Nov 08 04:08:41 user nova-compute[75014]:         <nova:user uuid="f8794d413cb745f2b855a808c052c8fd">tempest-AttachVolumeTestJSON-1095291946-project-member</nova:user>
Nov 08 04:08:41 user nova-compute[75014]:         <nova:project uuid="b61b5c5a54c743f78e97623c26050864">tempest-AttachVolumeTestJSON-1095291946</nova:project>
Nov 08 04:08:41 user nova-compute[75014]:       </nova:owner>
Nov 08 04:08:41 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:08:41 user nova-compute[75014]:       <nova:ports>
Nov 08 04:08:41 user nova-compute[75014]:         <nova:port uuid="5b680c90-914d-4583-a698-dccacaff9987">
Nov 08 04:08:41 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 04:08:41 user nova-compute[75014]:         </nova:port>
Nov 08 04:08:41 user nova-compute[75014]:       </nova:ports>
Nov 08 04:08:41 user nova-compute[75014]:     </nova:instance>
Nov 08 04:08:41 user nova-compute[75014]:   </metadata>
Nov 08 04:08:41 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:08:41 user nova-compute[75014]:     <system>
Nov 08 04:08:41 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:08:41 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:08:41 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:08:41 user nova-compute[75014]:       <entry name="serial">781932ce-0bea-466f-95e0-066130d6c410</entry>
Nov 08 04:08:41 user nova-compute[75014]:       <entry name="uuid">781932ce-0bea-466f-95e0-066130d6c410</entry>
Nov 08 04:08:41 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:08:41 user nova-compute[75014]:     </system>
Nov 08 04:08:41 user nova-compute[75014]:   </sysinfo>
Nov 08 04:08:41 user nova-compute[75014]:   <os>
Nov 08 04:08:41 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:08:41 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:08:41 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:08:41 user nova-compute[75014]:   </os>
Nov 08 04:08:41 user nova-compute[75014]:   <features>
Nov 08 04:08:41 user nova-compute[75014]:     <acpi/>
Nov 08 04:08:41 user nova-compute[75014]:     <apic/>
Nov 08 04:08:41 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:08:41 user nova-compute[75014]:   </features>
Nov 08 04:08:41 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:08:41 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:08:41 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:08:41 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:08:41 user nova-compute[75014]:   </clock>
Nov 08 04:08:41 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:08:41 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:08:41 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:08:41 user nova-compute[75014]:   </cpu>
Nov 08 04:08:41 user nova-compute[75014]:   <devices>
Nov 08 04:08:41 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 04:08:41 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 04:08:41 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk"/>
Nov 08 04:08:41 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:08:41 user nova-compute[75014]:     </disk>
Nov 08 04:08:41 user nova-compute[75014]:     <disk type="block" device="disk">
Nov 08 04:08:41 user nova-compute[75014]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:08:41 user nova-compute[75014]:       <source dev="/dev/sdd"/>
Nov 08 04:08:41 user nova-compute[75014]:       <target dev="vdb" bus="virtio"/>
Nov 08 04:08:41 user nova-compute[75014]:       <serial>f251c6de-c866-429b-b113-b67a97cf79f1</serial>
Nov 08 04:08:41 user nova-compute[75014]:     </disk>
Nov 08 04:08:41 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:08:41 user nova-compute[75014]:       <mac address="fa:16:3e:48:9a:fe"/>
Nov 08 04:08:41 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:08:41 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:08:41 user nova-compute[75014]:       <target dev="tap5b680c90-91"/>
Nov 08 04:08:41 user nova-compute[75014]:     </interface>
Nov 08 04:08:41 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:08:41 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/console.log" append="off"/>
Nov 08 04:08:41 user nova-compute[75014]:     </serial>
Nov 08 04:08:41 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:08:41 user nova-compute[75014]:     <video>
Nov 08 04:08:41 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:08:41 user nova-compute[75014]:     </video>
Nov 08 04:08:41 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:08:41 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:08:41 user nova-compute[75014]:     </rng>
Nov 08 04:08:41 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:08:41 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:08:41 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:08:41 user nova-compute[75014]:     </memballoon>
Nov 08 04:08:41 user nova-compute[75014]:   </devices>
Nov 08 04:08:41 user nova-compute[75014]: </domain>
Nov 08 04:08:41 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:08:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:08:41 user nova-compute[75014]: DEBUG nova.objects.instance [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lazy-loading 'trusted_certs' on Instance uuid 781932ce-0bea-466f-95e0-066130d6c410 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:08:41 user nova-compute[75014]: DEBUG nova.objects.base [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Object Instance<781932ce-0bea-466f-95e0-066130d6c410> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:08:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.197s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:41 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Checking if we can resize image /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 04:08:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:42 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Cannot resize image /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 04:08:42 user nova-compute[75014]: DEBUG nova.objects.instance [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lazy-loading 'migration_context' on Instance uuid 781932ce-0bea-466f-95e0-066130d6c410 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:08:42 user nova-compute[75014]: DEBUG nova.objects.base [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Object Instance<781932ce-0bea-466f-95e0-066130d6c410> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:08:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:04:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1668777333',display_name='tempest-AttachVolumeTestJSON-server-1668777333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1668777333',id=30,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6mnajMRsnB5A1jMf0Mqu/aGiRIJo9flQ+tedJW4Ejb4b/2emSY8dSQLEz7A16dKqzr7/OWo32j5VNwQAstah+AeC8v3Pb8Vhpq9T/r/uwJR3q73i8uI1OSr10mvZVNRA==',key_name='tempest-keypair-919667976',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:04:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='b61b5c5a54c743f78e97623c26050864',ramdisk_id='',reservation_id='r-k47t6zf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1095291946',owner_user_name='tempest-AttachVolumeTestJSON-1095291946-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:06:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8794d413cb745f2b855a808c052c8fd',uuid=781932ce-0bea-466f-95e0-066130d6c410,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5b680c90-914d-4583-a698-dccacaff9987", "address": "fa:16:3e:48:9a:fe", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b680c90-91", "ovs_interfaceid": "5b680c90-914d-4583-a698-dccacaff9987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:08:42 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Converting VIF {"id": "5b680c90-914d-4583-a698-dccacaff9987", "address": "fa:16:3e:48:9a:fe", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b680c90-91", "ovs_interfaceid": "5b680c90-914d-4583-a698-dccacaff9987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:08:42 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:9a:fe,bridge_name='br-int',has_traffic_filtering=True,id=5b680c90-914d-4583-a698-dccacaff9987,network=Network(b7df3975-2e50-4d96-8a34-26abf02bea76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b680c90-91') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:08:42 user nova-compute[75014]: DEBUG os_vif [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:9a:fe,bridge_name='br-int',has_traffic_filtering=True,id=5b680c90-914d-4583-a698-dccacaff9987,network=Network(b7df3975-2e50-4d96-8a34-26abf02bea76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b680c90-91') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:08:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:08:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:08:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7dc1abc2-ddd1-5964-9fb6-60149b0dc5e0', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:08:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:08:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b680c90-91, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:08:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b680c90-91, col_values=(('qos', UUID('35e6ae57-0ae0-43f6-bf2d-2754c4992c87')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:08:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b680c90-91, col_values=(('external_ids', {'iface-id': '5b680c90-914d-4583-a698-dccacaff9987', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:9a:fe', 'vm-uuid': '781932ce-0bea-466f-95e0-066130d6c410'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:08:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:08:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:42 user nova-compute[75014]: INFO os_vif [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:9a:fe,bridge_name='br-int',has_traffic_filtering=True,id=5b680c90-914d-4583-a698-dccacaff9987,network=Network(b7df3975-2e50-4d96-8a34-26abf02bea76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b680c90-91')
Nov 08 04:08:42 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:08:42 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:08:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:43 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:08:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:08:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:08:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:08:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:08:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:44 user nova-compute[75014]: DEBUG nova.compute.manager [req-9fdb5cfb-216f-4e14-a510-8def17a3d8f7 req-43079753-858b-4502-9883-1179dbeb1cfb service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Received event network-vif-plugged-5b680c90-914d-4583-a698-dccacaff9987 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:08:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-9fdb5cfb-216f-4e14-a510-8def17a3d8f7 req-43079753-858b-4502-9883-1179dbeb1cfb service nova] Acquiring lock "781932ce-0bea-466f-95e0-066130d6c410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:08:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-9fdb5cfb-216f-4e14-a510-8def17a3d8f7 req-43079753-858b-4502-9883-1179dbeb1cfb service nova] Lock "781932ce-0bea-466f-95e0-066130d6c410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:08:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-9fdb5cfb-216f-4e14-a510-8def17a3d8f7 req-43079753-858b-4502-9883-1179dbeb1cfb service nova] Lock "781932ce-0bea-466f-95e0-066130d6c410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:08:44 user nova-compute[75014]: DEBUG nova.compute.manager [req-9fdb5cfb-216f-4e14-a510-8def17a3d8f7 req-43079753-858b-4502-9883-1179dbeb1cfb service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] No waiting events found dispatching network-vif-plugged-5b680c90-914d-4583-a698-dccacaff9987 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:08:44 user nova-compute[75014]: WARNING nova.compute.manager [req-9fdb5cfb-216f-4e14-a510-8def17a3d8f7 req-43079753-858b-4502-9883-1179dbeb1cfb service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Received unexpected event network-vif-plugged-5b680c90-914d-4583-a698-dccacaff9987 for instance with vm_state stopped and task_state powering-on.
Nov 08 04:08:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-21400b33-1265-452b-80be-edeb9c189f61 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:08:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-21400b33-1265-452b-80be-edeb9c189f61 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:08:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-21400b33-1265-452b-80be-edeb9c189f61 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:08:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-21400b33-1265-452b-80be-edeb9c189f61 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:08:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-21400b33-1265-452b-80be-edeb9c189f61 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:08:44 user nova-compute[75014]: INFO nova.compute.manager [None req-21400b33-1265-452b-80be-edeb9c189f61 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Terminating instance
Nov 08 04:08:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:44 user nova-compute[75014]: DEBUG nova.compute.manager [None req-21400b33-1265-452b-80be-edeb9c189f61 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:08:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:45 user nova-compute[75014]: DEBUG nova.compute.manager [req-4f5d654b-44d9-458f-94c5-629a70b3405b req-f9a265e8-4a1a-480c-b207-bf3578d979ed service nova] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Received event network-vif-unplugged-ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:08:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4f5d654b-44d9-458f-94c5-629a70b3405b req-f9a265e8-4a1a-480c-b207-bf3578d979ed service nova] Acquiring lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:08:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4f5d654b-44d9-458f-94c5-629a70b3405b req-f9a265e8-4a1a-480c-b207-bf3578d979ed service nova] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:08:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4f5d654b-44d9-458f-94c5-629a70b3405b req-f9a265e8-4a1a-480c-b207-bf3578d979ed service nova] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:08:45 user nova-compute[75014]: DEBUG nova.compute.manager [req-4f5d654b-44d9-458f-94c5-629a70b3405b req-f9a265e8-4a1a-480c-b207-bf3578d979ed service nova] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] No waiting events found dispatching network-vif-unplugged-ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:08:45 user nova-compute[75014]: DEBUG nova.compute.manager [req-4f5d654b-44d9-458f-94c5-629a70b3405b req-f9a265e8-4a1a-480c-b207-bf3578d979ed service nova] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Received event network-vif-unplugged-ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:08:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:45 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Instance destroyed successfully.
Nov 08 04:08:45 user nova-compute[75014]: DEBUG nova.objects.instance [None req-21400b33-1265-452b-80be-edeb9c189f61 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lazy-loading 'resources' on Instance uuid 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:08:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-21400b33-1265-452b-80be-edeb9c189f61 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1385109673',display_name='tempest-SnapshotDataIntegrityTests-server-1385109673',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1385109673',id=20,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMsu7UBgeDdEoV7syNqUcHSBFWYDVcdfV5D2jMW+65uaSOH1fGFsoh4b+Gn/VD1CMU/t+nl7+gDGNDCwRyNFAcVU2BjfdlyKV8bwyXd6U9K6sfDyJgT1BDSWYZnV9UFTKQ==',key_name='tempest-keypair-1691743874',keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:58:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='deb879b910c742f6a0fbf17bf0909da3',ramdisk_id='',reservation_id='r-yqe82qjk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-93737511',owner_user_name='tempest-SnapshotDataIntegrityTests-93737511-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T03:58:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0c5176957284dca9ea64107eff32727',uuid=9b21e940-bc4e-41cd-b999-3bdc04c2aa4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba", "address": "fa:16:3e:8f:4a:4b", "network": {"id": "6e103f9f-8ed5-4e53-ac4a-85f3151d3e9e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-641600740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deb879b910c742f6a0fbf17bf0909da3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf8cfd7-cb", "ovs_interfaceid": "ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:08:45 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-21400b33-1265-452b-80be-edeb9c189f61 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Converting VIF {"id": "ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba", "address": "fa:16:3e:8f:4a:4b", "network": {"id": "6e103f9f-8ed5-4e53-ac4a-85f3151d3e9e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-641600740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deb879b910c742f6a0fbf17bf0909da3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf8cfd7-cb", "ovs_interfaceid": "ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:08:45 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-21400b33-1265-452b-80be-edeb9c189f61 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:4a:4b,bridge_name='br-int',has_traffic_filtering=True,id=ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba,network=Network(6e103f9f-8ed5-4e53-ac4a-85f3151d3e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf8cfd7-cb') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:08:45 user nova-compute[75014]: DEBUG os_vif [None req-21400b33-1265-452b-80be-edeb9c189f61 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:4a:4b,bridge_name='br-int',has_traffic_filtering=True,id=ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba,network=Network(6e103f9f-8ed5-4e53-ac4a-85f3151d3e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf8cfd7-cb') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:08:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapddf8cfd7-cb, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:08:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:08:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7bb1274-d065-4e86-a073-27d79fe18093) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:08:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:45 user nova-compute[75014]: INFO os_vif [None req-21400b33-1265-452b-80be-edeb9c189f61 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:4a:4b,bridge_name='br-int',has_traffic_filtering=True,id=ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba,network=Network(6e103f9f-8ed5-4e53-ac4a-85f3151d3e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf8cfd7-cb')
Nov 08 04:08:45 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-21400b33-1265-452b-80be-edeb9c189f61 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Deleting instance files /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d_del
Nov 08 04:08:45 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-21400b33-1265-452b-80be-edeb9c189f61 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Deletion of /opt/stack/data/nova/instances/9b21e940-bc4e-41cd-b999-3bdc04c2aa4d_del complete
Nov 08 04:08:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:08:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:45 user nova-compute[75014]: INFO nova.compute.manager [None req-21400b33-1265-452b-80be-edeb9c189f61 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 08 04:08:45 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-21400b33-1265-452b-80be-edeb9c189f61 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:08:45 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:08:45 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:08:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:08:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:08:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:46 user nova-compute[75014]: DEBUG nova.compute.manager [req-f3055bab-b89d-46fd-9df0-2aa537a991b0 req-78f3e369-0a05-4e50-8b41-260aa0f2494b service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Received event network-vif-plugged-5b680c90-914d-4583-a698-dccacaff9987 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:08:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f3055bab-b89d-46fd-9df0-2aa537a991b0 req-78f3e369-0a05-4e50-8b41-260aa0f2494b service nova] Acquiring lock "781932ce-0bea-466f-95e0-066130d6c410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:08:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f3055bab-b89d-46fd-9df0-2aa537a991b0 req-78f3e369-0a05-4e50-8b41-260aa0f2494b service nova] Lock "781932ce-0bea-466f-95e0-066130d6c410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:08:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f3055bab-b89d-46fd-9df0-2aa537a991b0 req-78f3e369-0a05-4e50-8b41-260aa0f2494b service nova] Lock "781932ce-0bea-466f-95e0-066130d6c410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:08:46 user nova-compute[75014]: DEBUG nova.compute.manager [req-f3055bab-b89d-46fd-9df0-2aa537a991b0 req-78f3e369-0a05-4e50-8b41-260aa0f2494b service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] No waiting events found dispatching network-vif-plugged-5b680c90-914d-4583-a698-dccacaff9987 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:08:46 user nova-compute[75014]: WARNING nova.compute.manager [req-f3055bab-b89d-46fd-9df0-2aa537a991b0 req-78f3e369-0a05-4e50-8b41-260aa0f2494b service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Received unexpected event network-vif-plugged-5b680c90-914d-4583-a698-dccacaff9987 for instance with vm_state stopped and task_state powering-on.
Nov 08 04:08:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:08:46 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Error from libvirt while getting description of instance-00000014: [Error Code 42] Domain not found: no domain with matching uuid '9b21e940-bc4e-41cd-b999-3bdc04c2aa4d' (instance-00000014): libvirt.libvirtError: Domain not found: no domain with matching uuid '9b21e940-bc4e-41cd-b999-3bdc04c2aa4d' (instance-00000014)
Nov 08 04:08:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:08:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:46 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:08:46 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Took 0.95 seconds to deallocate network for instance.
Nov 08 04:08:46 user nova-compute[75014]: DEBUG nova.compute.manager [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:08:46 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Instance rebooted successfully.
Nov 08 04:08:46 user nova-compute[75014]: DEBUG nova.compute.manager [None req-0774c27b-aec1-497e-bc9a-9fc08674dc97 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:08:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-21400b33-1265-452b-80be-edeb9c189f61 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:08:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-21400b33-1265-452b-80be-edeb9c189f61 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:08:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:08:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:47 user nova-compute[75014]: DEBUG nova.compute.manager [req-4984bac8-f3d5-4374-b4a7-989068cc423f req-fffeaa85-37d0-4536-8921-c5ee34018a32 service nova] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Received event network-vif-plugged-ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:08:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4984bac8-f3d5-4374-b4a7-989068cc423f req-fffeaa85-37d0-4536-8921-c5ee34018a32 service nova] Acquiring lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:08:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4984bac8-f3d5-4374-b4a7-989068cc423f req-fffeaa85-37d0-4536-8921-c5ee34018a32 service nova] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:08:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4984bac8-f3d5-4374-b4a7-989068cc423f req-fffeaa85-37d0-4536-8921-c5ee34018a32 service nova] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:08:47 user nova-compute[75014]: DEBUG nova.compute.manager [req-4984bac8-f3d5-4374-b4a7-989068cc423f req-fffeaa85-37d0-4536-8921-c5ee34018a32 service nova] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] No waiting events found dispatching network-vif-plugged-ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:08:47 user nova-compute[75014]: WARNING nova.compute.manager [req-4984bac8-f3d5-4374-b4a7-989068cc423f req-fffeaa85-37d0-4536-8921-c5ee34018a32 service nova] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Received unexpected event network-vif-plugged-ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba for instance with vm_state deleted and task_state None.
Nov 08 04:08:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:47 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-21400b33-1265-452b-80be-edeb9c189f61 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:08:47 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-21400b33-1265-452b-80be-edeb9c189f61 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:08:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-21400b33-1265-452b-80be-edeb9c189f61 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.756s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:08:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:47 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-21400b33-1265-452b-80be-edeb9c189f61 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Deleted allocations for instance 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d
Nov 08 04:08:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-21400b33-1265-452b-80be-edeb9c189f61 tempest-SnapshotDataIntegrityTests-93737511 tempest-SnapshotDataIntegrityTests-93737511-project-member] Lock "9b21e940-bc4e-41cd-b999-3bdc04c2aa4d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.159s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:08:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:48 user nova-compute[75014]: DEBUG nova.compute.manager [req-659f16c1-fbe4-454a-b77e-4f9783c1bd93 req-0d690a0f-7412-41b5-89d2-819939eacdbd service nova] [instance: 9b21e940-bc4e-41cd-b999-3bdc04c2aa4d] Received event network-vif-deleted-ddf8cfd7-cbb2-42c2-b0e9-324a93b95bba {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:08:48 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:08:48 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:08:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=7851MB free_disk=24.714214324951172GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:08:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:08:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:08:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 5bfa6580-e0fe-46b0-b497-8db67806113a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:08:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 655fe5eb-1271-4b9f-a5a6-6342bd012a69 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:08:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance d555b6b3-86ec-40ae-aa20-48846b5157d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:08:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance c23c9e00-b782-4530-bb01-a7a167951c1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:08:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 0b3b62d9-2543-402b-bdb5-cac994b755c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:08:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 36a4109b-f239-48ce-ad49-e640a12a73bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:08:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 781932ce-0bea-466f-95e0-066130d6c410 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:08:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 1cb11358-b4c4-47f4-ba30-d967d523f98a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:08:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 449e9147-efe0-4aa1-af52-557e313bf7fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:08:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:08:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:08:49 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:08:49 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:08:49 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:08:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.603s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:08:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "b25630ab-a3b3-4ec7-bd38-3344d90672c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:08:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "b25630ab-a3b3-4ec7-bd38-3344d90672c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:08:50 user nova-compute[75014]: DEBUG nova.compute.manager [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 04:08:50 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:08:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:08:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:08:50 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 04:08:50 user nova-compute[75014]: INFO nova.compute.claims [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Claim successful on node user
Nov 08 04:08:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:50 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:08:50 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:08:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:08:51 user nova-compute[75014]: DEBUG nova.compute.manager [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 04:08:51 user nova-compute[75014]: DEBUG nova.compute.manager [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 04:08:51 user nova-compute[75014]: DEBUG nova.network.neutron [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 04:08:51 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 04:08:51 user nova-compute[75014]: DEBUG nova.compute.manager [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 04:08:51 user nova-compute[75014]: DEBUG nova.policy [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c8c674d8b2cf49c08cf254a8095ef8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c9753cb588478a8a93182be3256674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 04:08:51 user nova-compute[75014]: DEBUG nova.compute.manager [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 04:08:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 04:08:51 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Creating image(s)
Nov 08 04:08:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "/opt/stack/data/nova/instances/b25630ab-a3b3-4ec7-bd38-3344d90672c9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:08:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "/opt/stack/data/nova/instances/b25630ab-a3b3-4ec7-bd38-3344d90672c9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:08:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "/opt/stack/data/nova/instances/b25630ab-a3b3-4ec7-bd38-3344d90672c9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:08:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.300s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:08:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:08:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.240s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/b25630ab-a3b3-4ec7-bd38-3344d90672c9/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/b25630ab-a3b3-4ec7-bd38-3344d90672c9/disk 1073741824" returned: 0 in 0.057s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:08:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.262s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:52 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b25630ab-a3b3-4ec7-bd38-3344d90672c9/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 04:08:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25630ab-a3b3-4ec7-bd38-3344d90672c9/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25630ab-a3b3-4ec7-bd38-3344d90672c9/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:52 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Cannot resize image /opt/stack/data/nova/instances/b25630ab-a3b3-4ec7-bd38-3344d90672c9/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 04:08:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 04:08:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Ensure instance console log exists: /opt/stack/data/nova/instances/b25630ab-a3b3-4ec7-bd38-3344d90672c9/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:08:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:08:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:08:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:08:53 user nova-compute[75014]: DEBUG nova.network.neutron [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Successfully created port: 4320bd7b-bdf6-400d-9e6e-2d29c34ccf84 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 04:08:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.network.neutron [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Successfully updated port: 4320bd7b-bdf6-400d-9e6e-2d29c34ccf84 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "refresh_cache-b25630ab-a3b3-4ec7-bd38-3344d90672c9" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquired lock "refresh_cache-b25630ab-a3b3-4ec7-bd38-3344d90672c9" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.network.neutron [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.compute.manager [req-dbb8059b-2ffe-4aec-93a0-1e79a3fa90df req-447eac58-543e-4e88-874b-632affa90337 service nova] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Received event network-changed-4320bd7b-bdf6-400d-9e6e-2d29c34ccf84 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.compute.manager [req-dbb8059b-2ffe-4aec-93a0-1e79a3fa90df req-447eac58-543e-4e88-874b-632affa90337 service nova] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Refreshing instance network info cache due to event network-changed-4320bd7b-bdf6-400d-9e6e-2d29c34ccf84. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dbb8059b-2ffe-4aec-93a0-1e79a3fa90df req-447eac58-543e-4e88-874b-632affa90337 service nova] Acquiring lock "refresh_cache-b25630ab-a3b3-4ec7-bd38-3344d90672c9" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.network.neutron [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.network.neutron [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Updating instance_info_cache with network_info: [{"id": "4320bd7b-bdf6-400d-9e6e-2d29c34ccf84", "address": "fa:16:3e:94:e1:8b", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4320bd7b-bd", "ovs_interfaceid": "4320bd7b-bdf6-400d-9e6e-2d29c34ccf84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Releasing lock "refresh_cache-b25630ab-a3b3-4ec7-bd38-3344d90672c9" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.compute.manager [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Instance network_info: |[{"id": "4320bd7b-bdf6-400d-9e6e-2d29c34ccf84", "address": "fa:16:3e:94:e1:8b", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4320bd7b-bd", "ovs_interfaceid": "4320bd7b-bdf6-400d-9e6e-2d29c34ccf84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dbb8059b-2ffe-4aec-93a0-1e79a3fa90df req-447eac58-543e-4e88-874b-632affa90337 service nova] Acquired lock "refresh_cache-b25630ab-a3b3-4ec7-bd38-3344d90672c9" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.network.neutron [req-dbb8059b-2ffe-4aec-93a0-1e79a3fa90df req-447eac58-543e-4e88-874b-632affa90337 service nova] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Refreshing network info cache for port 4320bd7b-bdf6-400d-9e6e-2d29c34ccf84 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Start _get_guest_xml network_info=[{"id": "4320bd7b-bdf6-400d-9e6e-2d29c34ccf84", "address": "fa:16:3e:94:e1:8b", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4320bd7b-bd", "ovs_interfaceid": "4320bd7b-bdf6-400d-9e6e-2d29c34ccf84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:08:54 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:08:54 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-841779446',display_name='tempest-AttachVolumeNegativeTest-server-841779446',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-841779446',id=34,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYiRuI6Qlrw5LB0w6rGjxj+RuPR9hBpFUKhepgvXYNgL4ISheWawEWS0cIN+5drheKvD0hhBsmbiQzrgZeL7Sgu1v34CnmjYiZJWha7ZmnUqEfdP4APbCpA7ikogdjzZA==',key_name='tempest-keypair-402936703',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1c9753cb588478a8a93182be3256674',ramdisk_id='',reservation_id='r-qd6pjmx2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1215701914',owner_user_name='tempest-AttachVolumeNegativeTest-1215701914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:08:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8c674d8b2cf49c08cf254a8095ef8ea',uuid=b25630ab-a3b3-4ec7-bd38-3344d90672c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4320bd7b-bdf6-400d-9e6e-2d29c34ccf84", "address": "fa:16:3e:94:e1:8b", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4320bd7b-bd", "ovs_interfaceid": "4320bd7b-bdf6-400d-9e6e-2d29c34ccf84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Converting VIF {"id": "4320bd7b-bdf6-400d-9e6e-2d29c34ccf84", "address": "fa:16:3e:94:e1:8b", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4320bd7b-bd", "ovs_interfaceid": "4320bd7b-bdf6-400d-9e6e-2d29c34ccf84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:e1:8b,bridge_name='br-int',has_traffic_filtering=True,id=4320bd7b-bdf6-400d-9e6e-2d29c34ccf84,network=Network(f3d67270-d525-45d9-958c-a901d121d510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4320bd7b-bd') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.objects.instance [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lazy-loading 'pci_devices' on Instance uuid b25630ab-a3b3-4ec7-bd38-3344d90672c9 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:08:54 user nova-compute[75014]:   <uuid>b25630ab-a3b3-4ec7-bd38-3344d90672c9</uuid>
Nov 08 04:08:54 user nova-compute[75014]:   <name>instance-00000022</name>
Nov 08 04:08:54 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:08:54 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:08:54 user nova-compute[75014]:   <metadata>
Nov 08 04:08:54 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:08:54 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:08:54 user nova-compute[75014]:       <nova:name>tempest-AttachVolumeNegativeTest-server-841779446</nova:name>
Nov 08 04:08:54 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:08:54</nova:creationTime>
Nov 08 04:08:54 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:08:54 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:08:54 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:08:54 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:08:54 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:08:54 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:08:54 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:08:54 user nova-compute[75014]:       <nova:owner>
Nov 08 04:08:54 user nova-compute[75014]:         <nova:user uuid="c8c674d8b2cf49c08cf254a8095ef8ea">tempest-AttachVolumeNegativeTest-1215701914-project-member</nova:user>
Nov 08 04:08:54 user nova-compute[75014]:         <nova:project uuid="f1c9753cb588478a8a93182be3256674">tempest-AttachVolumeNegativeTest-1215701914</nova:project>
Nov 08 04:08:54 user nova-compute[75014]:       </nova:owner>
Nov 08 04:08:54 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:08:54 user nova-compute[75014]:       <nova:ports>
Nov 08 04:08:54 user nova-compute[75014]:         <nova:port uuid="4320bd7b-bdf6-400d-9e6e-2d29c34ccf84">
Nov 08 04:08:54 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 04:08:54 user nova-compute[75014]:         </nova:port>
Nov 08 04:08:54 user nova-compute[75014]:       </nova:ports>
Nov 08 04:08:54 user nova-compute[75014]:     </nova:instance>
Nov 08 04:08:54 user nova-compute[75014]:   </metadata>
Nov 08 04:08:54 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:08:54 user nova-compute[75014]:     <system>
Nov 08 04:08:54 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:08:54 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:08:54 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:08:54 user nova-compute[75014]:       <entry name="serial">b25630ab-a3b3-4ec7-bd38-3344d90672c9</entry>
Nov 08 04:08:54 user nova-compute[75014]:       <entry name="uuid">b25630ab-a3b3-4ec7-bd38-3344d90672c9</entry>
Nov 08 04:08:54 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:08:54 user nova-compute[75014]:     </system>
Nov 08 04:08:54 user nova-compute[75014]:   </sysinfo>
Nov 08 04:08:54 user nova-compute[75014]:   <os>
Nov 08 04:08:54 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:08:54 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:08:54 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:08:54 user nova-compute[75014]:   </os>
Nov 08 04:08:54 user nova-compute[75014]:   <features>
Nov 08 04:08:54 user nova-compute[75014]:     <acpi/>
Nov 08 04:08:54 user nova-compute[75014]:     <apic/>
Nov 08 04:08:54 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:08:54 user nova-compute[75014]:   </features>
Nov 08 04:08:54 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:08:54 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:08:54 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:08:54 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:08:54 user nova-compute[75014]:   </clock>
Nov 08 04:08:54 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:08:54 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:08:54 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:08:54 user nova-compute[75014]:   </cpu>
Nov 08 04:08:54 user nova-compute[75014]:   <devices>
Nov 08 04:08:54 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 04:08:54 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 04:08:54 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/b25630ab-a3b3-4ec7-bd38-3344d90672c9/disk"/>
Nov 08 04:08:54 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:08:54 user nova-compute[75014]:     </disk>
Nov 08 04:08:54 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:08:54 user nova-compute[75014]:       <mac address="fa:16:3e:94:e1:8b"/>
Nov 08 04:08:54 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:08:54 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:08:54 user nova-compute[75014]:       <target dev="tap4320bd7b-bd"/>
Nov 08 04:08:54 user nova-compute[75014]:     </interface>
Nov 08 04:08:54 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:08:54 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/b25630ab-a3b3-4ec7-bd38-3344d90672c9/console.log" append="off"/>
Nov 08 04:08:54 user nova-compute[75014]:     </serial>
Nov 08 04:08:54 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:08:54 user nova-compute[75014]:     <video>
Nov 08 04:08:54 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:08:54 user nova-compute[75014]:     </video>
Nov 08 04:08:54 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:08:54 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:08:54 user nova-compute[75014]:     </rng>
Nov 08 04:08:54 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:08:54 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:08:54 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:08:54 user nova-compute[75014]:     </memballoon>
Nov 08 04:08:54 user nova-compute[75014]:   </devices>
Nov 08 04:08:54 user nova-compute[75014]: </domain>
Nov 08 04:08:54 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-841779446',display_name='tempest-AttachVolumeNegativeTest-server-841779446',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-841779446',id=34,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYiRuI6Qlrw5LB0w6rGjxj+RuPR9hBpFUKhepgvXYNgL4ISheWawEWS0cIN+5drheKvD0hhBsmbiQzrgZeL7Sgu1v34CnmjYiZJWha7ZmnUqEfdP4APbCpA7ikogdjzZA==',key_name='tempest-keypair-402936703',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1c9753cb588478a8a93182be3256674',ramdisk_id='',reservation_id='r-qd6pjmx2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1215701914',owner_user_name='tempest-AttachVolumeNegativeTest-1215701914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:08:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8c674d8b2cf49c08cf254a8095ef8ea',uuid=b25630ab-a3b3-4ec7-bd38-3344d90672c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4320bd7b-bdf6-400d-9e6e-2d29c34ccf84", "address": "fa:16:3e:94:e1:8b", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4320bd7b-bd", "ovs_interfaceid": "4320bd7b-bdf6-400d-9e6e-2d29c34ccf84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Converting VIF {"id": "4320bd7b-bdf6-400d-9e6e-2d29c34ccf84", "address": "fa:16:3e:94:e1:8b", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4320bd7b-bd", "ovs_interfaceid": "4320bd7b-bdf6-400d-9e6e-2d29c34ccf84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:e1:8b,bridge_name='br-int',has_traffic_filtering=True,id=4320bd7b-bdf6-400d-9e6e-2d29c34ccf84,network=Network(f3d67270-d525-45d9-958c-a901d121d510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4320bd7b-bd') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG os_vif [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:e1:8b,bridge_name='br-int',has_traffic_filtering=True,id=4320bd7b-bdf6-400d-9e6e-2d29c34ccf84,network=Network(f3d67270-d525-45d9-958c-a901d121d510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4320bd7b-bd') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ed01009-fee5-55f7-a016-dbd691c1ac1c', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4320bd7b-bd, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4320bd7b-bd, col_values=(('qos', UUID('899280bd-77ff-43e7-ad60-6f96aa91eafa')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4320bd7b-bd, col_values=(('external_ids', {'iface-id': '4320bd7b-bdf6-400d-9e6e-2d29c34ccf84', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:e1:8b', 'vm-uuid': 'b25630ab-a3b3-4ec7-bd38-3344d90672c9'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:54 user nova-compute[75014]: INFO os_vif [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:e1:8b,bridge_name='br-int',has_traffic_filtering=True,id=4320bd7b-bdf6-400d-9e6e-2d29c34ccf84,network=Network(f3d67270-d525-45d9-958c-a901d121d510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4320bd7b-bd')
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:08:54 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] No VIF found with MAC fa:16:3e:94:e1:8b, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:08:55 user nova-compute[75014]: DEBUG nova.network.neutron [req-dbb8059b-2ffe-4aec-93a0-1e79a3fa90df req-447eac58-543e-4e88-874b-632affa90337 service nova] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Updated VIF entry in instance network info cache for port 4320bd7b-bdf6-400d-9e6e-2d29c34ccf84. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:08:55 user nova-compute[75014]: DEBUG nova.network.neutron [req-dbb8059b-2ffe-4aec-93a0-1e79a3fa90df req-447eac58-543e-4e88-874b-632affa90337 service nova] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Updating instance_info_cache with network_info: [{"id": "4320bd7b-bdf6-400d-9e6e-2d29c34ccf84", "address": "fa:16:3e:94:e1:8b", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4320bd7b-bd", "ovs_interfaceid": "4320bd7b-bdf6-400d-9e6e-2d29c34ccf84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:08:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dbb8059b-2ffe-4aec-93a0-1e79a3fa90df req-447eac58-543e-4e88-874b-632affa90337 service nova] Releasing lock "refresh_cache-b25630ab-a3b3-4ec7-bd38-3344d90672c9" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:08:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "0b3b62d9-2543-402b-bdb5-cac994b755c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:08:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "0b3b62d9-2543-402b-bdb5-cac994b755c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:08:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:08:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:08:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:08:55 user nova-compute[75014]: INFO nova.compute.manager [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Terminating instance
Nov 08 04:08:55 user nova-compute[75014]: DEBUG nova.compute.manager [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:08:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:56 user nova-compute[75014]: DEBUG nova.compute.manager [req-ea4155a7-a46b-437e-9722-94d2cdf3b724 req-794d595e-4e78-44e2-a55a-7941e75726fe service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Received event network-vif-unplugged-4b006ecf-b195-4491-8ba7-7109ae8701df {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:08:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ea4155a7-a46b-437e-9722-94d2cdf3b724 req-794d595e-4e78-44e2-a55a-7941e75726fe service nova] Acquiring lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:08:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ea4155a7-a46b-437e-9722-94d2cdf3b724 req-794d595e-4e78-44e2-a55a-7941e75726fe service nova] Lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:08:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ea4155a7-a46b-437e-9722-94d2cdf3b724 req-794d595e-4e78-44e2-a55a-7941e75726fe service nova] Lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:08:56 user nova-compute[75014]: DEBUG nova.compute.manager [req-ea4155a7-a46b-437e-9722-94d2cdf3b724 req-794d595e-4e78-44e2-a55a-7941e75726fe service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] No waiting events found dispatching network-vif-unplugged-4b006ecf-b195-4491-8ba7-7109ae8701df {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:08:56 user nova-compute[75014]: DEBUG nova.compute.manager [req-ea4155a7-a46b-437e-9722-94d2cdf3b724 req-794d595e-4e78-44e2-a55a-7941e75726fe service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Received event network-vif-unplugged-4b006ecf-b195-4491-8ba7-7109ae8701df for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:08:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:57 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Instance destroyed successfully.
Nov 08 04:08:57 user nova-compute[75014]: DEBUG nova.objects.instance [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lazy-loading 'resources' on Instance uuid 0b3b62d9-2543-402b-bdb5-cac994b755c9 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1905655883',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1905655883',id=28,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:05:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92a182cdeb8543fea1ab24326734991e',ramdisk_id='',reservation_id='r-0igftpd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648299000',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:07:10Z,user_data=None,user_id='630b9ba8f1d9471f9cea51f74106381a',uuid=0b3b62d9-2543-402b-bdb5-cac994b755c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b006ecf-b195-4491-8ba7-7109ae8701df", "address": "fa:16:3e:c5:3a:a9", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b006ecf-b1", "ovs_interfaceid": "4b006ecf-b195-4491-8ba7-7109ae8701df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Converting VIF {"id": "4b006ecf-b195-4491-8ba7-7109ae8701df", "address": "fa:16:3e:c5:3a:a9", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b006ecf-b1", "ovs_interfaceid": "4b006ecf-b195-4491-8ba7-7109ae8701df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:3a:a9,bridge_name='br-int',has_traffic_filtering=True,id=4b006ecf-b195-4491-8ba7-7109ae8701df,network=Network(d45dbf14-9570-46c1-91a3-cbe2f7972b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b006ecf-b1') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG os_vif [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:3a:a9,bridge_name='br-int',has_traffic_filtering=True,id=4b006ecf-b195-4491-8ba7-7109ae8701df,network=Network(d45dbf14-9570-46c1-91a3-cbe2f7972b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b006ecf-b1') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b006ecf-b1, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cede4af6-aaea-4883-a4fb-c61b8887a936) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:08:57 user nova-compute[75014]: INFO os_vif [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:3a:a9,bridge_name='br-int',has_traffic_filtering=True,id=4b006ecf-b195-4491-8ba7-7109ae8701df,network=Network(d45dbf14-9570-46c1-91a3-cbe2f7972b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b006ecf-b1')
Nov 08 04:08:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oPyKNglX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:08:57 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:08:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.043s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[389cf68d-b40c-49df-aa26-420a0426ce05]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:08:57 user nova-compute[75014]: No targets found.
Nov 08 04:08:57 user nova-compute[75014]: iSNS:
Nov 08 04:08:57 user nova-compute[75014]: No targets found.
Nov 08 04:08:57 user nova-compute[75014]: STATIC:
Nov 08 04:08:57 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1
Nov 08 04:08:57 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:08:57 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:08:57 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec
Nov 08 04:08:57 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:08:57 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:08:57 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1
Nov 08 04:08:57 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:08:57 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:08:57 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00
Nov 08 04:08:57 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:08:57 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:08:57 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:08:57 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:08:57 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:08:57 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb
Nov 08 04:08:57 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:08:57 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:08:57 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c
Nov 08 04:08:57 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:08:57 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:08:57 user nova-compute[75014]: FIRMWARE:
Nov 08 04:08:57 user nova-compute[75014]: No targets found.
Nov 08 04:08:57 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:08:57 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:08:57 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9973041c-e725-4719-95ba-8e74ce3c13e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[98afdcb9-970c-479e-8323-7c6cfb42356b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:08:57 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:08:57 user nova-compute[75014]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:08:57 user nova-compute[75014]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 (non-flash)
Nov 08 04:08:57 user nova-compute[75014]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)
Nov 08 04:08:57 user nova-compute[75014]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:08:57 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:08:57 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:08:57 user nova-compute[75014]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 (non-flash)
Nov 08 04:08:57 user nova-compute[75014]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:08:57 user nova-compute[75014]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 (non-flash)
Nov 08 04:08:57 user nova-compute[75014]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)
Nov 08 04:08:57 user nova-compute[75014]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:08:57 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:08:57 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f040070b490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00'): ({'sdi'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Removing single pathed devices sdi {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df1b066-ff77-43a3-9102-016af6d71dd1]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.028s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a83a2e1-17d8-4cbf-8047-28aeebe99f7b]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Flushing IO for device /dev/sdi {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[671c9874-8315-4258-8904-ea12884c70b7]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.053s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4098f2-86fe-4811-a561-846d5b22935b]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] SCSI volumes sdi have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[717a1b10-f91e-4652-b8e2-be51b3d35d8b]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a24457-6b69-4360-83ea-e6a3d88e3471]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00, portal: 172.16.0.220,3260]
Nov 08 04:08:57 user nova-compute[75014]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00, portal: 172.16.0.220,3260] successful.
Nov 08 04:08:57 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47179dad-70f6-4bbd-afc1-51487445cd00 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f32170-99c5-449e-bba0-04ef2307c71e]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.434s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] <== disconnect_volume: return (437ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:08:57 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Deleting instance files /opt/stack/data/nova/instances/0b3b62d9-2543-402b-bdb5-cac994b755c9_del
Nov 08 04:08:57 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Deletion of /opt/stack/data/nova/instances/0b3b62d9-2543-402b-bdb5-cac994b755c9_del complete
Nov 08 04:08:57 user nova-compute[75014]: INFO nova.compute.manager [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Took 1.92 seconds to destroy the instance on the hypervisor.
Nov 08 04:08:57 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:08:57 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:08:58 user nova-compute[75014]: DEBUG nova.compute.manager [req-397bf0eb-9d49-46da-9799-56d6f25406b3 req-53e1719f-a5ea-44e8-a732-b68af6e49b42 service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Received event network-vif-plugged-4b006ecf-b195-4491-8ba7-7109ae8701df {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:08:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-397bf0eb-9d49-46da-9799-56d6f25406b3 req-53e1719f-a5ea-44e8-a732-b68af6e49b42 service nova] Acquiring lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:08:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-397bf0eb-9d49-46da-9799-56d6f25406b3 req-53e1719f-a5ea-44e8-a732-b68af6e49b42 service nova] Lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:08:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-397bf0eb-9d49-46da-9799-56d6f25406b3 req-53e1719f-a5ea-44e8-a732-b68af6e49b42 service nova] Lock "0b3b62d9-2543-402b-bdb5-cac994b755c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:08:58 user nova-compute[75014]: DEBUG nova.compute.manager [req-397bf0eb-9d49-46da-9799-56d6f25406b3 req-53e1719f-a5ea-44e8-a732-b68af6e49b42 service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] No waiting events found dispatching network-vif-plugged-4b006ecf-b195-4491-8ba7-7109ae8701df {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:08:58 user nova-compute[75014]: WARNING nova.compute.manager [req-397bf0eb-9d49-46da-9799-56d6f25406b3 req-53e1719f-a5ea-44e8-a732-b68af6e49b42 service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Received unexpected event network-vif-plugged-4b006ecf-b195-4491-8ba7-7109ae8701df for instance with vm_state active and task_state deleting.
Nov 08 04:08:58 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:08:58 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Took 0.58 seconds to deallocate network for instance.
Nov 08 04:08:58 user nova-compute[75014]: DEBUG nova.compute.manager [req-d91c216e-ff44-4f29-92f7-c6d48188664f req-e3eeffcc-d658-4c61-8d7a-64d99f028cf1 service nova] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Received event network-vif-deleted-4b006ecf-b195-4491-8ba7-7109ae8701df {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:08:58 user nova-compute[75014]: DEBUG nova.compute.manager [req-7293191c-50c5-49bd-bce8-70535166d46e req-648420ef-d48e-486f-88ae-e4d117460d7e service nova] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Received event network-vif-plugged-4320bd7b-bdf6-400d-9e6e-2d29c34ccf84 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:08:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-7293191c-50c5-49bd-bce8-70535166d46e req-648420ef-d48e-486f-88ae-e4d117460d7e service nova] Acquiring lock "b25630ab-a3b3-4ec7-bd38-3344d90672c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:08:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-7293191c-50c5-49bd-bce8-70535166d46e req-648420ef-d48e-486f-88ae-e4d117460d7e service nova] Lock "b25630ab-a3b3-4ec7-bd38-3344d90672c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:08:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-7293191c-50c5-49bd-bce8-70535166d46e req-648420ef-d48e-486f-88ae-e4d117460d7e service nova] Lock "b25630ab-a3b3-4ec7-bd38-3344d90672c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:08:58 user nova-compute[75014]: DEBUG nova.compute.manager [req-7293191c-50c5-49bd-bce8-70535166d46e req-648420ef-d48e-486f-88ae-e4d117460d7e service nova] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] No waiting events found dispatching network-vif-plugged-4320bd7b-bdf6-400d-9e6e-2d29c34ccf84 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:08:58 user nova-compute[75014]: WARNING nova.compute.manager [req-7293191c-50c5-49bd-bce8-70535166d46e req-648420ef-d48e-486f-88ae-e4d117460d7e service nova] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Received unexpected event network-vif-plugged-4320bd7b-bdf6-400d-9e6e-2d29c34ccf84 for instance with vm_state building and task_state spawning.
Nov 08 04:08:59 user nova-compute[75014]: DEBUG nova.compute.manager [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:08:59 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 04:08:59 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Instance spawned successfully.
Nov 08 04:08:59 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 04:08:59 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:08:59 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:08:59 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:08:59 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:08:59 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:08:59 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:08:59 user nova-compute[75014]: INFO nova.compute.manager [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Took 7.79 seconds to spawn the instance on the hypervisor.
Nov 08 04:08:59 user nova-compute[75014]: DEBUG nova.compute.manager [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:08:59 user nova-compute[75014]: INFO nova.compute.manager [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Took 9.11 seconds to build instance.
Nov 08 04:08:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-23e9c310-0044-40a0-a444-a1545318d0c3 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "b25630ab-a3b3-4ec7-bd38-3344d90672c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.343s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:09:00 user nova-compute[75014]: DEBUG nova.compute.manager [req-3f038244-25b6-4ba3-9b8f-c9d5fe29ff1e req-20517ad3-3447-4c78-9d5e-82b5b0fb7256 service nova] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Received event network-vif-plugged-4320bd7b-bdf6-400d-9e6e-2d29c34ccf84 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:09:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3f038244-25b6-4ba3-9b8f-c9d5fe29ff1e req-20517ad3-3447-4c78-9d5e-82b5b0fb7256 service nova] Acquiring lock "b25630ab-a3b3-4ec7-bd38-3344d90672c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:09:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3f038244-25b6-4ba3-9b8f-c9d5fe29ff1e req-20517ad3-3447-4c78-9d5e-82b5b0fb7256 service nova] Lock "b25630ab-a3b3-4ec7-bd38-3344d90672c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:09:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3f038244-25b6-4ba3-9b8f-c9d5fe29ff1e req-20517ad3-3447-4c78-9d5e-82b5b0fb7256 service nova] Lock "b25630ab-a3b3-4ec7-bd38-3344d90672c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:09:00 user nova-compute[75014]: DEBUG nova.compute.manager [req-3f038244-25b6-4ba3-9b8f-c9d5fe29ff1e req-20517ad3-3447-4c78-9d5e-82b5b0fb7256 service nova] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] No waiting events found dispatching network-vif-plugged-4320bd7b-bdf6-400d-9e6e-2d29c34ccf84 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:09:00 user nova-compute[75014]: WARNING nova.compute.manager [req-3f038244-25b6-4ba3-9b8f-c9d5fe29ff1e req-20517ad3-3447-4c78-9d5e-82b5b0fb7256 service nova] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Received unexpected event network-vif-plugged-4320bd7b-bdf6-400d-9e6e-2d29c34ccf84 for instance with vm_state active and task_state None.
Nov 08 04:09:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:02 user nova-compute[75014]: INFO nova.compute.manager [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 0b3b62d9-2543-402b-bdb5-cac994b755c9] Took 4.37 seconds to detach 1 volumes for instance.
Nov 08 04:09:02 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:09:02 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:09:03 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:09:03 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:09:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:09:03 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Deleted allocations for instance 0b3b62d9-2543-402b-bdb5-cac994b755c9
Nov 08 04:09:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-df52502a-d57b-4904-a70f-dc1a41103f0e tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "0b3b62d9-2543-402b-bdb5-cac994b755c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.555s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:09:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:33 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:09:35 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:09:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:36 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:09:36 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:09:36 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:09:36 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Rebuilding the list of instances to heal {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 04:09:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-5bfa6580-e0fe-46b0-b497-8db67806113a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:09:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-5bfa6580-e0fe-46b0-b497-8db67806113a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:09:36 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 04:09:36 user nova-compute[75014]: DEBUG nova.objects.instance [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lazy-loading 'info_cache' on Instance uuid 5bfa6580-e0fe-46b0-b497-8db67806113a {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:09:37 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Updating instance_info_cache with network_info: [{"id": "3f08242a-d68d-4744-8b4c-49bdc29ea557", "address": "fa:16:3e:65:f5:c2", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f08242a-d6", "ovs_interfaceid": "3f08242a-d68d-4744-8b4c-49bdc29ea557", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:09:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-5bfa6580-e0fe-46b0-b497-8db67806113a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:09:37 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 04:09:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:38 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:09:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:40 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:09:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Acquiring lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:09:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:09:41 user nova-compute[75014]: DEBUG nova.compute.manager [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 04:09:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:09:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:09:41 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 04:09:41 user nova-compute[75014]: INFO nova.compute.claims [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Claim successful on node user
Nov 08 04:09:42 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:09:42 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:09:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:42 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:09:42 user nova-compute[75014]: DEBUG nova.compute.manager [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 04:09:42 user nova-compute[75014]: DEBUG nova.compute.manager [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 04:09:42 user nova-compute[75014]: DEBUG nova.network.neutron [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 04:09:42 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 04:09:42 user nova-compute[75014]: DEBUG nova.compute.manager [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 04:09:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:42 user nova-compute[75014]: INFO nova.virt.block_device [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Booting with volume e0ec0452-90f2-48e1-b99a-b6a460342437 at /dev/vda
Nov 08 04:09:42 user nova-compute[75014]: DEBUG nova.policy [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '58b14797a2974cb19e3759f51c391509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0174a3477d45e1a6aa8a405b0027b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 04:09:42 user nova-compute[75014]: DEBUG os_brick.utils [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:09:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:09:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:09:42 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[921d835c-0ad5-45bd-945b-c4cecce4b8be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:09:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:09:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:09:42 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4b0d68-b167-40ad-b1d5-5558f77b0966]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:09:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:09:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:09:42 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45f6fcf-856d-4b61-bc29-cf0815b09a9f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:09:42 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[452dca2f-d3e6-49de-8a30-8de5cb6b3a43]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:09:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:09:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:09:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:09:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:09:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:09:42 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:09:42 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f288b2be-edd4-4d24-a982-55eeb0970922]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:09:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:09:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:09:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:09:42 user nova-compute[75014]: DEBUG os_brick.utils [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:09:42 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Updating existing volume attachment record: 70c01e55-a5e4-4b33-8965-166f4045d953 {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:09:43 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:09:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:09:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:09:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:09:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:09:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25630ab-a3b3-4ec7-bd38-3344d90672c9/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:09:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25630ab-a3b3-4ec7-bd38-3344d90672c9/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:09:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25630ab-a3b3-4ec7-bd38-3344d90672c9/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:09:43 user nova-compute[75014]: DEBUG nova.network.neutron [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Successfully created port: 0fe677fa-7bc0-4ab0-abe1-4078284cb71a {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 04:09:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25630ab-a3b3-4ec7-bd38-3344d90672c9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:09:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:09:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:09:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:09:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:09:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:09:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:09:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:09:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:09:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:09:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:09:44 user nova-compute[75014]: DEBUG nova.network.neutron [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Successfully updated port: 0fe677fa-7bc0-4ab0-abe1-4078284cb71a {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 04:09:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Acquiring lock "refresh_cache-ace7e2f7-28c3-41e3-b92b-05e834c3968c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:09:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Acquired lock "refresh_cache-ace7e2f7-28c3-41e3-b92b-05e834c3968c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:09:44 user nova-compute[75014]: DEBUG nova.network.neutron [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:09:44 user nova-compute[75014]: DEBUG nova.compute.manager [req-b8fa01bb-bc91-4d62-bee3-e13d656efaa3 req-b6aec1d4-91b6-4b8e-8861-2e0f71da16c4 service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Received event network-changed-0fe677fa-7bc0-4ab0-abe1-4078284cb71a {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:09:44 user nova-compute[75014]: DEBUG nova.compute.manager [req-b8fa01bb-bc91-4d62-bee3-e13d656efaa3 req-b6aec1d4-91b6-4b8e-8861-2e0f71da16c4 service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Refreshing instance network info cache due to event network-changed-0fe677fa-7bc0-4ab0-abe1-4078284cb71a. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:09:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b8fa01bb-bc91-4d62-bee3-e13d656efaa3 req-b6aec1d4-91b6-4b8e-8861-2e0f71da16c4 service nova] Acquiring lock "refresh_cache-ace7e2f7-28c3-41e3-b92b-05e834c3968c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:09:45 user nova-compute[75014]: DEBUG nova.network.neutron [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 04:09:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:09:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:09:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:09:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:09:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:09:45 user nova-compute[75014]: DEBUG nova.network.neutron [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Updating instance_info_cache with network_info: [{"id": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "address": "fa:16:3e:9c:4b:98", "network": {"id": "11cfca93-63ac-49c6-8cf8-2c7885e21563", "bridge": "br-int", "label": "tempest-TestShelveInstance-1503372709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0174a3477d45e1a6aa8a405b0027b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe677fa-7b", "ovs_interfaceid": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:09:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Releasing lock "refresh_cache-ace7e2f7-28c3-41e3-b92b-05e834c3968c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:09:45 user nova-compute[75014]: DEBUG nova.compute.manager [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Instance network_info: |[{"id": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "address": "fa:16:3e:9c:4b:98", "network": {"id": "11cfca93-63ac-49c6-8cf8-2c7885e21563", "bridge": "br-int", "label": "tempest-TestShelveInstance-1503372709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0174a3477d45e1a6aa8a405b0027b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe677fa-7b", "ovs_interfaceid": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 04:09:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b8fa01bb-bc91-4d62-bee3-e13d656efaa3 req-b6aec1d4-91b6-4b8e-8861-2e0f71da16c4 service nova] Acquired lock "refresh_cache-ace7e2f7-28c3-41e3-b92b-05e834c3968c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:09:45 user nova-compute[75014]: DEBUG nova.network.neutron [req-b8fa01bb-bc91-4d62-bee3-e13d656efaa3 req-b6aec1d4-91b6-4b8e-8861-2e0f71da16c4 service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Refreshing network info cache for port 0fe677fa-7bc0-4ab0-abe1-4078284cb71a {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:09:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:09:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:09:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:09:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:09:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:09:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:09:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:09:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:09:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:09:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:09:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:09:46 user nova-compute[75014]: DEBUG nova.network.neutron [req-b8fa01bb-bc91-4d62-bee3-e13d656efaa3 req-b6aec1d4-91b6-4b8e-8861-2e0f71da16c4 service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Updated VIF entry in instance network info cache for port 0fe677fa-7bc0-4ab0-abe1-4078284cb71a. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:09:46 user nova-compute[75014]: DEBUG nova.network.neutron [req-b8fa01bb-bc91-4d62-bee3-e13d656efaa3 req-b6aec1d4-91b6-4b8e-8861-2e0f71da16c4 service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Updating instance_info_cache with network_info: [{"id": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "address": "fa:16:3e:9c:4b:98", "network": {"id": "11cfca93-63ac-49c6-8cf8-2c7885e21563", "bridge": "br-int", "label": "tempest-TestShelveInstance-1503372709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0174a3477d45e1a6aa8a405b0027b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe677fa-7b", "ovs_interfaceid": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:09:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b8fa01bb-bc91-4d62-bee3-e13d656efaa3 req-b6aec1d4-91b6-4b8e-8861-2e0f71da16c4 service nova] Releasing lock "refresh_cache-ace7e2f7-28c3-41e3-b92b-05e834c3968c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:09:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:09:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:09:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:09:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:09:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2e45371c-ef7e-48e2-8703-e8d4754d44a7 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "d555b6b3-86ec-40ae-aa20-48846b5157d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:09:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2e45371c-ef7e-48e2-8703-e8d4754d44a7 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "d555b6b3-86ec-40ae-aa20-48846b5157d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:09:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2e45371c-ef7e-48e2-8703-e8d4754d44a7 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "d555b6b3-86ec-40ae-aa20-48846b5157d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:09:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2e45371c-ef7e-48e2-8703-e8d4754d44a7 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "d555b6b3-86ec-40ae-aa20-48846b5157d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:09:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2e45371c-ef7e-48e2-8703-e8d4754d44a7 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "d555b6b3-86ec-40ae-aa20-48846b5157d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:09:46 user nova-compute[75014]: INFO nova.compute.manager [None req-2e45371c-ef7e-48e2-8703-e8d4754d44a7 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Terminating instance
Nov 08 04:09:46 user nova-compute[75014]: DEBUG nova.compute.manager [None req-2e45371c-ef7e-48e2-8703-e8d4754d44a7 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:09:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:09:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:09:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG nova.compute.manager [req-818ef0e5-4be6-4a00-936b-7db0a6796294 req-dc4d3dac-d919-4212-a3b1-232c3ab8ac6d service nova] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Received event network-vif-unplugged-611f5c87-6ea2-44f7-95ff-c2a8375bbb76 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-818ef0e5-4be6-4a00-936b-7db0a6796294 req-dc4d3dac-d919-4212-a3b1-232c3ab8ac6d service nova] Acquiring lock "d555b6b3-86ec-40ae-aa20-48846b5157d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-818ef0e5-4be6-4a00-936b-7db0a6796294 req-dc4d3dac-d919-4212-a3b1-232c3ab8ac6d service nova] Lock "d555b6b3-86ec-40ae-aa20-48846b5157d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-818ef0e5-4be6-4a00-936b-7db0a6796294 req-dc4d3dac-d919-4212-a3b1-232c3ab8ac6d service nova] Lock "d555b6b3-86ec-40ae-aa20-48846b5157d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG nova.compute.manager [req-818ef0e5-4be6-4a00-936b-7db0a6796294 req-dc4d3dac-d919-4212-a3b1-232c3ab8ac6d service nova] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] No waiting events found dispatching network-vif-unplugged-611f5c87-6ea2-44f7-95ff-c2a8375bbb76 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG nova.compute.manager [req-818ef0e5-4be6-4a00-936b-7db0a6796294 req-dc4d3dac-d919-4212-a3b1-232c3ab8ac6d service nova] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Received event network-vif-unplugged-611f5c87-6ea2-44f7-95ff-c2a8375bbb76 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:09:48 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:09:48 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:09:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=7687MB free_disk=24.69918441772461GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:09:48 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Instance destroyed successfully.
Nov 08 04:09:48 user nova-compute[75014]: DEBUG nova.objects.instance [None req-2e45371c-ef7e-48e2-8703-e8d4754d44a7 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lazy-loading 'resources' on Instance uuid d555b6b3-86ec-40ae-aa20-48846b5157d5 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-2e45371c-ef7e-48e2-8703-e8d4754d44a7 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:59:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-348183258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-348183258',id=24,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:59:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92a182cdeb8543fea1ab24326734991e',ramdisk_id='',reservation_id='r-qlshhsjx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648299000',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:01:31Z,user_data=None,user_id='630b9ba8f1d9471f9cea51f74106381a',uuid=d555b6b3-86ec-40ae-aa20-48846b5157d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "611f5c87-6ea2-44f7-95ff-c2a8375bbb76", "address": "fa:16:3e:1b:8a:50", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap611f5c87-6e", "ovs_interfaceid": "611f5c87-6ea2-44f7-95ff-c2a8375bbb76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-2e45371c-ef7e-48e2-8703-e8d4754d44a7 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Converting VIF {"id": "611f5c87-6ea2-44f7-95ff-c2a8375bbb76", "address": "fa:16:3e:1b:8a:50", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap611f5c87-6e", "ovs_interfaceid": "611f5c87-6ea2-44f7-95ff-c2a8375bbb76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-2e45371c-ef7e-48e2-8703-e8d4754d44a7 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:8a:50,bridge_name='br-int',has_traffic_filtering=True,id=611f5c87-6ea2-44f7-95ff-c2a8375bbb76,network=Network(d45dbf14-9570-46c1-91a3-cbe2f7972b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap611f5c87-6e') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG os_vif [None req-2e45371c-ef7e-48e2-8703-e8d4754d44a7 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:8a:50,bridge_name='br-int',has_traffic_filtering=True,id=611f5c87-6ea2-44f7-95ff-c2a8375bbb76,network=Network(d45dbf14-9570-46c1-91a3-cbe2f7972b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap611f5c87-6e') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap611f5c87-6e, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=610de61c-28cd-4b1e-8c38-3bb67ec707d8) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:48 user nova-compute[75014]: INFO os_vif [None req-2e45371c-ef7e-48e2-8703-e8d4754d44a7 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:8a:50,bridge_name='br-int',has_traffic_filtering=True,id=611f5c87-6ea2-44f7-95ff-c2a8375bbb76,network=Network(d45dbf14-9570-46c1-91a3-cbe2f7972b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap611f5c87-6e')
Nov 08 04:09:48 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-2e45371c-ef7e-48e2-8703-e8d4754d44a7 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Deleting instance files /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5_del
Nov 08 04:09:48 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-2e45371c-ef7e-48e2-8703-e8d4754d44a7 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Deletion of /opt/stack/data/nova/instances/d555b6b3-86ec-40ae-aa20-48846b5157d5_del complete
Nov 08 04:09:48 user nova-compute[75014]: INFO nova.compute.manager [None req-2e45371c-ef7e-48e2-8703-e8d4754d44a7 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Took 1.62 seconds to destroy the instance on the hypervisor.
Nov 08 04:09:48 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-2e45371c-ef7e-48e2-8703-e8d4754d44a7 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 5bfa6580-e0fe-46b0-b497-8db67806113a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 655fe5eb-1271-4b9f-a5a6-6342bd012a69 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance d555b6b3-86ec-40ae-aa20-48846b5157d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance c23c9e00-b782-4530-bb01-a7a167951c1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 36a4109b-f239-48ce-ad49-e640a12a73bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 781932ce-0bea-466f-95e0-066130d6c410 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 1cb11358-b4c4-47f4-ba30-d967d523f98a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 449e9147-efe0-4aa1-af52-557e313bf7fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance b25630ab-a3b3-4ec7-bd38-3344d90672c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance ace7e2f7-28c3-41e3-b92b-05e834c3968c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:09:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.565s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:09:49 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:09:49 user nova-compute[75014]: DEBUG nova.compute.manager [req-0dd00d3b-34e6-409f-983d-005ff87b918d req-833217d1-c01e-4b8f-bab5-ebc5bd947cd7 service nova] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Received event network-vif-plugged-611f5c87-6ea2-44f7-95ff-c2a8375bbb76 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:09:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0dd00d3b-34e6-409f-983d-005ff87b918d req-833217d1-c01e-4b8f-bab5-ebc5bd947cd7 service nova] Acquiring lock "d555b6b3-86ec-40ae-aa20-48846b5157d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:09:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0dd00d3b-34e6-409f-983d-005ff87b918d req-833217d1-c01e-4b8f-bab5-ebc5bd947cd7 service nova] Lock "d555b6b3-86ec-40ae-aa20-48846b5157d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:09:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0dd00d3b-34e6-409f-983d-005ff87b918d req-833217d1-c01e-4b8f-bab5-ebc5bd947cd7 service nova] Lock "d555b6b3-86ec-40ae-aa20-48846b5157d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:09:49 user nova-compute[75014]: DEBUG nova.compute.manager [req-0dd00d3b-34e6-409f-983d-005ff87b918d req-833217d1-c01e-4b8f-bab5-ebc5bd947cd7 service nova] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] No waiting events found dispatching network-vif-plugged-611f5c87-6ea2-44f7-95ff-c2a8375bbb76 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:09:49 user nova-compute[75014]: WARNING nova.compute.manager [req-0dd00d3b-34e6-409f-983d-005ff87b918d req-833217d1-c01e-4b8f-bab5-ebc5bd947cd7 service nova] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Received unexpected event network-vif-plugged-611f5c87-6ea2-44f7-95ff-c2a8375bbb76 for instance with vm_state active and task_state deleting.
Nov 08 04:09:49 user nova-compute[75014]: DEBUG nova.compute.manager [req-9f6b8f72-dd5b-424d-ac30-c11559ce1617 req-65b43487-74cf-4ba1-b3fd-6d957ad42077 service nova] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Received event network-vif-deleted-611f5c87-6ea2-44f7-95ff-c2a8375bbb76 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:09:49 user nova-compute[75014]: INFO nova.compute.manager [req-9f6b8f72-dd5b-424d-ac30-c11559ce1617 req-65b43487-74cf-4ba1-b3fd-6d957ad42077 service nova] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Neutron deleted interface 611f5c87-6ea2-44f7-95ff-c2a8375bbb76; detaching it from the instance and deleting it from the info cache
Nov 08 04:09:49 user nova-compute[75014]: DEBUG nova.network.neutron [req-9f6b8f72-dd5b-424d-ac30-c11559ce1617 req-65b43487-74cf-4ba1-b3fd-6d957ad42077 service nova] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:09:49 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Took 0.84 seconds to deallocate network for instance.
Nov 08 04:09:49 user nova-compute[75014]: DEBUG nova.compute.manager [req-9f6b8f72-dd5b-424d-ac30-c11559ce1617 req-65b43487-74cf-4ba1-b3fd-6d957ad42077 service nova] [instance: d555b6b3-86ec-40ae-aa20-48846b5157d5] Detach interface failed, port_id=611f5c87-6ea2-44f7-95ff-c2a8375bbb76, reason: Instance d555b6b3-86ec-40ae-aa20-48846b5157d5 could not be found. {{(pid=75014) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 04:09:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2e45371c-ef7e-48e2-8703-e8d4754d44a7 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:09:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2e45371c-ef7e-48e2-8703-e8d4754d44a7 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:09:49 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-2e45371c-ef7e-48e2-8703-e8d4754d44a7 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:09:49 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-2e45371c-ef7e-48e2-8703-e8d4754d44a7 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:09:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2e45371c-ef7e-48e2-8703-e8d4754d44a7 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:09:49 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-2e45371c-ef7e-48e2-8703-e8d4754d44a7 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Deleted allocations for instance d555b6b3-86ec-40ae-aa20-48846b5157d5
Nov 08 04:09:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2e45371c-ef7e-48e2-8703-e8d4754d44a7 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "d555b6b3-86ec-40ae-aa20-48846b5157d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.004s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:09:49 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:09:49 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:09:49 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:09:49 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:09:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquiring lock "1cb11358-b4c4-47f4-ba30-d967d523f98a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:09:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "1cb11358-b4c4-47f4-ba30-d967d523f98a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:09:53 user nova-compute[75014]: INFO nova.compute.manager [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Detaching volume c809a55c-75e5-4e8f-950f-845b6594a5b1
Nov 08 04:09:53 user nova-compute[75014]: INFO nova.virt.block_device [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Attempting to driver detach volume c809a55c-75e5-4e8f-950f-845b6594a5b1 from mountpoint /dev/vdb
Nov 08 04:09:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Attempting to detach device vdb from instance 1cb11358-b4c4-47f4-ba30-d967d523f98a from the persistent domain config. {{(pid=75014) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 04:09:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:09:53 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:09:53 user nova-compute[75014]:   <source dev="/dev/sde"/>
Nov 08 04:09:53 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:09:53 user nova-compute[75014]:   <serial>c809a55c-75e5-4e8f-950f-845b6594a5b1</serial>
Nov 08 04:09:53 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:09:53 user nova-compute[75014]: </disk>
Nov 08 04:09:53 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:09:53 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Successfully detached device vdb from instance 1cb11358-b4c4-47f4-ba30-d967d523f98a from the persistent domain config.
Nov 08 04:09:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1cb11358-b4c4-47f4-ba30-d967d523f98a from the live domain config. {{(pid=75014) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 04:09:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:09:53 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:09:53 user nova-compute[75014]:   <source dev="/dev/sde"/>
Nov 08 04:09:53 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:09:53 user nova-compute[75014]:   <serial>c809a55c-75e5-4e8f-950f-845b6594a5b1</serial>
Nov 08 04:09:53 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:09:53 user nova-compute[75014]: </disk>
Nov 08 04:09:53 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:09:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquiring lock "1cb11358-b4c4-47f4-ba30-d967d523f98a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:09:54 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1cb11358-b4c4-47f4-ba30-d967d523f98a {{(pid=75014) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 04:09:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Acquiring lock "c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:09:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Lock "c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:09:55 user nova-compute[75014]: DEBUG nova.compute.manager [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 04:09:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:09:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:09:55 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 04:09:55 user nova-compute[75014]: INFO nova.compute.claims [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Claim successful on node user
Nov 08 04:09:55 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:09:55 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:09:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.810s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:09:55 user nova-compute[75014]: DEBUG nova.compute.manager [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 04:09:56 user nova-compute[75014]: DEBUG nova.compute.manager [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 04:09:56 user nova-compute[75014]: DEBUG nova.network.neutron [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 04:09:56 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 04:09:56 user nova-compute[75014]: DEBUG nova.compute.manager [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 04:09:56 user nova-compute[75014]: DEBUG nova.policy [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7841ea39b60405b87cc29a2b293ab10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326f25150296480b99a0eca140f65204', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 04:09:56 user nova-compute[75014]: DEBUG nova.compute.manager [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 04:09:56 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 04:09:56 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Creating image(s)
Nov 08 04:09:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:09:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Lock "/opt/stack/data/nova/instances/c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:09:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Lock "/opt/stack/data/nova/instances/c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:09:56 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:09:56 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.182s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:09:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:09:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:09:56 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:09:56 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.219s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:09:56 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:09:56 user nova-compute[75014]: DEBUG nova.network.neutron [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Successfully created port: 2f8edc8d-688d-4218-8ab2-5d94deb36ec7 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 04:09:56 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf/disk 1073741824" returned: 0 in 0.061s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:09:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:09:56 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:09:56 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.174s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:09:56 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 04:09:56 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:09:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:09:57 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Cannot resize image /opt/stack/data/nova/instances/c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 04:09:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 04:09:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Ensure instance console log exists: /opt/stack/data/nova/instances/c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:09:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:09:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:09:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:09:57 user nova-compute[75014]: DEBUG nova.network.neutron [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Successfully updated port: 2f8edc8d-688d-4218-8ab2-5d94deb36ec7 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 04:09:57 user nova-compute[75014]: DEBUG nova.compute.manager [req-ebd82f70-44fb-4e7f-b175-b36275749658 req-85e2aefe-5583-4354-86cc-a26df96daad8 service nova] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Received event network-changed-2f8edc8d-688d-4218-8ab2-5d94deb36ec7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:09:57 user nova-compute[75014]: DEBUG nova.compute.manager [req-ebd82f70-44fb-4e7f-b175-b36275749658 req-85e2aefe-5583-4354-86cc-a26df96daad8 service nova] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Refreshing instance network info cache due to event network-changed-2f8edc8d-688d-4218-8ab2-5d94deb36ec7. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:09:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ebd82f70-44fb-4e7f-b175-b36275749658 req-85e2aefe-5583-4354-86cc-a26df96daad8 service nova] Acquiring lock "refresh_cache-c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:09:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ebd82f70-44fb-4e7f-b175-b36275749658 req-85e2aefe-5583-4354-86cc-a26df96daad8 service nova] Acquired lock "refresh_cache-c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:09:57 user nova-compute[75014]: DEBUG nova.network.neutron [req-ebd82f70-44fb-4e7f-b175-b36275749658 req-85e2aefe-5583-4354-86cc-a26df96daad8 service nova] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Refreshing network info cache for port 2f8edc8d-688d-4218-8ab2-5d94deb36ec7 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:09:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Acquiring lock "refresh_cache-c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:09:57 user nova-compute[75014]: DEBUG nova.network.neutron [req-ebd82f70-44fb-4e7f-b175-b36275749658 req-85e2aefe-5583-4354-86cc-a26df96daad8 service nova] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 04:09:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:57 user nova-compute[75014]: DEBUG nova.network.neutron [req-ebd82f70-44fb-4e7f-b175-b36275749658 req-85e2aefe-5583-4354-86cc-a26df96daad8 service nova] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:09:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ebd82f70-44fb-4e7f-b175-b36275749658 req-85e2aefe-5583-4354-86cc-a26df96daad8 service nova] Releasing lock "refresh_cache-c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:09:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Acquired lock "refresh_cache-c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:09:57 user nova-compute[75014]: DEBUG nova.network.neutron [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:09:57 user nova-compute[75014]: DEBUG nova.network.neutron [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 04:09:57 user nova-compute[75014]: DEBUG nova.network.neutron [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Updating instance_info_cache with network_info: [{"id": "2f8edc8d-688d-4218-8ab2-5d94deb36ec7", "address": "fa:16:3e:bd:60:8b", "network": {"id": "5f4fdfa8-0690-4305-9eda-3abf64609f4c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1326493770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "326f25150296480b99a0eca140f65204", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8edc8d-68", "ovs_interfaceid": "2f8edc8d-688d-4218-8ab2-5d94deb36ec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:09:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Releasing lock "refresh_cache-c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:09:57 user nova-compute[75014]: DEBUG nova.compute.manager [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Instance network_info: |[{"id": "2f8edc8d-688d-4218-8ab2-5d94deb36ec7", "address": "fa:16:3e:bd:60:8b", "network": {"id": "5f4fdfa8-0690-4305-9eda-3abf64609f4c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1326493770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "326f25150296480b99a0eca140f65204", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8edc8d-68", "ovs_interfaceid": "2f8edc8d-688d-4218-8ab2-5d94deb36ec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 04:09:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Start _get_guest_xml network_info=[{"id": "2f8edc8d-688d-4218-8ab2-5d94deb36ec7", "address": "fa:16:3e:bd:60:8b", "network": {"id": "5f4fdfa8-0690-4305-9eda-3abf64609f4c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1326493770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "326f25150296480b99a0eca140f65204", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8edc8d-68", "ovs_interfaceid": "2f8edc8d-688d-4218-8ab2-5d94deb36ec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:09:57 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:09:57 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:09:58 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:09:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2078873129',display_name='tempest-VolumesActionsTest-instance-2078873129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2078873129',id=36,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='326f25150296480b99a0eca140f65204',ramdisk_id='',reservation_id='r-mebc0fg6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-777452474',owner_user_name='tempest-VolumesActionsTest-777452474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:09:56Z,user_data=None,user_id='b7841ea39b60405b87cc29a2b293ab10',uuid=c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f8edc8d-688d-4218-8ab2-5d94deb36ec7", "address": "fa:16:3e:bd:60:8b", "network": {"id": "5f4fdfa8-0690-4305-9eda-3abf64609f4c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1326493770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "326f25150296480b99a0eca140f65204", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8edc8d-68", "ovs_interfaceid": "2f8edc8d-688d-4218-8ab2-5d94deb36ec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Converting VIF {"id": "2f8edc8d-688d-4218-8ab2-5d94deb36ec7", "address": "fa:16:3e:bd:60:8b", "network": {"id": "5f4fdfa8-0690-4305-9eda-3abf64609f4c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1326493770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "326f25150296480b99a0eca140f65204", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8edc8d-68", "ovs_interfaceid": "2f8edc8d-688d-4218-8ab2-5d94deb36ec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:60:8b,bridge_name='br-int',has_traffic_filtering=True,id=2f8edc8d-688d-4218-8ab2-5d94deb36ec7,network=Network(5f4fdfa8-0690-4305-9eda-3abf64609f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8edc8d-68') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG nova.objects.instance [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Lazy-loading 'pci_devices' on Instance uuid c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:09:58 user nova-compute[75014]:   <uuid>c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf</uuid>
Nov 08 04:09:58 user nova-compute[75014]:   <name>instance-00000024</name>
Nov 08 04:09:58 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:09:58 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:09:58 user nova-compute[75014]:   <metadata>
Nov 08 04:09:58 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:09:58 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:09:58 user nova-compute[75014]:       <nova:name>tempest-VolumesActionsTest-instance-2078873129</nova:name>
Nov 08 04:09:58 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:09:58</nova:creationTime>
Nov 08 04:09:58 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:09:58 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:09:58 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:09:58 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:09:58 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:09:58 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:09:58 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:09:58 user nova-compute[75014]:       <nova:owner>
Nov 08 04:09:58 user nova-compute[75014]:         <nova:user uuid="b7841ea39b60405b87cc29a2b293ab10">tempest-VolumesActionsTest-777452474-project-member</nova:user>
Nov 08 04:09:58 user nova-compute[75014]:         <nova:project uuid="326f25150296480b99a0eca140f65204">tempest-VolumesActionsTest-777452474</nova:project>
Nov 08 04:09:58 user nova-compute[75014]:       </nova:owner>
Nov 08 04:09:58 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:09:58 user nova-compute[75014]:       <nova:ports>
Nov 08 04:09:58 user nova-compute[75014]:         <nova:port uuid="2f8edc8d-688d-4218-8ab2-5d94deb36ec7">
Nov 08 04:09:58 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 04:09:58 user nova-compute[75014]:         </nova:port>
Nov 08 04:09:58 user nova-compute[75014]:       </nova:ports>
Nov 08 04:09:58 user nova-compute[75014]:     </nova:instance>
Nov 08 04:09:58 user nova-compute[75014]:   </metadata>
Nov 08 04:09:58 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:09:58 user nova-compute[75014]:     <system>
Nov 08 04:09:58 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:09:58 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:09:58 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:09:58 user nova-compute[75014]:       <entry name="serial">c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf</entry>
Nov 08 04:09:58 user nova-compute[75014]:       <entry name="uuid">c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf</entry>
Nov 08 04:09:58 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:09:58 user nova-compute[75014]:     </system>
Nov 08 04:09:58 user nova-compute[75014]:   </sysinfo>
Nov 08 04:09:58 user nova-compute[75014]:   <os>
Nov 08 04:09:58 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:09:58 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:09:58 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:09:58 user nova-compute[75014]:   </os>
Nov 08 04:09:58 user nova-compute[75014]:   <features>
Nov 08 04:09:58 user nova-compute[75014]:     <acpi/>
Nov 08 04:09:58 user nova-compute[75014]:     <apic/>
Nov 08 04:09:58 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:09:58 user nova-compute[75014]:   </features>
Nov 08 04:09:58 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:09:58 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:09:58 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:09:58 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:09:58 user nova-compute[75014]:   </clock>
Nov 08 04:09:58 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:09:58 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:09:58 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:09:58 user nova-compute[75014]:   </cpu>
Nov 08 04:09:58 user nova-compute[75014]:   <devices>
Nov 08 04:09:58 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 04:09:58 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 04:09:58 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf/disk"/>
Nov 08 04:09:58 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:09:58 user nova-compute[75014]:     </disk>
Nov 08 04:09:58 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:09:58 user nova-compute[75014]:       <mac address="fa:16:3e:bd:60:8b"/>
Nov 08 04:09:58 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:09:58 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:09:58 user nova-compute[75014]:       <target dev="tap2f8edc8d-68"/>
Nov 08 04:09:58 user nova-compute[75014]:     </interface>
Nov 08 04:09:58 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:09:58 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf/console.log" append="off"/>
Nov 08 04:09:58 user nova-compute[75014]:     </serial>
Nov 08 04:09:58 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:09:58 user nova-compute[75014]:     <video>
Nov 08 04:09:58 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:09:58 user nova-compute[75014]:     </video>
Nov 08 04:09:58 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:09:58 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:09:58 user nova-compute[75014]:     </rng>
Nov 08 04:09:58 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:09:58 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:09:58 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:09:58 user nova-compute[75014]:     </memballoon>
Nov 08 04:09:58 user nova-compute[75014]:   </devices>
Nov 08 04:09:58 user nova-compute[75014]: </domain>
Nov 08 04:09:58 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:09:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2078873129',display_name='tempest-VolumesActionsTest-instance-2078873129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2078873129',id=36,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='326f25150296480b99a0eca140f65204',ramdisk_id='',reservation_id='r-mebc0fg6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-777452474',owner_user_name='tempest-VolumesActionsTest-777452474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:09:56Z,user_data=None,user_id='b7841ea39b60405b87cc29a2b293ab10',uuid=c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f8edc8d-688d-4218-8ab2-5d94deb36ec7", "address": "fa:16:3e:bd:60:8b", "network": {"id": "5f4fdfa8-0690-4305-9eda-3abf64609f4c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1326493770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "326f25150296480b99a0eca140f65204", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8edc8d-68", "ovs_interfaceid": "2f8edc8d-688d-4218-8ab2-5d94deb36ec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Converting VIF {"id": "2f8edc8d-688d-4218-8ab2-5d94deb36ec7", "address": "fa:16:3e:bd:60:8b", "network": {"id": "5f4fdfa8-0690-4305-9eda-3abf64609f4c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1326493770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "326f25150296480b99a0eca140f65204", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8edc8d-68", "ovs_interfaceid": "2f8edc8d-688d-4218-8ab2-5d94deb36ec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:60:8b,bridge_name='br-int',has_traffic_filtering=True,id=2f8edc8d-688d-4218-8ab2-5d94deb36ec7,network=Network(5f4fdfa8-0690-4305-9eda-3abf64609f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8edc8d-68') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG os_vif [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:60:8b,bridge_name='br-int',has_traffic_filtering=True,id=2f8edc8d-688d-4218-8ab2-5d94deb36ec7,network=Network(5f4fdfa8-0690-4305-9eda-3abf64609f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8edc8d-68') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bb9578d8-89bb-5666-9a6d-e2f55080aff4', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f8edc8d-68, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f8edc8d-68, col_values=(('qos', UUID('a419c2cc-7011-4659-848d-b38b4970731c')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f8edc8d-68, col_values=(('external_ids', {'iface-id': '2f8edc8d-688d-4218-8ab2-5d94deb36ec7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:60:8b', 'vm-uuid': 'c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:58 user nova-compute[75014]: INFO os_vif [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:60:8b,bridge_name='br-int',has_traffic_filtering=True,id=2f8edc8d-688d-4218-8ab2-5d94deb36ec7,network=Network(5f4fdfa8-0690-4305-9eda-3abf64609f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8edc8d-68')
Nov 08 04:09:58 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:09:58 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] No VIF found with MAC fa:16:3e:bd:60:8b, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:09:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:09:59 user nova-compute[75014]: DEBUG nova.compute.manager [req-c438be26-e10d-48e2-8431-6d451f061238 req-5e00d43d-3fad-4074-b5e3-d6709b6c203e service nova] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Received event network-vif-plugged-2f8edc8d-688d-4218-8ab2-5d94deb36ec7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:09:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c438be26-e10d-48e2-8431-6d451f061238 req-5e00d43d-3fad-4074-b5e3-d6709b6c203e service nova] Acquiring lock "c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:09:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c438be26-e10d-48e2-8431-6d451f061238 req-5e00d43d-3fad-4074-b5e3-d6709b6c203e service nova] Lock "c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:09:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c438be26-e10d-48e2-8431-6d451f061238 req-5e00d43d-3fad-4074-b5e3-d6709b6c203e service nova] Lock "c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:09:59 user nova-compute[75014]: DEBUG nova.compute.manager [req-c438be26-e10d-48e2-8431-6d451f061238 req-5e00d43d-3fad-4074-b5e3-d6709b6c203e service nova] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] No waiting events found dispatching network-vif-plugged-2f8edc8d-688d-4218-8ab2-5d94deb36ec7 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:09:59 user nova-compute[75014]: WARNING nova.compute.manager [req-c438be26-e10d-48e2-8431-6d451f061238 req-5e00d43d-3fad-4074-b5e3-d6709b6c203e service nova] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Received unexpected event network-vif-plugged-2f8edc8d-688d-4218-8ab2-5d94deb36ec7 for instance with vm_state building and task_state spawning.
Nov 08 04:10:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:01 user nova-compute[75014]: DEBUG nova.compute.manager [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:10:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 04:10:01 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Instance spawned successfully.
Nov 08 04:10:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 04:10:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:10:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:10:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:10:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:10:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:10:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:10:01 user nova-compute[75014]: DEBUG nova.compute.manager [req-4402c1ba-3996-4305-a5c0-e8cd61d09bc9 req-f3abbc5b-f77d-4d8f-ab57-eeb5c2a3e241 service nova] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Received event network-vif-plugged-2f8edc8d-688d-4218-8ab2-5d94deb36ec7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:10:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4402c1ba-3996-4305-a5c0-e8cd61d09bc9 req-f3abbc5b-f77d-4d8f-ab57-eeb5c2a3e241 service nova] Acquiring lock "c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:10:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4402c1ba-3996-4305-a5c0-e8cd61d09bc9 req-f3abbc5b-f77d-4d8f-ab57-eeb5c2a3e241 service nova] Lock "c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:10:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4402c1ba-3996-4305-a5c0-e8cd61d09bc9 req-f3abbc5b-f77d-4d8f-ab57-eeb5c2a3e241 service nova] Lock "c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:10:01 user nova-compute[75014]: DEBUG nova.compute.manager [req-4402c1ba-3996-4305-a5c0-e8cd61d09bc9 req-f3abbc5b-f77d-4d8f-ab57-eeb5c2a3e241 service nova] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] No waiting events found dispatching network-vif-plugged-2f8edc8d-688d-4218-8ab2-5d94deb36ec7 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:10:01 user nova-compute[75014]: WARNING nova.compute.manager [req-4402c1ba-3996-4305-a5c0-e8cd61d09bc9 req-f3abbc5b-f77d-4d8f-ab57-eeb5c2a3e241 service nova] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Received unexpected event network-vif-plugged-2f8edc8d-688d-4218-8ab2-5d94deb36ec7 for instance with vm_state building and task_state spawning.
Nov 08 04:10:01 user nova-compute[75014]: INFO nova.compute.manager [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Took 5.68 seconds to spawn the instance on the hypervisor.
Nov 08 04:10:01 user nova-compute[75014]: DEBUG nova.compute.manager [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:10:01 user nova-compute[75014]: INFO nova.compute.manager [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Took 6.81 seconds to build instance.
Nov 08 04:10:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-14d6d4b1-fa7e-4c32-a969-7892389d4c50 tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Lock "c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.924s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:10:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:14 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1cb11358-b4c4-47f4-ba30-d967d523f98a is timed out.
Nov 08 04:10:14 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Successfully detached device vdb from instance 1cb11358-b4c4-47f4-ba30-d967d523f98a from the live domain config.
Nov 08 04:10:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AEvVGDJZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:10:14 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:10:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadff960-91cc-4dd3-b350-affaa63965c4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:10:14 user nova-compute[75014]: No targets found.
Nov 08 04:10:14 user nova-compute[75014]: iSNS:
Nov 08 04:10:14 user nova-compute[75014]: No targets found.
Nov 08 04:10:14 user nova-compute[75014]: STATIC:
Nov 08 04:10:14 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1
Nov 08 04:10:14 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:10:14 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:10:14 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec
Nov 08 04:10:14 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:10:14 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:10:14 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1
Nov 08 04:10:14 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:10:14 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:10:14 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:10:14 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:10:14 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:10:14 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb
Nov 08 04:10:14 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:10:14 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:10:14 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c
Nov 08 04:10:14 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:10:14 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:10:14 user nova-compute[75014]: FIRMWARE:
Nov 08 04:10:14 user nova-compute[75014]: No targets found.
Nov 08 04:10:14 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:10:14 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:10:14 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ff03a5-0b9a-49ee-aa1a-fc228dadc44d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c86db41-c408-4ce7-b82e-4db8a5feeed2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:10:14 user nova-compute[75014]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:10:14 user nova-compute[75014]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 (non-flash)
Nov 08 04:10:14 user nova-compute[75014]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)
Nov 08 04:10:14 user nova-compute[75014]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:10:14 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:10:14 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:10:14 user nova-compute[75014]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:10:14 user nova-compute[75014]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 (non-flash)
Nov 08 04:10:14 user nova-compute[75014]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)
Nov 08 04:10:14 user nova-compute[75014]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:10:14 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:10:14 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f040046d990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1'): ({'sde'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Removing single pathed devices sde {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9707e177-a1da-41e2-ad39-282cc428e2b2]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd01719-0d1b-4d14-b310-39e2abe9934f]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Flushing IO for device /dev/sde {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9c3109-0d6a-47b1-aae3-033b5873bccb]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.061s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ac98b2-2991-4a4a-9f4f-608109513c69]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] SCSI volumes sde have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10c69f8-da02-434f-9eb0-11728856b610]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bd3f02-c2db-4f27-ac8b-4b5287f1474e]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1, portal: 172.16.0.220,3260]
Nov 08 04:10:14 user nova-compute[75014]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1, portal: 172.16.0.220,3260] successful.
Nov 08 04:10:14 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8264111-54e5-4c2a-8d7d-0db682ec810c]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] <== disconnect_volume: return (333ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:10:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:10:16 user nova-compute[75014]: DEBUG nova.objects.instance [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lazy-loading 'flavor' on Instance uuid 1cb11358-b4c4-47f4-ba30-d967d523f98a {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:10:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-99fe9c6f-b95c-4de1-b7ab-289ba8883afd tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "1cb11358-b4c4-47f4-ba30-d967d523f98a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.729s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:10:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "1cb11358-b4c4-47f4-ba30-d967d523f98a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.584s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:10:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquiring lock "1cb11358-b4c4-47f4-ba30-d967d523f98a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:10:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "1cb11358-b4c4-47f4-ba30-d967d523f98a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:10:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "1cb11358-b4c4-47f4-ba30-d967d523f98a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:10:16 user nova-compute[75014]: INFO nova.compute.manager [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Terminating instance
Nov 08 04:10:16 user nova-compute[75014]: DEBUG nova.compute.manager [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:10:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:16 user nova-compute[75014]: DEBUG nova.compute.manager [req-760be427-9873-4373-ad0f-a0a17ec624f1 req-7667015e-eafe-44a7-bf2c-966d588f3f81 service nova] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Received event network-vif-unplugged-fa9015d5-2c52-4575-a315-a082c02593eb {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:10:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-760be427-9873-4373-ad0f-a0a17ec624f1 req-7667015e-eafe-44a7-bf2c-966d588f3f81 service nova] Acquiring lock "1cb11358-b4c4-47f4-ba30-d967d523f98a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:10:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-760be427-9873-4373-ad0f-a0a17ec624f1 req-7667015e-eafe-44a7-bf2c-966d588f3f81 service nova] Lock "1cb11358-b4c4-47f4-ba30-d967d523f98a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:10:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-760be427-9873-4373-ad0f-a0a17ec624f1 req-7667015e-eafe-44a7-bf2c-966d588f3f81 service nova] Lock "1cb11358-b4c4-47f4-ba30-d967d523f98a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:10:16 user nova-compute[75014]: DEBUG nova.compute.manager [req-760be427-9873-4373-ad0f-a0a17ec624f1 req-7667015e-eafe-44a7-bf2c-966d588f3f81 service nova] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] No waiting events found dispatching network-vif-unplugged-fa9015d5-2c52-4575-a315-a082c02593eb {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:10:16 user nova-compute[75014]: DEBUG nova.compute.manager [req-760be427-9873-4373-ad0f-a0a17ec624f1 req-7667015e-eafe-44a7-bf2c-966d588f3f81 service nova] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Received event network-vif-unplugged-fa9015d5-2c52-4575-a315-a082c02593eb for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:10:16 user nova-compute[75014]: DEBUG nova.compute.manager [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 04:10:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 04:10:16 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Creating image(s)
Nov 08 04:10:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Did not create local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 04:10:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Ensure instance console log exists: /opt/stack/data/nova/instances/ace7e2f7-28c3-41e3-b92b-05e834c3968c/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:10:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:10:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:10:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:10:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Start _get_guest_xml network_info=[{"id": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "address": "fa:16:3e:9c:4b:98", "network": {"id": "11cfca93-63ac-49c6-8cf8-2c7885e21563", "bridge": "br-int", "label": "tempest-TestShelveInstance-1503372709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0174a3477d45e1a6aa8a405b0027b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe677fa-7b", "ovs_interfaceid": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zoZcGiyA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ace7e2f7-28c3-41e3-b92b-05e834c3968c', 'attached_at': '', 'detached_at': '', 'volume_id': 'e0ec0452-90f2-48e1-b99a-b6a460342437', 'serial': 'e0ec0452-90f2-48e1-b99a-b6a460342437'}, 'device_type': 'disk', 'attachment_id': '70c01e55-a5e4-4b33-8965-166f4045d953', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:10:16 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:10:16 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:10:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zoZcGiyA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:10:17 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:10:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:10:17 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:10:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:10:17 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9f6bcf-8fef-4b75-8788-3013272851c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:10:17 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e984865-fd82-47ec-b0bc-f6d0736c0419]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437] added
Nov 08 04:10:17 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9a4557-7f5b-47ed-833c-0a618697636d]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:17 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Instance destroyed successfully.
Nov 08 04:10:17 user nova-compute[75014]: DEBUG nova.objects.instance [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lazy-loading 'resources' on Instance uuid 1cb11358-b4c4-47f4-ba30-d967d523f98a {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4d556d-58cd-4df1-8acd-3b55c6c0cce9]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:04:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-590403129',display_name='tempest-VolumesSnapshotTestJSON-instance-590403129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-590403129',id=32,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApwxl/mV6D1jStTryfmCuT7MAnpPlgePGA85/dzLF5MWHoUHVI1tIXZQUCSRXX3Ii4AS0IiTpCqTqIzf5+d4hwBDeNcdKfVCSV9GeeBTZFFBQoBFTkZ2SvAV9ZYlQmdQw==',key_name='tempest-keypair-47994009',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:05:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e5003c0e79d42248cd1ff8be29fe3b0',ramdisk_id='',reservation_id='r-8jumx3qd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-334487690',owner_user_name='tempest-VolumesSnapshotTestJSON-334487690-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:05:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74a3234564994ff7a7c7fc6166e16aef',uuid=1cb11358-b4c4-47f4-ba30-d967d523f98a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa9015d5-2c52-4575-a315-a082c02593eb", "address": "fa:16:3e:3c:38:9c", "network": {"id": "25bc77a0-1460-485f-a61a-a43843631782", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-430613931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e5003c0e79d42248cd1ff8be29fe3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa9015d5-2c", "ovs_interfaceid": "fa9015d5-2c52-4575-a315-a082c02593eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Converting VIF {"id": "fa9015d5-2c52-4575-a315-a082c02593eb", "address": "fa:16:3e:3c:38:9c", "network": {"id": "25bc77a0-1460-485f-a61a-a43843631782", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-430613931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e5003c0e79d42248cd1ff8be29fe3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa9015d5-2c", "ovs_interfaceid": "fa9015d5-2c52-4575-a315-a082c02593eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:38:9c,bridge_name='br-int',has_traffic_filtering=True,id=fa9015d5-2c52-4575-a315-a082c02593eb,network=Network(25bc77a0-1460-485f-a61a-a43843631782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa9015d5-2c') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG os_vif [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:38:9c,bridge_name='br-int',has_traffic_filtering=True,id=fa9015d5-2c52-4575-a315-a082c02593eb,network=Network(25bc77a0-1460-485f-a61a-a43843631782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa9015d5-2c') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zoZcGiyA {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa9015d5-2c, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=165e31a8-05ce-4597-b527-fc2eb227e64d) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:17 user nova-compute[75014]: INFO os_vif [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:38:9c,bridge_name='br-int',has_traffic_filtering=True,id=fa9015d5-2c52-4575-a315-a082c02593eb,network=Network(25bc77a0-1460-485f-a61a-a43843631782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa9015d5-2c')
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zoZcGiyA" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d31c94-183c-42ed-8bff-fd98c2b617c0]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zoZcGiyA'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AEvVGDJZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:10:17 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:10:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ce1302-bb29-4769-80b6-758ddd9e6269]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b59c16-f3e5-40ea-8eea-d2404f77aa74]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:10:17 user nova-compute[75014]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:10:17 user nova-compute[75014]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)
Nov 08 04:10:17 user nova-compute[75014]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:10:17 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:10:17 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:10:17 user nova-compute[75014]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:10:17 user nova-compute[75014]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)
Nov 08 04:10:17 user nova-compute[75014]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:10:17 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:10:17 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95549f2-acc2-46a3-98eb-999b1656afeb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437, portal: 172.16.0.220,3260]
Nov 08 04:10:17 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437, portal: 172.16.0.220,3260] successful.
Nov 08 04:10:17 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1497b3f1-a33e-421c-a9bb-1dd26b249674]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f07812b-67b6-44a8-87b8-b06b32d9cb66]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:10:17 user nova-compute[75014]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:10:17 user nova-compute[75014]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)
Nov 08 04:10:17 user nova-compute[75014]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:10:17 user nova-compute[75014]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)
Nov 08 04:10:17 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:10:17 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:10:17 user nova-compute[75014]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:10:17 user nova-compute[75014]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)
Nov 08 04:10:17 user nova-compute[75014]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:10:17 user nova-compute[75014]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)
Nov 08 04:10:17 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:10:17 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[94074a77-310c-4e61-98d1-105b5c9bf55f]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zoZcGiyA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:10:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26362323930666465', 'path': '/dev/sde'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362323930666465', 'path': '/dev/sde'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.222s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:09:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1114062548',display_name='tempest-TestShelveInstance-server-1114062548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1114062548',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDciRwDmkXIWJ59cSwLkrq0g6fRWYu1rgIHdChGoGUVHZISbu0npqT6Q3VTBlFFTYXtLW//rqLSyyNUm93IqVTTPMb/uBRfKBfBqHi/1FWKNAmj/2k9FvggMVKvEN4GfIA==',key_name='tempest-TestShelveInstance-26222747',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad0174a3477d45e1a6aa8a405b0027b8',ramdisk_id='',reservation_id='r-v4udig5g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-958337227',owner_user_name='tempest-TestShelveInstance-958337227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:09:42Z,user_data=None,user_id='58b14797a2974cb19e3759f51c391509',uuid=ace7e2f7-28c3-41e3-b92b-05e834c3968c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "address": "fa:16:3e:9c:4b:98", "network": {"id": "11cfca93-63ac-49c6-8cf8-2c7885e21563", "bridge": "br-int", "label": "tempest-TestShelveInstance-1503372709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0174a3477d45e1a6aa8a405b0027b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe677fa-7b", "ovs_interfaceid": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Converting VIF {"id": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "address": "fa:16:3e:9c:4b:98", "network": {"id": "11cfca93-63ac-49c6-8cf8-2c7885e21563", "bridge": "br-int", "label": "tempest-TestShelveInstance-1503372709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0174a3477d45e1a6aa8a405b0027b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe677fa-7b", "ovs_interfaceid": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:4b:98,bridge_name='br-int',has_traffic_filtering=True,id=0fe677fa-7bc0-4ab0-abe1-4078284cb71a,network=Network(11cfca93-63ac-49c6-8cf8-2c7885e21563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe677fa-7b') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG nova.objects.instance [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lazy-loading 'pci_devices' on Instance uuid ace7e2f7-28c3-41e3-b92b-05e834c3968c {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bef8bf0-d887-48b3-adb1-a6e1d4373dea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:10:18 user nova-compute[75014]: No targets found.
Nov 08 04:10:18 user nova-compute[75014]: iSNS:
Nov 08 04:10:18 user nova-compute[75014]: No targets found.
Nov 08 04:10:18 user nova-compute[75014]: STATIC:
Nov 08 04:10:18 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec
Nov 08 04:10:18 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:10:18 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:10:18 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1
Nov 08 04:10:18 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:10:18 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:10:18 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:10:18 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:10:18 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:10:18 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb
Nov 08 04:10:18 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:10:18 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:10:18 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c
Nov 08 04:10:18 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:10:18 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:10:18 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437
Nov 08 04:10:18 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:10:18 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:10:18 user nova-compute[75014]: FIRMWARE:
Nov 08 04:10:18 user nova-compute[75014]: No targets found.
Nov 08 04:10:18 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:10:18 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:10:18 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c809a55c-75e5-4e8f-950f-845b6594a5b1', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:10:18 user nova-compute[75014]:   <uuid>ace7e2f7-28c3-41e3-b92b-05e834c3968c</uuid>
Nov 08 04:10:18 user nova-compute[75014]:   <name>instance-00000023</name>
Nov 08 04:10:18 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:10:18 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:10:18 user nova-compute[75014]:   <metadata>
Nov 08 04:10:18 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:10:18 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:10:18 user nova-compute[75014]:       <nova:name>tempest-TestShelveInstance-server-1114062548</nova:name>
Nov 08 04:10:18 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:10:16</nova:creationTime>
Nov 08 04:10:18 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:10:18 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:10:18 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:10:18 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:10:18 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:10:18 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:10:18 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:10:18 user nova-compute[75014]:       <nova:owner>
Nov 08 04:10:18 user nova-compute[75014]:         <nova:user uuid="58b14797a2974cb19e3759f51c391509">tempest-TestShelveInstance-958337227-project-member</nova:user>
Nov 08 04:10:18 user nova-compute[75014]:         <nova:project uuid="ad0174a3477d45e1a6aa8a405b0027b8">tempest-TestShelveInstance-958337227</nova:project>
Nov 08 04:10:18 user nova-compute[75014]:       </nova:owner>
Nov 08 04:10:18 user nova-compute[75014]:       <nova:ports>
Nov 08 04:10:18 user nova-compute[75014]:         <nova:port uuid="0fe677fa-7bc0-4ab0-abe1-4078284cb71a">
Nov 08 04:10:18 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 04:10:18 user nova-compute[75014]:         </nova:port>
Nov 08 04:10:18 user nova-compute[75014]:       </nova:ports>
Nov 08 04:10:18 user nova-compute[75014]:     </nova:instance>
Nov 08 04:10:18 user nova-compute[75014]:   </metadata>
Nov 08 04:10:18 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:10:18 user nova-compute[75014]:     <system>
Nov 08 04:10:18 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:10:18 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:10:18 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:10:18 user nova-compute[75014]:       <entry name="serial">ace7e2f7-28c3-41e3-b92b-05e834c3968c</entry>
Nov 08 04:10:18 user nova-compute[75014]:       <entry name="uuid">ace7e2f7-28c3-41e3-b92b-05e834c3968c</entry>
Nov 08 04:10:18 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:10:18 user nova-compute[75014]:     </system>
Nov 08 04:10:18 user nova-compute[75014]:   </sysinfo>
Nov 08 04:10:18 user nova-compute[75014]:   <os>
Nov 08 04:10:18 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:10:18 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:10:18 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:10:18 user nova-compute[75014]:   </os>
Nov 08 04:10:18 user nova-compute[75014]:   <features>
Nov 08 04:10:18 user nova-compute[75014]:     <acpi/>
Nov 08 04:10:18 user nova-compute[75014]:     <apic/>
Nov 08 04:10:18 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:10:18 user nova-compute[75014]:   </features>
Nov 08 04:10:18 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:10:18 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:10:18 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:10:18 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:10:18 user nova-compute[75014]:   </clock>
Nov 08 04:10:18 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:10:18 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:10:18 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:10:18 user nova-compute[75014]:   </cpu>
Nov 08 04:10:18 user nova-compute[75014]:   <devices>
Nov 08 04:10:18 user nova-compute[75014]:     <disk type="block" device="disk">
Nov 08 04:10:18 user nova-compute[75014]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:10:18 user nova-compute[75014]:       <source dev="/dev/sde"/>
Nov 08 04:10:18 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:10:18 user nova-compute[75014]:       <serial>e0ec0452-90f2-48e1-b99a-b6a460342437</serial>
Nov 08 04:10:18 user nova-compute[75014]:     </disk>
Nov 08 04:10:18 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:10:18 user nova-compute[75014]:       <mac address="fa:16:3e:9c:4b:98"/>
Nov 08 04:10:18 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:10:18 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:10:18 user nova-compute[75014]:       <target dev="tap0fe677fa-7b"/>
Nov 08 04:10:18 user nova-compute[75014]:     </interface>
Nov 08 04:10:18 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:10:18 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/ace7e2f7-28c3-41e3-b92b-05e834c3968c/console.log" append="off"/>
Nov 08 04:10:18 user nova-compute[75014]:     </serial>
Nov 08 04:10:18 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:10:18 user nova-compute[75014]:     <video>
Nov 08 04:10:18 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:10:18 user nova-compute[75014]:     </video>
Nov 08 04:10:18 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:10:18 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:10:18 user nova-compute[75014]:     </rng>
Nov 08 04:10:18 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:10:18 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:10:18 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:10:18 user nova-compute[75014]:     </memballoon>
Nov 08 04:10:18 user nova-compute[75014]:   </devices>
Nov 08 04:10:18 user nova-compute[75014]: </domain>
Nov 08 04:10:18 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:09:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1114062548',display_name='tempest-TestShelveInstance-server-1114062548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1114062548',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDciRwDmkXIWJ59cSwLkrq0g6fRWYu1rgIHdChGoGUVHZISbu0npqT6Q3VTBlFFTYXtLW//rqLSyyNUm93IqVTTPMb/uBRfKBfBqHi/1FWKNAmj/2k9FvggMVKvEN4GfIA==',key_name='tempest-TestShelveInstance-26222747',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad0174a3477d45e1a6aa8a405b0027b8',ramdisk_id='',reservation_id='r-v4udig5g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-958337227',owner_user_name='tempest-TestShelveInstance-958337227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:09:42Z,user_data=None,user_id='58b14797a2974cb19e3759f51c391509',uuid=ace7e2f7-28c3-41e3-b92b-05e834c3968c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "address": "fa:16:3e:9c:4b:98", "network": {"id": "11cfca93-63ac-49c6-8cf8-2c7885e21563", "bridge": "br-int", "label": "tempest-TestShelveInstance-1503372709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0174a3477d45e1a6aa8a405b0027b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe677fa-7b", "ovs_interfaceid": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Converting VIF {"id": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "address": "fa:16:3e:9c:4b:98", "network": {"id": "11cfca93-63ac-49c6-8cf8-2c7885e21563", "bridge": "br-int", "label": "tempest-TestShelveInstance-1503372709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0174a3477d45e1a6aa8a405b0027b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe677fa-7b", "ovs_interfaceid": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:4b:98,bridge_name='br-int',has_traffic_filtering=True,id=0fe677fa-7bc0-4ab0-abe1-4078284cb71a,network=Network(11cfca93-63ac-49c6-8cf8-2c7885e21563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe677fa-7b') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG os_vif [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:4b:98,bridge_name='br-int',has_traffic_filtering=True,id=0fe677fa-7bc0-4ab0-abe1-4078284cb71a,network=Network(11cfca93-63ac-49c6-8cf8-2c7885e21563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe677fa-7b') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '89ec231d-9d9c-5ce4-bbe1-d3e1c7c59e1b', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0fe677fa-7b, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0fe677fa-7b, col_values=(('qos', UUID('ea7a7fee-7ffe-452c-92af-1a4e1eb8f079')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0fe677fa-7b, col_values=(('external_ids', {'iface-id': '0fe677fa-7bc0-4ab0-abe1-4078284cb71a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:4b:98', 'vm-uuid': 'ace7e2f7-28c3-41e3-b92b-05e834c3968c'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8657d651-7409-4ba6-8559-1f9dfc84f64b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:18 user nova-compute[75014]: INFO os_vif [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:4b:98,bridge_name='br-int',has_traffic_filtering=True,id=0fe677fa-7bc0-4ab0-abe1-4078284cb71a,network=Network(11cfca93-63ac-49c6-8cf8-2c7885e21563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe677fa-7b')
Nov 08 04:10:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a95599f-aba4-4c15-9d0f-b23488a032a5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:10:18 user nova-compute[75014]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:10:18 user nova-compute[75014]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)
Nov 08 04:10:18 user nova-compute[75014]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:10:18 user nova-compute[75014]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)
Nov 08 04:10:18 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:10:18 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:10:18 user nova-compute[75014]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:10:18 user nova-compute[75014]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)
Nov 08 04:10:18 user nova-compute[75014]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:10:18 user nova-compute[75014]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)
Nov 08 04:10:18 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:10:18 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f04183c12d0>, {}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Disconnecting from: [] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.099s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] <== disconnect_volume: return (1321ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:10:18 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Deleting instance files /opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a_del
Nov 08 04:10:18 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Deletion of /opt/stack/data/nova/instances/1cb11358-b4c4-47f4-ba30-d967d523f98a_del complete
Nov 08 04:10:18 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] No VIF found with MAC fa:16:3e:9c:4b:98, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:10:18 user nova-compute[75014]: INFO nova.compute.manager [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Took 2.20 seconds to destroy the instance on the hypervisor.
Nov 08 04:10:18 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG nova.compute.manager [req-07f25cdc-9fdb-4afd-8cda-6dce9c177b91 req-00266e43-d3b7-4f2d-9df0-9cae8d3908ad service nova] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Received event network-vif-plugged-fa9015d5-2c52-4575-a315-a082c02593eb {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-07f25cdc-9fdb-4afd-8cda-6dce9c177b91 req-00266e43-d3b7-4f2d-9df0-9cae8d3908ad service nova] Acquiring lock "1cb11358-b4c4-47f4-ba30-d967d523f98a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-07f25cdc-9fdb-4afd-8cda-6dce9c177b91 req-00266e43-d3b7-4f2d-9df0-9cae8d3908ad service nova] Lock "1cb11358-b4c4-47f4-ba30-d967d523f98a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-07f25cdc-9fdb-4afd-8cda-6dce9c177b91 req-00266e43-d3b7-4f2d-9df0-9cae8d3908ad service nova] Lock "1cb11358-b4c4-47f4-ba30-d967d523f98a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:10:18 user nova-compute[75014]: DEBUG nova.compute.manager [req-07f25cdc-9fdb-4afd-8cda-6dce9c177b91 req-00266e43-d3b7-4f2d-9df0-9cae8d3908ad service nova] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] No waiting events found dispatching network-vif-plugged-fa9015d5-2c52-4575-a315-a082c02593eb {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:10:18 user nova-compute[75014]: WARNING nova.compute.manager [req-07f25cdc-9fdb-4afd-8cda-6dce9c177b91 req-00266e43-d3b7-4f2d-9df0-9cae8d3908ad service nova] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Received unexpected event network-vif-plugged-fa9015d5-2c52-4575-a315-a082c02593eb for instance with vm_state active and task_state deleting.
Nov 08 04:10:19 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:10:19 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Took 0.77 seconds to deallocate network for instance.
Nov 08 04:10:19 user nova-compute[75014]: WARNING nova.volume.cinder [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Attachment 96cc4516-39de-4e39-bdd7-828e38bb809f does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 96cc4516-39de-4e39-bdd7-828e38bb809f. (HTTP 404) (Request-ID: req-359ff42c-9317-4ad3-8055-1148823e1dbd)
Nov 08 04:10:19 user nova-compute[75014]: INFO nova.compute.manager [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Took 0.04 seconds to detach 1 volumes for instance.
Nov 08 04:10:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:10:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:10:19 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:10:19 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:10:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:10:19 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Deleted allocations for instance 1cb11358-b4c4-47f4-ba30-d967d523f98a
Nov 08 04:10:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e8aceb2c-8544-4625-9d0d-56e82aee1469 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "1cb11358-b4c4-47f4-ba30-d967d523f98a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.547s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:10:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:20 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:20 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:20 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:20 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-21f7a11d-6b32-4a6d-816f-9e70f3659a52 req-29016826-b0d9-4fcf-b2a3-71db20437ffe service nova] [instance: 1cb11358-b4c4-47f4-ba30-d967d523f98a] Received event network-vif-deleted-fa9015d5-2c52-4575-a315-a082c02593eb {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:10:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-21f7a11d-6b32-4a6d-816f-9e70f3659a52 req-29016826-b0d9-4fcf-b2a3-71db20437ffe service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Received event network-vif-plugged-0fe677fa-7bc0-4ab0-abe1-4078284cb71a {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:10:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-21f7a11d-6b32-4a6d-816f-9e70f3659a52 req-29016826-b0d9-4fcf-b2a3-71db20437ffe service nova] Acquiring lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:10:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-21f7a11d-6b32-4a6d-816f-9e70f3659a52 req-29016826-b0d9-4fcf-b2a3-71db20437ffe service nova] Lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:10:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-21f7a11d-6b32-4a6d-816f-9e70f3659a52 req-29016826-b0d9-4fcf-b2a3-71db20437ffe service nova] Lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:10:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-21f7a11d-6b32-4a6d-816f-9e70f3659a52 req-29016826-b0d9-4fcf-b2a3-71db20437ffe service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] No waiting events found dispatching network-vif-plugged-0fe677fa-7bc0-4ab0-abe1-4078284cb71a {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:10:20 user nova-compute[75014]: WARNING nova.compute.manager [req-21f7a11d-6b32-4a6d-816f-9e70f3659a52 req-29016826-b0d9-4fcf-b2a3-71db20437ffe service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Received unexpected event network-vif-plugged-0fe677fa-7bc0-4ab0-abe1-4078284cb71a for instance with vm_state building and task_state spawning.
Nov 08 04:10:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-21f7a11d-6b32-4a6d-816f-9e70f3659a52 req-29016826-b0d9-4fcf-b2a3-71db20437ffe service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Received event network-vif-plugged-0fe677fa-7bc0-4ab0-abe1-4078284cb71a {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:10:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-21f7a11d-6b32-4a6d-816f-9e70f3659a52 req-29016826-b0d9-4fcf-b2a3-71db20437ffe service nova] Acquiring lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:10:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-21f7a11d-6b32-4a6d-816f-9e70f3659a52 req-29016826-b0d9-4fcf-b2a3-71db20437ffe service nova] Lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:10:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-21f7a11d-6b32-4a6d-816f-9e70f3659a52 req-29016826-b0d9-4fcf-b2a3-71db20437ffe service nova] Lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:10:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-21f7a11d-6b32-4a6d-816f-9e70f3659a52 req-29016826-b0d9-4fcf-b2a3-71db20437ffe service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] No waiting events found dispatching network-vif-plugged-0fe677fa-7bc0-4ab0-abe1-4078284cb71a {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:10:20 user nova-compute[75014]: WARNING nova.compute.manager [req-21f7a11d-6b32-4a6d-816f-9e70f3659a52 req-29016826-b0d9-4fcf-b2a3-71db20437ffe service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Received unexpected event network-vif-plugged-0fe677fa-7bc0-4ab0-abe1-4078284cb71a for instance with vm_state building and task_state spawning.
Nov 08 04:10:22 user nova-compute[75014]: DEBUG nova.compute.manager [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:10:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 04:10:22 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Instance spawned successfully.
Nov 08 04:10:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 04:10:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:10:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:10:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:10:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:10:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:10:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:10:22 user nova-compute[75014]: INFO nova.compute.manager [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Took 5.29 seconds to spawn the instance on the hypervisor.
Nov 08 04:10:22 user nova-compute[75014]: DEBUG nova.compute.manager [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:10:22 user nova-compute[75014]: INFO nova.compute.manager [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Took 40.75 seconds to build instance.
Nov 08 04:10:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-de72a977-edf4-4916-8cb6-f73f9b80e919 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 40.868s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:10:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:24 user nova-compute[75014]: DEBUG nova.compute.manager [req-f39d0778-145c-4080-ab2e-35b7a4734f11 req-ee0d92e1-4095-4f74-add9-988245db0274 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Received event network-changed-f85faa29-4fe7-4ef1-b746-a1bcad900d9f {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:10:24 user nova-compute[75014]: DEBUG nova.compute.manager [req-f39d0778-145c-4080-ab2e-35b7a4734f11 req-ee0d92e1-4095-4f74-add9-988245db0274 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Refreshing instance network info cache due to event network-changed-f85faa29-4fe7-4ef1-b746-a1bcad900d9f. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:10:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f39d0778-145c-4080-ab2e-35b7a4734f11 req-ee0d92e1-4095-4f74-add9-988245db0274 service nova] Acquiring lock "refresh_cache-449e9147-efe0-4aa1-af52-557e313bf7fe" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:10:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f39d0778-145c-4080-ab2e-35b7a4734f11 req-ee0d92e1-4095-4f74-add9-988245db0274 service nova] Acquired lock "refresh_cache-449e9147-efe0-4aa1-af52-557e313bf7fe" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:10:24 user nova-compute[75014]: DEBUG nova.network.neutron [req-f39d0778-145c-4080-ab2e-35b7a4734f11 req-ee0d92e1-4095-4f74-add9-988245db0274 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Refreshing network info cache for port f85faa29-4fe7-4ef1-b746-a1bcad900d9f {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:10:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "36a4109b-f239-48ce-ad49-e640a12a73bf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:10:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "36a4109b-f239-48ce-ad49-e640a12a73bf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:10:24 user nova-compute[75014]: INFO nova.compute.manager [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Detaching volume d6e20ff7-58e6-4de5-8680-e6b29925cfcb
Nov 08 04:10:25 user nova-compute[75014]: INFO nova.virt.block_device [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Attempting to driver detach volume d6e20ff7-58e6-4de5-8680-e6b29925cfcb from mountpoint /dev/vdb
Nov 08 04:10:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Attempting to detach device vdb from instance 36a4109b-f239-48ce-ad49-e640a12a73bf from the persistent domain config. {{(pid=75014) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 04:10:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:10:25 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:10:25 user nova-compute[75014]:   <source dev="/dev/sdb"/>
Nov 08 04:10:25 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:10:25 user nova-compute[75014]:   <serial>d6e20ff7-58e6-4de5-8680-e6b29925cfcb</serial>
Nov 08 04:10:25 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 04:10:25 user nova-compute[75014]: </disk>
Nov 08 04:10:25 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:10:25 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Successfully detached device vdb from instance 36a4109b-f239-48ce-ad49-e640a12a73bf from the persistent domain config.
Nov 08 04:10:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 36a4109b-f239-48ce-ad49-e640a12a73bf from the live domain config. {{(pid=75014) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 04:10:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:10:25 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:10:25 user nova-compute[75014]:   <source dev="/dev/sdb"/>
Nov 08 04:10:25 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:10:25 user nova-compute[75014]:   <serial>d6e20ff7-58e6-4de5-8680-e6b29925cfcb</serial>
Nov 08 04:10:25 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 04:10:25 user nova-compute[75014]: </disk>
Nov 08 04:10:25 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:10:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 36a4109b-f239-48ce-ad49-e640a12a73bf {{(pid=75014) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 04:10:25 user nova-compute[75014]: DEBUG nova.network.neutron [req-f39d0778-145c-4080-ab2e-35b7a4734f11 req-ee0d92e1-4095-4f74-add9-988245db0274 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Updated VIF entry in instance network info cache for port f85faa29-4fe7-4ef1-b746-a1bcad900d9f. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:10:25 user nova-compute[75014]: DEBUG nova.network.neutron [req-f39d0778-145c-4080-ab2e-35b7a4734f11 req-ee0d92e1-4095-4f74-add9-988245db0274 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Updating instance_info_cache with network_info: [{"id": "f85faa29-4fe7-4ef1-b746-a1bcad900d9f", "address": "fa:16:3e:e3:84:5d", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85faa29-4f", "ovs_interfaceid": "f85faa29-4fe7-4ef1-b746-a1bcad900d9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:10:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f39d0778-145c-4080-ab2e-35b7a4734f11 req-ee0d92e1-4095-4f74-add9-988245db0274 service nova] Releasing lock "refresh_cache-449e9147-efe0-4aa1-af52-557e313bf7fe" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:10:26 user nova-compute[75014]: DEBUG nova.compute.manager [req-1f3ce348-1021-4a6a-9841-e284622690e7 req-8886842e-ed3e-445c-b378-104753222623 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Received event network-changed-f85faa29-4fe7-4ef1-b746-a1bcad900d9f {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:10:26 user nova-compute[75014]: DEBUG nova.compute.manager [req-1f3ce348-1021-4a6a-9841-e284622690e7 req-8886842e-ed3e-445c-b378-104753222623 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Refreshing instance network info cache due to event network-changed-f85faa29-4fe7-4ef1-b746-a1bcad900d9f. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:10:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1f3ce348-1021-4a6a-9841-e284622690e7 req-8886842e-ed3e-445c-b378-104753222623 service nova] Acquiring lock "refresh_cache-449e9147-efe0-4aa1-af52-557e313bf7fe" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:10:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1f3ce348-1021-4a6a-9841-e284622690e7 req-8886842e-ed3e-445c-b378-104753222623 service nova] Acquired lock "refresh_cache-449e9147-efe0-4aa1-af52-557e313bf7fe" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:10:26 user nova-compute[75014]: DEBUG nova.network.neutron [req-1f3ce348-1021-4a6a-9841-e284622690e7 req-8886842e-ed3e-445c-b378-104753222623 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Refreshing network info cache for port f85faa29-4fe7-4ef1-b746-a1bcad900d9f {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:10:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "449e9147-efe0-4aa1-af52-557e313bf7fe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:10:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "449e9147-efe0-4aa1-af52-557e313bf7fe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:10:26 user nova-compute[75014]: INFO nova.compute.manager [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Detaching volume 9adf5c03-4d4d-44d3-ac4e-835bc141e45c
Nov 08 04:10:26 user nova-compute[75014]: INFO nova.virt.block_device [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Attempting to driver detach volume 9adf5c03-4d4d-44d3-ac4e-835bc141e45c from mountpoint /dev/vdb
Nov 08 04:10:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Attempting to detach device vdb from instance 449e9147-efe0-4aa1-af52-557e313bf7fe from the persistent domain config. {{(pid=75014) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 04:10:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:10:26 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:10:26 user nova-compute[75014]:   <source dev="/dev/sdf"/>
Nov 08 04:10:26 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:10:26 user nova-compute[75014]:   <serial>9adf5c03-4d4d-44d3-ac4e-835bc141e45c</serial>
Nov 08 04:10:26 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:10:26 user nova-compute[75014]: </disk>
Nov 08 04:10:26 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:10:26 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Successfully detached device vdb from instance 449e9147-efe0-4aa1-af52-557e313bf7fe from the persistent domain config.
Nov 08 04:10:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 449e9147-efe0-4aa1-af52-557e313bf7fe from the live domain config. {{(pid=75014) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 04:10:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:10:26 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:10:26 user nova-compute[75014]:   <source dev="/dev/sdf"/>
Nov 08 04:10:26 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:10:26 user nova-compute[75014]:   <serial>9adf5c03-4d4d-44d3-ac4e-835bc141e45c</serial>
Nov 08 04:10:26 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:10:26 user nova-compute[75014]: </disk>
Nov 08 04:10:26 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:10:26 user nova-compute[75014]: DEBUG nova.network.neutron [req-1f3ce348-1021-4a6a-9841-e284622690e7 req-8886842e-ed3e-445c-b378-104753222623 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Updated VIF entry in instance network info cache for port f85faa29-4fe7-4ef1-b746-a1bcad900d9f. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:10:26 user nova-compute[75014]: DEBUG nova.network.neutron [req-1f3ce348-1021-4a6a-9841-e284622690e7 req-8886842e-ed3e-445c-b378-104753222623 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Updating instance_info_cache with network_info: [{"id": "f85faa29-4fe7-4ef1-b746-a1bcad900d9f", "address": "fa:16:3e:e3:84:5d", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85faa29-4f", "ovs_interfaceid": "f85faa29-4fe7-4ef1-b746-a1bcad900d9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:10:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1f3ce348-1021-4a6a-9841-e284622690e7 req-8886842e-ed3e-445c-b378-104753222623 service nova] Releasing lock "refresh_cache-449e9147-efe0-4aa1-af52-557e313bf7fe" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:10:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 449e9147-efe0-4aa1-af52-557e313bf7fe {{(pid=75014) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 04:10:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "781932ce-0bea-466f-95e0-066130d6c410" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:10:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "781932ce-0bea-466f-95e0-066130d6c410" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:10:29 user nova-compute[75014]: INFO nova.compute.manager [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Detaching volume f251c6de-c866-429b-b113-b67a97cf79f1
Nov 08 04:10:29 user nova-compute[75014]: INFO nova.virt.block_device [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Attempting to driver detach volume f251c6de-c866-429b-b113-b67a97cf79f1 from mountpoint /dev/vdb
Nov 08 04:10:29 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Attempting to detach device vdb from instance 781932ce-0bea-466f-95e0-066130d6c410 from the persistent domain config. {{(pid=75014) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 04:10:29 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:10:29 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:10:29 user nova-compute[75014]:   <source dev="/dev/sdd"/>
Nov 08 04:10:29 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:10:29 user nova-compute[75014]:   <serial>f251c6de-c866-429b-b113-b67a97cf79f1</serial>
Nov 08 04:10:29 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 04:10:29 user nova-compute[75014]: </disk>
Nov 08 04:10:29 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:10:29 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Successfully detached device vdb from instance 781932ce-0bea-466f-95e0-066130d6c410 from the persistent domain config.
Nov 08 04:10:29 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 781932ce-0bea-466f-95e0-066130d6c410 from the live domain config. {{(pid=75014) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 04:10:29 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:10:29 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:10:29 user nova-compute[75014]:   <source dev="/dev/sdd"/>
Nov 08 04:10:29 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:10:29 user nova-compute[75014]:   <serial>f251c6de-c866-429b-b113-b67a97cf79f1</serial>
Nov 08 04:10:29 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 04:10:29 user nova-compute[75014]: </disk>
Nov 08 04:10:29 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:10:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 781932ce-0bea-466f-95e0-066130d6c410 {{(pid=75014) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 04:10:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:34 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:10:36 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:10:36 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:10:37 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:10:37 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:10:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-655fe5eb-1271-4b9f-a5a6-6342bd012a69" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:10:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-655fe5eb-1271-4b9f-a5a6-6342bd012a69" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:10:37 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 04:10:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:10:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:10:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:10:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:10:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:10:37 user nova-compute[75014]: INFO nova.compute.manager [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Terminating instance
Nov 08 04:10:37 user nova-compute[75014]: DEBUG nova.compute.manager [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:10:37 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Updating instance_info_cache with network_info: [{"id": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "address": "fa:16:3e:65:33:45", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9034975-10", "ovs_interfaceid": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:10:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-655fe5eb-1271-4b9f-a5a6-6342bd012a69" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:10:37 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 04:10:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG nova.compute.manager [req-5e741088-bd8c-43a2-9e0b-422d896ce497 req-ab5978cd-06be-40c7-8699-194822048139 service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Received event network-vif-unplugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5e741088-bd8c-43a2-9e0b-422d896ce497 req-ab5978cd-06be-40c7-8699-194822048139 service nova] Acquiring lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5e741088-bd8c-43a2-9e0b-422d896ce497 req-ab5978cd-06be-40c7-8699-194822048139 service nova] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5e741088-bd8c-43a2-9e0b-422d896ce497 req-ab5978cd-06be-40c7-8699-194822048139 service nova] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG nova.compute.manager [req-5e741088-bd8c-43a2-9e0b-422d896ce497 req-ab5978cd-06be-40c7-8699-194822048139 service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] No waiting events found dispatching network-vif-unplugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG nova.compute.manager [req-5e741088-bd8c-43a2-9e0b-422d896ce497 req-ab5978cd-06be-40c7-8699-194822048139 service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Received event network-vif-unplugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:38 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Instance destroyed successfully.
Nov 08 04:10:38 user nova-compute[75014]: DEBUG nova.objects.instance [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lazy-loading 'resources' on Instance uuid 655fe5eb-1271-4b9f-a5a6-6342bd012a69 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:53:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-296870254',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-296870254',id=12,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:56:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92a182cdeb8543fea1ab24326734991e',ramdisk_id='',reservation_id='r-zhw8trfw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648299000',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T03:57:48Z,user_data=None,user_id='630b9ba8f1d9471f9cea51f74106381a',uuid=655fe5eb-1271-4b9f-a5a6-6342bd012a69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "address": "fa:16:3e:65:33:45", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9034975-10", "ovs_interfaceid": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Converting VIF {"id": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "address": "fa:16:3e:65:33:45", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9034975-10", "ovs_interfaceid": "c9034975-100d-4ca6-b1dd-c39ea788e2d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:33:45,bridge_name='br-int',has_traffic_filtering=True,id=c9034975-100d-4ca6-b1dd-c39ea788e2d3,network=Network(d45dbf14-9570-46c1-91a3-cbe2f7972b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9034975-10') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG os_vif [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:33:45,bridge_name='br-int',has_traffic_filtering=True,id=c9034975-100d-4ca6-b1dd-c39ea788e2d3,network=Network(d45dbf14-9570-46c1-91a3-cbe2f7972b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9034975-10') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9034975-10, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=91fe0811-0e05-44d9-876e-9b72c79e539a) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:10:38 user nova-compute[75014]: INFO os_vif [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:33:45,bridge_name='br-int',has_traffic_filtering=True,id=c9034975-100d-4ca6-b1dd-c39ea788e2d3,network=Network(d45dbf14-9570-46c1-91a3-cbe2f7972b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9034975-10')
Nov 08 04:10:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFNlLqJa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:10:38 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:10:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[878576b7-dbe2-4d57-aa54-f07513af0b24]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:10:38 user nova-compute[75014]: No targets found.
Nov 08 04:10:38 user nova-compute[75014]: iSNS:
Nov 08 04:10:38 user nova-compute[75014]: No targets found.
Nov 08 04:10:38 user nova-compute[75014]: STATIC:
Nov 08 04:10:38 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec
Nov 08 04:10:38 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:10:38 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:10:38 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1
Nov 08 04:10:38 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:10:38 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:10:38 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:10:38 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:10:38 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:10:38 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb
Nov 08 04:10:38 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:10:38 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:10:38 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c
Nov 08 04:10:38 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:10:38 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:10:38 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437
Nov 08 04:10:38 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:10:38 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:10:38 user nova-compute[75014]: FIRMWARE:
Nov 08 04:10:38 user nova-compute[75014]: No targets found.
Nov 08 04:10:38 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:10:38 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:10:38 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d480f8-d349-495a-a306-25b267422935]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1a7af9-fcd7-4a3a-b2f3-220d16b345b5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:10:38 user nova-compute[75014]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:10:38 user nova-compute[75014]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)
Nov 08 04:10:38 user nova-compute[75014]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:10:38 user nova-compute[75014]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)
Nov 08 04:10:38 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:10:38 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:10:38 user nova-compute[75014]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:10:38 user nova-compute[75014]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)
Nov 08 04:10:38 user nova-compute[75014]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:10:38 user nova-compute[75014]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)
Nov 08 04:10:38 user nova-compute[75014]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec (non-flash)
Nov 08 04:10:38 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0400614040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec'): ({'sdc'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Removing single pathed devices sdc {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d8372f-689a-4524-be7d-fd7af10b1ed6]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28fa095-d2d1-4a13-9cdb-67d2c0f62471]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Flushing IO for device /dev/sdc {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b209458a-cf8a-4136-aefa-2923b77249dd]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d4ec9b-e08e-4c35-afc3-3b79cdd17dea]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] SCSI volumes sdc have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[741a7247-539e-4fef-af0a-d59fa2295eaf]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6239d2ac-3c29-42bd-b3ce-7d909550e5b6]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec, portal: 172.16.0.220,3260]
Nov 08 04:10:38 user nova-compute[75014]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec, portal: 172.16.0.220,3260] successful.
Nov 08 04:10:38 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f9f2d2-e443-4943-85f4-0f697ab7f6ec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f0d56f-1ea4-41e9-a78c-44439b8e93d5]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] <== disconnect_volume: return (323ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:10:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:10:38 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Deleting instance files /opt/stack/data/nova/instances/655fe5eb-1271-4b9f-a5a6-6342bd012a69_del
Nov 08 04:10:38 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Deletion of /opt/stack/data/nova/instances/655fe5eb-1271-4b9f-a5a6-6342bd012a69_del complete
Nov 08 04:10:39 user nova-compute[75014]: INFO nova.compute.manager [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 08 04:10:39 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:10:39 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:10:39 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:10:39 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:10:39 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:10:39 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Took 0.53 seconds to deallocate network for instance.
Nov 08 04:10:40 user nova-compute[75014]: DEBUG nova.compute.manager [req-0b78c360-9a5d-4ae9-9d77-1eb0979e84e8 req-66fffdd2-5375-4c96-9401-4ce6ecae46bc service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Received event network-vif-plugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:10:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0b78c360-9a5d-4ae9-9d77-1eb0979e84e8 req-66fffdd2-5375-4c96-9401-4ce6ecae46bc service nova] Acquiring lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:10:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0b78c360-9a5d-4ae9-9d77-1eb0979e84e8 req-66fffdd2-5375-4c96-9401-4ce6ecae46bc service nova] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:10:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0b78c360-9a5d-4ae9-9d77-1eb0979e84e8 req-66fffdd2-5375-4c96-9401-4ce6ecae46bc service nova] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:10:40 user nova-compute[75014]: DEBUG nova.compute.manager [req-0b78c360-9a5d-4ae9-9d77-1eb0979e84e8 req-66fffdd2-5375-4c96-9401-4ce6ecae46bc service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] No waiting events found dispatching network-vif-plugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:10:40 user nova-compute[75014]: WARNING nova.compute.manager [req-0b78c360-9a5d-4ae9-9d77-1eb0979e84e8 req-66fffdd2-5375-4c96-9401-4ce6ecae46bc service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Received unexpected event network-vif-plugged-c9034975-100d-4ca6-b1dd-c39ea788e2d3 for instance with vm_state active and task_state deleting.
Nov 08 04:10:40 user nova-compute[75014]: DEBUG nova.compute.manager [req-0b78c360-9a5d-4ae9-9d77-1eb0979e84e8 req-66fffdd2-5375-4c96-9401-4ce6ecae46bc service nova] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Received event network-vif-deleted-c9034975-100d-4ca6-b1dd-c39ea788e2d3 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:10:40 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:10:40 user nova-compute[75014]: INFO nova.compute.manager [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 655fe5eb-1271-4b9f-a5a6-6342bd012a69] Took 1.07 seconds to detach 1 volumes for instance.
Nov 08 04:10:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:10:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:10:40 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:10:40 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:10:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:10:41 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Deleted allocations for instance 655fe5eb-1271-4b9f-a5a6-6342bd012a69
Nov 08 04:10:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-74d3cc36-0789-4153-876d-01dfa606f5c5 tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "655fe5eb-1271-4b9f-a5a6-6342bd012a69" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.296s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:10:41 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:10:42 user nova-compute[75014]: DEBUG nova.compute.manager [req-ad147194-ab36-4564-a2d0-e43b9254fec7 req-c7c88e5e-d8d8-4832-b2d7-4a013beb7482 service nova] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Received event network-changed-4320bd7b-bdf6-400d-9e6e-2d29c34ccf84 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:10:42 user nova-compute[75014]: DEBUG nova.compute.manager [req-ad147194-ab36-4564-a2d0-e43b9254fec7 req-c7c88e5e-d8d8-4832-b2d7-4a013beb7482 service nova] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Refreshing instance network info cache due to event network-changed-4320bd7b-bdf6-400d-9e6e-2d29c34ccf84. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:10:42 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ad147194-ab36-4564-a2d0-e43b9254fec7 req-c7c88e5e-d8d8-4832-b2d7-4a013beb7482 service nova] Acquiring lock "refresh_cache-b25630ab-a3b3-4ec7-bd38-3344d90672c9" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:10:42 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ad147194-ab36-4564-a2d0-e43b9254fec7 req-c7c88e5e-d8d8-4832-b2d7-4a013beb7482 service nova] Acquired lock "refresh_cache-b25630ab-a3b3-4ec7-bd38-3344d90672c9" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:10:42 user nova-compute[75014]: DEBUG nova.network.neutron [req-ad147194-ab36-4564-a2d0-e43b9254fec7 req-c7c88e5e-d8d8-4832-b2d7-4a013beb7482 service nova] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Refreshing network info cache for port 4320bd7b-bdf6-400d-9e6e-2d29c34ccf84 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:10:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:43 user nova-compute[75014]: DEBUG nova.network.neutron [req-ad147194-ab36-4564-a2d0-e43b9254fec7 req-c7c88e5e-d8d8-4832-b2d7-4a013beb7482 service nova] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Updated VIF entry in instance network info cache for port 4320bd7b-bdf6-400d-9e6e-2d29c34ccf84. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:10:43 user nova-compute[75014]: DEBUG nova.network.neutron [req-ad147194-ab36-4564-a2d0-e43b9254fec7 req-c7c88e5e-d8d8-4832-b2d7-4a013beb7482 service nova] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Updating instance_info_cache with network_info: [{"id": "4320bd7b-bdf6-400d-9e6e-2d29c34ccf84", "address": "fa:16:3e:94:e1:8b", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4320bd7b-bd", "ovs_interfaceid": "4320bd7b-bdf6-400d-9e6e-2d29c34ccf84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:10:43 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:10:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ad147194-ab36-4564-a2d0-e43b9254fec7 req-c7c88e5e-d8d8-4832-b2d7-4a013beb7482 service nova] Releasing lock "refresh_cache-b25630ab-a3b3-4ec7-bd38-3344d90672c9" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:10:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:10:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:10:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:10:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:10:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:10:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25630ab-a3b3-4ec7-bd38-3344d90672c9/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25630ab-a3b3-4ec7-bd38-3344d90672c9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25630ab-a3b3-4ec7-bd38-3344d90672c9/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25630ab-a3b3-4ec7-bd38-3344d90672c9/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:45 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 36a4109b-f239-48ce-ad49-e640a12a73bf is timed out.
Nov 08 04:10:45 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Successfully detached device vdb from instance 36a4109b-f239-48ce-ad49-e640a12a73bf from the live domain config.
Nov 08 04:10:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmyjVSXs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:10:45 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:10:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa37617-4f07-4a75-96cf-495be062cc6b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:10:45 user nova-compute[75014]: No targets found.
Nov 08 04:10:45 user nova-compute[75014]: iSNS:
Nov 08 04:10:45 user nova-compute[75014]: No targets found.
Nov 08 04:10:45 user nova-compute[75014]: STATIC:
Nov 08 04:10:45 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1
Nov 08 04:10:45 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:10:45 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:10:45 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:10:45 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:10:45 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:10:45 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb
Nov 08 04:10:45 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:10:45 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:10:45 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c
Nov 08 04:10:45 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:10:45 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:10:45 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437
Nov 08 04:10:45 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:10:45 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:10:45 user nova-compute[75014]: FIRMWARE:
Nov 08 04:10:45 user nova-compute[75014]: No targets found.
Nov 08 04:10:45 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:10:45 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:10:45 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3204e1c0-588e-40f6-9aed-74f7c8fedf40]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76e7d64-8be6-427a-896b-364a8fcb5cbf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:10:45 user nova-compute[75014]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:10:45 user nova-compute[75014]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)
Nov 08 04:10:45 user nova-compute[75014]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:10:45 user nova-compute[75014]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)
Nov 08 04:10:45 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:10:45 user nova-compute[75014]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb (non-flash)
Nov 08 04:10:45 user nova-compute[75014]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)
Nov 08 04:10:45 user nova-compute[75014]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:10:45 user nova-compute[75014]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)
Nov 08 04:10:45 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f042136e0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb'): ({'sdb'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Removing single pathed devices sdb {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[91024feb-d22c-4898-bb80-4faa8caccdc6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fe51aa-69dc-4a41-975a-548a672a7e84]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Flushing IO for device /dev/sdb {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68b1701-3d1d-4a41-8485-93af64fa9fb4]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e13952-daed-493a-88e6-4d7e61196b3d]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] SCSI volumes sdb have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9df0592-4f33-4cec-949b-123368fee2c5]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[391f383c-fbdb-4db1-a5fa-2b15142a17d1]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb, portal: 172.16.0.220,3260]
Nov 08 04:10:45 user nova-compute[75014]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb, portal: 172.16.0.220,3260] successful.
Nov 08 04:10:45 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e20ff7-58e6-4de5-8680-e6b29925cfcb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:46 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9a4bac-fd7a-4506-849f-c7bcbb0e54bb]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:10:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:10:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] <== disconnect_volume: return (378ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:10:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:10:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG nova.objects.instance [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lazy-loading 'flavor' on Instance uuid 36a4109b-f239-48ce-ad49-e640a12a73bf {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:10:47 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 449e9147-efe0-4aa1-af52-557e313bf7fe is timed out.
Nov 08 04:10:47 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Successfully detached device vdb from instance 449e9147-efe0-4aa1-af52-557e313bf7fe from the live domain config.
Nov 08 04:10:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YjfxARiX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:10:47 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:10:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:10:47 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:10:47 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:10:47 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=7692MB free_disk=24.803531646728516GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e8861c-5506-40bb-997f-0978a8c7e354]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:10:47 user nova-compute[75014]: No targets found.
Nov 08 04:10:47 user nova-compute[75014]: iSNS:
Nov 08 04:10:47 user nova-compute[75014]: No targets found.
Nov 08 04:10:47 user nova-compute[75014]: STATIC:
Nov 08 04:10:47 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1
Nov 08 04:10:47 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:10:47 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:10:47 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:10:47 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:10:47 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:10:47 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c
Nov 08 04:10:47 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:10:47 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:10:47 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437
Nov 08 04:10:47 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:10:47 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:10:47 user nova-compute[75014]: FIRMWARE:
Nov 08 04:10:47 user nova-compute[75014]: No targets found.
Nov 08 04:10:47 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:10:47 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:10:47 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-88cd6bca-9ef0-4217-9e1a-015cbcbf358a tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "36a4109b-f239-48ce-ad49-e640a12a73bf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.160s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8405091-f1ee-48f7-b31e-d0f21e1989db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[275c552b-f166-4dee-ad18-7882fe87782d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:10:47 user nova-compute[75014]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)
Nov 08 04:10:47 user nova-compute[75014]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:10:47 user nova-compute[75014]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)
Nov 08 04:10:47 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:10:47 user nova-compute[75014]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c (non-flash)
Nov 08 04:10:47 user nova-compute[75014]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:10:47 user nova-compute[75014]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)
Nov 08 04:10:47 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0400614d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c'): ({'sdf'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Removing single pathed devices sdf {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2b329a-5d62-4832-96fd-00e3cbea2c37]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96b3589-fd80-42e0-b4d6-e4035e7b8730]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Flushing IO for device /dev/sdf {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6af1730-12ba-4395-99b5-423760bea46c]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c67cfa-5b4a-4771-8a43-1ecda620d1a6]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] SCSI volumes sdf have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9709fb62-68e0-44eb-92fc-7cce503edcfe]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 5bfa6580-e0fe-46b0-b497-8db67806113a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance c23c9e00-b782-4530-bb01-a7a167951c1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 36a4109b-f239-48ce-ad49-e640a12a73bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 781932ce-0bea-466f-95e0-066130d6c410 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 449e9147-efe0-4aa1-af52-557e313bf7fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance b25630ab-a3b3-4ec7-bd38-3344d90672c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance ace7e2f7-28c3-41e3-b92b-05e834c3968c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eca6b1e-2108-4e60-bbcf-8e2e11ea55c1]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c, portal: 172.16.0.220,3260]
Nov 08 04:10:47 user nova-compute[75014]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c, portal: 172.16.0.220,3260] successful.
Nov 08 04:10:47 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Refreshing inventories for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9adf5c03-4d4d-44d3-ac4e-835bc141e45c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c3233a-b2a6-4694-9834-9705dd54f36e]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] <== disconnect_volume: return (366ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Updating ProviderTree inventory for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Updating inventory in ProviderTree for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Refreshing aggregate associations for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0, aggregates: None {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Refreshing trait associations for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:10:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.737s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG nova.objects.instance [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lazy-loading 'flavor' on Instance uuid 449e9147-efe0-4aa1-af52-557e313bf7fe {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=75014) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3e73ec00-fd9e-4e0f-a558-33d9bf44715f tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "449e9147-efe0-4aa1-af52-557e313bf7fe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.093s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "b25630ab-a3b3-4ec7-bd38-3344d90672c9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "b25630ab-a3b3-4ec7-bd38-3344d90672c9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG nova.objects.instance [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lazy-loading 'flavor' on Instance uuid b25630ab-a3b3-4ec7-bd38-3344d90672c9 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "b25630ab-a3b3-4ec7-bd38-3344d90672c9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "b25630ab-a3b3-4ec7-bd38-3344d90672c9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "b25630ab-a3b3-4ec7-bd38-3344d90672c9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:10:48 user nova-compute[75014]: INFO nova.compute.manager [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Attaching volume 687fb5fd-83e0-4cd8-8605-296b6a461c26 to /dev/vdb
Nov 08 04:10:48 user nova-compute[75014]: DEBUG os_brick.utils [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[572af1e1-ea02-430d-a61e-7ecde9eeb1ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cfa932-ffe4-4186-9ca1-03ed8793b882]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e114aed-5581-41b5-9340-a1bf7fde7068]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6502f3-7a18-4e31-a427-d6c208e385d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:10:48 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:10:48 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea62b164-a9f2-4154-918a-3b6674aed5aa]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG os_brick.utils [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:10:48 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Updating existing volume attachment record: 68262b3f-d360-4c10-b84a-9efeb64ed99b {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:10:50 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 781932ce-0bea-466f-95e0-066130d6c410 is timed out.
Nov 08 04:10:50 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Successfully detached device vdb from instance 781932ce-0bea-466f-95e0-066130d6c410 from the live domain config.
Nov 08 04:10:50 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crbqawYg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:10:50 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:10:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[440653ad-3649-47e7-b1da-ffd23a758689]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:10:50 user nova-compute[75014]: No targets found.
Nov 08 04:10:50 user nova-compute[75014]: iSNS:
Nov 08 04:10:50 user nova-compute[75014]: No targets found.
Nov 08 04:10:50 user nova-compute[75014]: STATIC:
Nov 08 04:10:50 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1
Nov 08 04:10:50 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:10:50 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:10:50 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:10:50 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:10:50 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:10:50 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437
Nov 08 04:10:50 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:10:50 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:10:50 user nova-compute[75014]: FIRMWARE:
Nov 08 04:10:50 user nova-compute[75014]: No targets found.
Nov 08 04:10:50 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:10:50 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:10:50 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a38735-22fd-42bf-beb8-9df2e2a38580]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a90add-ccbd-47c3-a9c1-327c77203bc3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:10:50 user nova-compute[75014]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:10:50 user nova-compute[75014]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)
Nov 08 04:10:50 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:10:50 user nova-compute[75014]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 (non-flash)
Nov 08 04:10:50 user nova-compute[75014]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)
Nov 08 04:10:50 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f042136e0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1'): ({'sdd'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Removing single pathed devices sdd {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25f9cc7-dea3-4e5e-a575-81d430bf6d37]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ed8328-8720-41b9-a37d-8b0de381c7b4]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Flushing IO for device /dev/sdd {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6359ba85-999f-4690-ab91-8c55bb0c8565]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.059s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[010f217f-714b-4fd4-bf7b-6c14fc1f1cd4]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] SCSI volumes sdd have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[850fa9f8-a821-438e-955a-a8ac0b7fb08a]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b893f60-8c4f-4090-a321-20ca7b025ac2]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1, portal: 172.16.0.220,3260]
Nov 08 04:10:50 user nova-compute[75014]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1, portal: 172.16.0.220,3260] successful.
Nov 08 04:10:50 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f251c6de-c866-429b-b113-b67a97cf79f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2728523f-5212-4f08-99ab-fc3012492149]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] <== disconnect_volume: return (338ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:10:50 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:10:51 user nova-compute[75014]: DEBUG nova.objects.instance [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lazy-loading 'flavor' on Instance uuid 781932ce-0bea-466f-95e0-066130d6c410 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:10:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dcf6497f-de46-4099-af77-37f8016e893d tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "781932ce-0bea-466f-95e0-066130d6c410" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.948s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:10:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e2108ee0-86fc-4d80-acff-b1f9eeb57196 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "781932ce-0bea-466f-95e0-066130d6c410" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:10:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e2108ee0-86fc-4d80-acff-b1f9eeb57196 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "781932ce-0bea-466f-95e0-066130d6c410" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:10:52 user nova-compute[75014]: DEBUG nova.compute.manager [None req-e2108ee0-86fc-4d80-acff-b1f9eeb57196 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:10:52 user nova-compute[75014]: DEBUG nova.compute.manager [None req-e2108ee0-86fc-4d80-acff-b1f9eeb57196 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75014) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 08 04:10:52 user nova-compute[75014]: DEBUG nova.objects.instance [None req-e2108ee0-86fc-4d80-acff-b1f9eeb57196 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lazy-loading 'flavor' on Instance uuid 781932ce-0bea-466f-95e0-066130d6c410 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:10:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:52 user nova-compute[75014]: DEBUG nova.compute.manager [req-5cb37255-b78e-43ff-bad7-9b17998bfc37 req-1c2500e3-dc09-4a04-8bc3-86d39d18b98d service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Received event network-vif-unplugged-5b680c90-914d-4583-a698-dccacaff9987 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:10:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5cb37255-b78e-43ff-bad7-9b17998bfc37 req-1c2500e3-dc09-4a04-8bc3-86d39d18b98d service nova] Acquiring lock "781932ce-0bea-466f-95e0-066130d6c410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:10:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5cb37255-b78e-43ff-bad7-9b17998bfc37 req-1c2500e3-dc09-4a04-8bc3-86d39d18b98d service nova] Lock "781932ce-0bea-466f-95e0-066130d6c410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:10:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5cb37255-b78e-43ff-bad7-9b17998bfc37 req-1c2500e3-dc09-4a04-8bc3-86d39d18b98d service nova] Lock "781932ce-0bea-466f-95e0-066130d6c410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:10:52 user nova-compute[75014]: DEBUG nova.compute.manager [req-5cb37255-b78e-43ff-bad7-9b17998bfc37 req-1c2500e3-dc09-4a04-8bc3-86d39d18b98d service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] No waiting events found dispatching network-vif-unplugged-5b680c90-914d-4583-a698-dccacaff9987 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:10:52 user nova-compute[75014]: WARNING nova.compute.manager [req-5cb37255-b78e-43ff-bad7-9b17998bfc37 req-1c2500e3-dc09-4a04-8bc3-86d39d18b98d service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Received unexpected event network-vif-unplugged-5b680c90-914d-4583-a698-dccacaff9987 for instance with vm_state active and task_state powering-off.
Nov 08 04:10:53 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Instance destroyed successfully.
Nov 08 04:10:53 user nova-compute[75014]: DEBUG nova.compute.manager [None req-e2108ee0-86fc-4d80-acff-b1f9eeb57196 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:10:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e2108ee0-86fc-4d80-acff-b1f9eeb57196 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "781932ce-0bea-466f-95e0-066130d6c410" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.946s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:10:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:54 user nova-compute[75014]: DEBUG nova.compute.manager [req-2b5907c6-9b9c-41c8-a697-f2d71bbba122 req-f66ca793-2557-4d79-87ee-21d6265f4f78 service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Received event network-vif-plugged-5b680c90-914d-4583-a698-dccacaff9987 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:10:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2b5907c6-9b9c-41c8-a697-f2d71bbba122 req-f66ca793-2557-4d79-87ee-21d6265f4f78 service nova] Acquiring lock "781932ce-0bea-466f-95e0-066130d6c410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:10:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2b5907c6-9b9c-41c8-a697-f2d71bbba122 req-f66ca793-2557-4d79-87ee-21d6265f4f78 service nova] Lock "781932ce-0bea-466f-95e0-066130d6c410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:10:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2b5907c6-9b9c-41c8-a697-f2d71bbba122 req-f66ca793-2557-4d79-87ee-21d6265f4f78 service nova] Lock "781932ce-0bea-466f-95e0-066130d6c410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:10:54 user nova-compute[75014]: DEBUG nova.compute.manager [req-2b5907c6-9b9c-41c8-a697-f2d71bbba122 req-f66ca793-2557-4d79-87ee-21d6265f4f78 service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] No waiting events found dispatching network-vif-plugged-5b680c90-914d-4583-a698-dccacaff9987 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:10:54 user nova-compute[75014]: WARNING nova.compute.manager [req-2b5907c6-9b9c-41c8-a697-f2d71bbba122 req-f66ca793-2557-4d79-87ee-21d6265f4f78 service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Received unexpected event network-vif-plugged-5b680c90-914d-4583-a698-dccacaff9987 for instance with vm_state stopped and task_state None.
Nov 08 04:10:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:10:58 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:10:58 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Cleaning up deleted instances {{(pid=75014) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 04:10:58 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] There are 0 instances to clean {{(pid=75014) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 04:10:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BcEQDHAf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:11:12 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:11:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:11:12 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:11:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:11:12 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:11:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26 -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd125b1-23ca-41dc-b77b-bbc9f5e05ebf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:11:12 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26 -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dab055-1196-48f9-9526-7226f261916b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26] added
Nov 08 04:11:12 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc38af4-3199-4e4e-9758-54c3c3175ac8]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f9549d-d634-4c39-90f8-6f99bf87a1e0]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BcEQDHAf {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BcEQDHAf" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04252ea-f888-4284-9a30-ad7700539c45]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BcEQDHAf'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bce48c2-6c0d-45bb-9d71-51de016c75b4]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e36377-c19e-42f4-a85c-6fe2550ad8bf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:11:12 user nova-compute[75014]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)
Nov 08 04:11:12 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:11:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:11:12 user nova-compute[75014]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)
Nov 08 04:11:12 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:11:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26 -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c96e978-4643-418a-97ac-bbdcc00ed0fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:11:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26, portal: 172.16.0.220,3260]
Nov 08 04:11:13 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26, portal: 172.16.0.220,3260] successful.
Nov 08 04:11:13 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:11:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[47352dce-32a7-47d5-8c43-3605bd80be84]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:11:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:11:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c385c5-b085-45ba-a521-096e16d3110e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:11:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:11:13 user nova-compute[75014]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)
Nov 08 04:11:13 user nova-compute[75014]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26 (non-flash)
Nov 08 04:11:13 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:11:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:11:13 user nova-compute[75014]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)
Nov 08 04:11:13 user nova-compute[75014]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26 (non-flash)
Nov 08 04:11:13 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:11:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:11:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:11:13 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:11:13 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:11:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec52e0b-95dd-40d1-89e8-43b3821b9bb8]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:11:13 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:11:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BcEQDHAf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:11:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:11:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26362376135663834', 'path': '/dev/sdb'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:11:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362376135663834', 'path': '/dev/sdb'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:11:14 user nova-compute[75014]: DEBUG nova.objects.instance [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lazy-loading 'flavor' on Instance uuid b25630ab-a3b3-4ec7-bd38-3344d90672c9 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:11:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 04:11:14 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:11:14 user nova-compute[75014]:   <source dev="/dev/sdb"/>
Nov 08 04:11:14 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:11:14 user nova-compute[75014]:   <serial>687fb5fd-83e0-4cd8-8605-296b6a461c26</serial>
Nov 08 04:11:14 user nova-compute[75014]: </disk>
Nov 08 04:11:14 user nova-compute[75014]:  {{(pid=75014) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 04:11:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:11:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:11:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] No VIF found with MAC fa:16:3e:94:e1:8b, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:11:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-661f77be-cd3b-4850-ae3e-74708c9284b8 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "b25630ab-a3b3-4ec7-bd38-3344d90672c9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.026s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:11:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-10989341-7d0c-41e4-847a-0a7b7b926d50 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "36a4109b-f239-48ce-ad49-e640a12a73bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:11:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-10989341-7d0c-41e4-847a-0a7b7b926d50 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "36a4109b-f239-48ce-ad49-e640a12a73bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:11:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-10989341-7d0c-41e4-847a-0a7b7b926d50 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "36a4109b-f239-48ce-ad49-e640a12a73bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:11:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-10989341-7d0c-41e4-847a-0a7b7b926d50 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "36a4109b-f239-48ce-ad49-e640a12a73bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:11:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-10989341-7d0c-41e4-847a-0a7b7b926d50 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "36a4109b-f239-48ce-ad49-e640a12a73bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:11:15 user nova-compute[75014]: INFO nova.compute.manager [None req-10989341-7d0c-41e4-847a-0a7b7b926d50 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Terminating instance
Nov 08 04:11:15 user nova-compute[75014]: DEBUG nova.compute.manager [None req-10989341-7d0c-41e4-847a-0a7b7b926d50 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:11:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "b25630ab-a3b3-4ec7-bd38-3344d90672c9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:11:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "b25630ab-a3b3-4ec7-bd38-3344d90672c9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:11:15 user nova-compute[75014]: INFO nova.compute.manager [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Detaching volume 687fb5fd-83e0-4cd8-8605-296b6a461c26
Nov 08 04:11:15 user nova-compute[75014]: DEBUG nova.compute.manager [req-8a36ae64-a64b-4f0a-89c6-f1cd19864d66 req-ae8b05fd-2a86-4690-a5ac-f9ec9b7cae71 service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Received event network-vif-unplugged-a575a382-2b45-4494-b351-0ace52e3588b {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:11:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8a36ae64-a64b-4f0a-89c6-f1cd19864d66 req-ae8b05fd-2a86-4690-a5ac-f9ec9b7cae71 service nova] Acquiring lock "36a4109b-f239-48ce-ad49-e640a12a73bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:11:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8a36ae64-a64b-4f0a-89c6-f1cd19864d66 req-ae8b05fd-2a86-4690-a5ac-f9ec9b7cae71 service nova] Lock "36a4109b-f239-48ce-ad49-e640a12a73bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:11:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8a36ae64-a64b-4f0a-89c6-f1cd19864d66 req-ae8b05fd-2a86-4690-a5ac-f9ec9b7cae71 service nova] Lock "36a4109b-f239-48ce-ad49-e640a12a73bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:11:16 user nova-compute[75014]: DEBUG nova.compute.manager [req-8a36ae64-a64b-4f0a-89c6-f1cd19864d66 req-ae8b05fd-2a86-4690-a5ac-f9ec9b7cae71 service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] No waiting events found dispatching network-vif-unplugged-a575a382-2b45-4494-b351-0ace52e3588b {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:11:16 user nova-compute[75014]: DEBUG nova.compute.manager [req-8a36ae64-a64b-4f0a-89c6-f1cd19864d66 req-ae8b05fd-2a86-4690-a5ac-f9ec9b7cae71 service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Received event network-vif-unplugged-a575a382-2b45-4494-b351-0ace52e3588b for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:11:16 user nova-compute[75014]: INFO nova.virt.block_device [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Attempting to driver detach volume 687fb5fd-83e0-4cd8-8605-296b6a461c26 from mountpoint /dev/vdb
Nov 08 04:11:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Attempting to detach device vdb from instance b25630ab-a3b3-4ec7-bd38-3344d90672c9 from the persistent domain config. {{(pid=75014) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 04:11:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:11:16 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:11:16 user nova-compute[75014]:   <source dev="/dev/sdb"/>
Nov 08 04:11:16 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:11:16 user nova-compute[75014]:   <serial>687fb5fd-83e0-4cd8-8605-296b6a461c26</serial>
Nov 08 04:11:16 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:11:16 user nova-compute[75014]: </disk>
Nov 08 04:11:16 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:11:16 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Successfully detached device vdb from instance b25630ab-a3b3-4ec7-bd38-3344d90672c9 from the persistent domain config.
Nov 08 04:11:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b25630ab-a3b3-4ec7-bd38-3344d90672c9 from the live domain config. {{(pid=75014) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 04:11:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:11:16 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:11:16 user nova-compute[75014]:   <source dev="/dev/sdb"/>
Nov 08 04:11:16 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:11:16 user nova-compute[75014]:   <serial>687fb5fd-83e0-4cd8-8605-296b6a461c26</serial>
Nov 08 04:11:16 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:11:16 user nova-compute[75014]: </disk>
Nov 08 04:11:16 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:11:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b25630ab-a3b3-4ec7-bd38-3344d90672c9 {{(pid=75014) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 04:11:16 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Instance destroyed successfully.
Nov 08 04:11:16 user nova-compute[75014]: DEBUG nova.objects.instance [None req-10989341-7d0c-41e4-847a-0a7b7b926d50 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lazy-loading 'resources' on Instance uuid 36a4109b-f239-48ce-ad49-e640a12a73bf {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:11:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-10989341-7d0c-41e4-847a-0a7b7b926d50 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T04:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-372983470',display_name='tempest-ServerActionsTestOtherA-server-1298346474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-372983470',id=29,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhheGyNzDlKZ2iBJ0DNzi5AYIcLl14TQHCatvNP3avHAzjaEguIvBGcBxNnOYp/JkyWAjVRAHcTHBiFLXLHVGrIzmoaj96sMdyVyHAw+f4ZhavFNOqzCWT3h0YxLOs+7g==',key_name='tempest-keypair-1837241282',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:07:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b9ecaed30ba4ad1a9d5eaca02633604',ramdisk_id='',reservation_id='r-prevyyvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-537496863',owner_user_name='tempest-ServerActionsTestOtherA-537496863-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:07:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8398fcf62a014e7f943bff6fcc3f72f3',uuid=36a4109b-f239-48ce-ad49-e640a12a73bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a575a382-2b45-4494-b351-0ace52e3588b", "address": "fa:16:3e:17:47:bd", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa575a382-2b", "ovs_interfaceid": "a575a382-2b45-4494-b351-0ace52e3588b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:11:16 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-10989341-7d0c-41e4-847a-0a7b7b926d50 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Converting VIF {"id": "a575a382-2b45-4494-b351-0ace52e3588b", "address": "fa:16:3e:17:47:bd", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa575a382-2b", "ovs_interfaceid": "a575a382-2b45-4494-b351-0ace52e3588b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:11:16 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-10989341-7d0c-41e4-847a-0a7b7b926d50 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:47:bd,bridge_name='br-int',has_traffic_filtering=True,id=a575a382-2b45-4494-b351-0ace52e3588b,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa575a382-2b') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:11:16 user nova-compute[75014]: DEBUG os_vif [None req-10989341-7d0c-41e4-847a-0a7b7b926d50 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:47:bd,bridge_name='br-int',has_traffic_filtering=True,id=a575a382-2b45-4494-b351-0ace52e3588b,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa575a382-2b') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:11:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa575a382-2b, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:11:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:11:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27c4c3f2-43cd-4f9a-9f2f-d6cb1ec916f3) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:11:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:11:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:16 user nova-compute[75014]: INFO os_vif [None req-10989341-7d0c-41e4-847a-0a7b7b926d50 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:47:bd,bridge_name='br-int',has_traffic_filtering=True,id=a575a382-2b45-4494-b351-0ace52e3588b,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa575a382-2b')
Nov 08 04:11:16 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-10989341-7d0c-41e4-847a-0a7b7b926d50 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Deleting instance files /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf_del
Nov 08 04:11:16 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-10989341-7d0c-41e4-847a-0a7b7b926d50 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Deletion of /opt/stack/data/nova/instances/36a4109b-f239-48ce-ad49-e640a12a73bf_del complete
Nov 08 04:11:16 user nova-compute[75014]: INFO nova.compute.manager [None req-10989341-7d0c-41e4-847a-0a7b7b926d50 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Took 1.35 seconds to destroy the instance on the hypervisor.
Nov 08 04:11:16 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-10989341-7d0c-41e4-847a-0a7b7b926d50 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:11:16 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:11:16 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:11:17 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:11:17 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Took 0.73 seconds to deallocate network for instance.
Nov 08 04:11:17 user nova-compute[75014]: DEBUG nova.compute.manager [req-56bef894-642a-4d0a-b264-4ba7f6d74856 req-3c4e84e3-be98-41f7-9c4b-3e4cb011e2eb service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Received event network-vif-deleted-a575a382-2b45-4494-b351-0ace52e3588b {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:11:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-10989341-7d0c-41e4-847a-0a7b7b926d50 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:11:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-10989341-7d0c-41e4-847a-0a7b7b926d50 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:11:17 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-10989341-7d0c-41e4-847a-0a7b7b926d50 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:11:17 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-10989341-7d0c-41e4-847a-0a7b7b926d50 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:11:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-10989341-7d0c-41e4-847a-0a7b7b926d50 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:11:17 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-10989341-7d0c-41e4-847a-0a7b7b926d50 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Deleted allocations for instance 36a4109b-f239-48ce-ad49-e640a12a73bf
Nov 08 04:11:18 user nova-compute[75014]: DEBUG nova.compute.manager [req-029b4f22-ae61-4eb5-b605-98e77a0bd861 req-0c9752a4-cda7-4e69-992f-5fab0aed9c71 service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Received event network-vif-plugged-a575a382-2b45-4494-b351-0ace52e3588b {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:11:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-029b4f22-ae61-4eb5-b605-98e77a0bd861 req-0c9752a4-cda7-4e69-992f-5fab0aed9c71 service nova] Acquiring lock "36a4109b-f239-48ce-ad49-e640a12a73bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:11:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-029b4f22-ae61-4eb5-b605-98e77a0bd861 req-0c9752a4-cda7-4e69-992f-5fab0aed9c71 service nova] Lock "36a4109b-f239-48ce-ad49-e640a12a73bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:11:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-029b4f22-ae61-4eb5-b605-98e77a0bd861 req-0c9752a4-cda7-4e69-992f-5fab0aed9c71 service nova] Lock "36a4109b-f239-48ce-ad49-e640a12a73bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:11:18 user nova-compute[75014]: DEBUG nova.compute.manager [req-029b4f22-ae61-4eb5-b605-98e77a0bd861 req-0c9752a4-cda7-4e69-992f-5fab0aed9c71 service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] No waiting events found dispatching network-vif-plugged-a575a382-2b45-4494-b351-0ace52e3588b {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:11:18 user nova-compute[75014]: WARNING nova.compute.manager [req-029b4f22-ae61-4eb5-b605-98e77a0bd861 req-0c9752a4-cda7-4e69-992f-5fab0aed9c71 service nova] [instance: 36a4109b-f239-48ce-ad49-e640a12a73bf] Received unexpected event network-vif-plugged-a575a382-2b45-4494-b351-0ace52e3588b for instance with vm_state deleted and task_state None.
Nov 08 04:11:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-10989341-7d0c-41e4-847a-0a7b7b926d50 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "36a4109b-f239-48ce-ad49-e640a12a73bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.566s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:11:21 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-61bf1682-13d2-41d0-bf33-95c195c5e782 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "449e9147-efe0-4aa1-af52-557e313bf7fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:11:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-61bf1682-13d2-41d0-bf33-95c195c5e782 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "449e9147-efe0-4aa1-af52-557e313bf7fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:11:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-61bf1682-13d2-41d0-bf33-95c195c5e782 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "449e9147-efe0-4aa1-af52-557e313bf7fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:11:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-61bf1682-13d2-41d0-bf33-95c195c5e782 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "449e9147-efe0-4aa1-af52-557e313bf7fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:11:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-61bf1682-13d2-41d0-bf33-95c195c5e782 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "449e9147-efe0-4aa1-af52-557e313bf7fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:11:28 user nova-compute[75014]: INFO nova.compute.manager [None req-61bf1682-13d2-41d0-bf33-95c195c5e782 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Terminating instance
Nov 08 04:11:28 user nova-compute[75014]: DEBUG nova.compute.manager [None req-61bf1682-13d2-41d0-bf33-95c195c5e782 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:11:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:28 user nova-compute[75014]: DEBUG nova.compute.manager [req-14d3841b-2090-4b5e-81de-e0780860a5d7 req-db865914-8345-47bd-9aef-e119367825e1 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Received event network-vif-unplugged-f85faa29-4fe7-4ef1-b746-a1bcad900d9f {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:11:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-14d3841b-2090-4b5e-81de-e0780860a5d7 req-db865914-8345-47bd-9aef-e119367825e1 service nova] Acquiring lock "449e9147-efe0-4aa1-af52-557e313bf7fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:11:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-14d3841b-2090-4b5e-81de-e0780860a5d7 req-db865914-8345-47bd-9aef-e119367825e1 service nova] Lock "449e9147-efe0-4aa1-af52-557e313bf7fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:11:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-14d3841b-2090-4b5e-81de-e0780860a5d7 req-db865914-8345-47bd-9aef-e119367825e1 service nova] Lock "449e9147-efe0-4aa1-af52-557e313bf7fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:11:28 user nova-compute[75014]: DEBUG nova.compute.manager [req-14d3841b-2090-4b5e-81de-e0780860a5d7 req-db865914-8345-47bd-9aef-e119367825e1 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] No waiting events found dispatching network-vif-unplugged-f85faa29-4fe7-4ef1-b746-a1bcad900d9f {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:11:28 user nova-compute[75014]: DEBUG nova.compute.manager [req-14d3841b-2090-4b5e-81de-e0780860a5d7 req-db865914-8345-47bd-9aef-e119367825e1 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Received event network-vif-unplugged-f85faa29-4fe7-4ef1-b746-a1bcad900d9f for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-97340d7c-35d7-42a8-953b-9025d508f92c tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "5bfa6580-e0fe-46b0-b497-8db67806113a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-97340d7c-35d7-42a8-953b-9025d508f92c tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "5bfa6580-e0fe-46b0-b497-8db67806113a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-97340d7c-35d7-42a8-953b-9025d508f92c tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "5bfa6580-e0fe-46b0-b497-8db67806113a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-97340d7c-35d7-42a8-953b-9025d508f92c tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "5bfa6580-e0fe-46b0-b497-8db67806113a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-97340d7c-35d7-42a8-953b-9025d508f92c tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "5bfa6580-e0fe-46b0-b497-8db67806113a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:11:29 user nova-compute[75014]: INFO nova.compute.manager [None req-97340d7c-35d7-42a8-953b-9025d508f92c tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Terminating instance
Nov 08 04:11:29 user nova-compute[75014]: DEBUG nova.compute.manager [None req-97340d7c-35d7-42a8-953b-9025d508f92c tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:29 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Instance destroyed successfully.
Nov 08 04:11:29 user nova-compute[75014]: DEBUG nova.objects.instance [None req-61bf1682-13d2-41d0-bf33-95c195c5e782 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lazy-loading 'resources' on Instance uuid 449e9147-efe0-4aa1-af52-557e313bf7fe {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:11:29 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Instance destroyed successfully.
Nov 08 04:11:29 user nova-compute[75014]: DEBUG nova.objects.instance [None req-97340d7c-35d7-42a8-953b-9025d508f92c tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lazy-loading 'resources' on Instance uuid 5bfa6580-e0fe-46b0-b497-8db67806113a {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-61bf1682-13d2-41d0-bf33-95c195c5e782 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-947753843',display_name='tempest-TestMinimumBasicScenario-server-947753843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-947753843',id=33,image_ref='99456f5c-cff4-4ad8-afe3-4f5454f6e3ab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3nXb/RsyynTT5PUm/7pMaVbxD4C3VjPlxa28BU5xF0dIuRS2NrCPk10dkh/0jcqwT/gsbFXl8ojWfehBZis3ZqP+9JIQ5oyzaX3WITaf2SiIc2xAnIEX2eRQmv+TgEFA==',key_name='tempest-TestMinimumBasicScenario-668009236',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:06:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60831c0130424415a7bcf071bba28ab0',ramdisk_id='',reservation_id='r-fulgpybi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='99456f5c-cff4-4ad8-afe3-4f5454f6e3ab',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-696617302',owner_user_name='tempest-TestMinimumBasicScenario-696617302-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:08:40Z,user_data=None,user_id='377368f8d9a540aebd8b8760b7130fb5',uuid=449e9147-efe0-4aa1-af52-557e313bf7fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f85faa29-4fe7-4ef1-b746-a1bcad900d9f", "address": "fa:16:3e:e3:84:5d", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85faa29-4f", "ovs_interfaceid": "f85faa29-4fe7-4ef1-b746-a1bcad900d9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-61bf1682-13d2-41d0-bf33-95c195c5e782 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Converting VIF {"id": "f85faa29-4fe7-4ef1-b746-a1bcad900d9f", "address": "fa:16:3e:e3:84:5d", "network": {"id": "b36b65ee-1443-4741-946a-096b65a4e083", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1521246306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60831c0130424415a7bcf071bba28ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85faa29-4f", "ovs_interfaceid": "f85faa29-4fe7-4ef1-b746-a1bcad900d9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-61bf1682-13d2-41d0-bf33-95c195c5e782 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:84:5d,bridge_name='br-int',has_traffic_filtering=True,id=f85faa29-4fe7-4ef1-b746-a1bcad900d9f,network=Network(b36b65ee-1443-4741-946a-096b65a4e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85faa29-4f') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG os_vif [None req-61bf1682-13d2-41d0-bf33-95c195c5e782 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:84:5d,bridge_name='br-int',has_traffic_filtering=True,id=f85faa29-4fe7-4ef1-b746-a1bcad900d9f,network=Network(b36b65ee-1443-4741-946a-096b65a4e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85faa29-4f') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-97340d7c-35d7-42a8-953b-9025d508f92c tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T03:49:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1651379021',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1651379021',id=2,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T03:49:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92a182cdeb8543fea1ab24326734991e',ramdisk_id='',reservation_id='r-zwcl00y6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648299000',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T03:51:24Z,user_data=None,user_id='630b9ba8f1d9471f9cea51f74106381a',uuid=5bfa6580-e0fe-46b0-b497-8db67806113a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f08242a-d68d-4744-8b4c-49bdc29ea557", "address": "fa:16:3e:65:f5:c2", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f08242a-d6", "ovs_interfaceid": "3f08242a-d68d-4744-8b4c-49bdc29ea557", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-97340d7c-35d7-42a8-953b-9025d508f92c tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Converting VIF {"id": "3f08242a-d68d-4744-8b4c-49bdc29ea557", "address": "fa:16:3e:65:f5:c2", "network": {"id": "d45dbf14-9570-46c1-91a3-cbe2f7972b02", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1563730725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92a182cdeb8543fea1ab24326734991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f08242a-d6", "ovs_interfaceid": "3f08242a-d68d-4744-8b4c-49bdc29ea557", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-97340d7c-35d7-42a8-953b-9025d508f92c tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:f5:c2,bridge_name='br-int',has_traffic_filtering=True,id=3f08242a-d68d-4744-8b4c-49bdc29ea557,network=Network(d45dbf14-9570-46c1-91a3-cbe2f7972b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f08242a-d6') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG os_vif [None req-97340d7c-35d7-42a8-953b-9025d508f92c tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:f5:c2,bridge_name='br-int',has_traffic_filtering=True,id=3f08242a-d68d-4744-8b4c-49bdc29ea557,network=Network(d45dbf14-9570-46c1-91a3-cbe2f7972b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f08242a-d6') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf85faa29-4f, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f08242a-d6, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=36e22727-c4f2-4abc-9355-abe06843d64f) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=432183d8-d6c2-40f3-8ae2-848c2d270281) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:29 user nova-compute[75014]: INFO os_vif [None req-61bf1682-13d2-41d0-bf33-95c195c5e782 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:84:5d,bridge_name='br-int',has_traffic_filtering=True,id=f85faa29-4fe7-4ef1-b746-a1bcad900d9f,network=Network(b36b65ee-1443-4741-946a-096b65a4e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85faa29-4f')
Nov 08 04:11:29 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-61bf1682-13d2-41d0-bf33-95c195c5e782 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Deleting instance files /opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe_del
Nov 08 04:11:29 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-61bf1682-13d2-41d0-bf33-95c195c5e782 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Deletion of /opt/stack/data/nova/instances/449e9147-efe0-4aa1-af52-557e313bf7fe_del complete
Nov 08 04:11:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:29 user nova-compute[75014]: INFO os_vif [None req-97340d7c-35d7-42a8-953b-9025d508f92c tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:f5:c2,bridge_name='br-int',has_traffic_filtering=True,id=3f08242a-d68d-4744-8b4c-49bdc29ea557,network=Network(d45dbf14-9570-46c1-91a3-cbe2f7972b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f08242a-d6')
Nov 08 04:11:29 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-97340d7c-35d7-42a8-953b-9025d508f92c tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Deleting instance files /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a_del
Nov 08 04:11:29 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-97340d7c-35d7-42a8-953b-9025d508f92c tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Deletion of /opt/stack/data/nova/instances/5bfa6580-e0fe-46b0-b497-8db67806113a_del complete
Nov 08 04:11:29 user nova-compute[75014]: INFO nova.compute.manager [None req-61bf1682-13d2-41d0-bf33-95c195c5e782 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 08 04:11:29 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-61bf1682-13d2-41d0-bf33-95c195c5e782 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:11:29 user nova-compute[75014]: INFO nova.compute.manager [None req-97340d7c-35d7-42a8-953b-9025d508f92c tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 08 04:11:29 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-97340d7c-35d7-42a8-953b-9025d508f92c tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:11:29 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:11:30 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:11:30 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Took 0.43 seconds to deallocate network for instance.
Nov 08 04:11:30 user nova-compute[75014]: DEBUG nova.compute.manager [req-d7e1d19b-92f4-4f28-b639-df2693b9f116 req-2990aeec-f68c-497c-b58b-38b76551fbb0 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Received event network-vif-deleted-f85faa29-4fe7-4ef1-b746-a1bcad900d9f {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:11:30 user nova-compute[75014]: INFO nova.compute.manager [req-d7e1d19b-92f4-4f28-b639-df2693b9f116 req-2990aeec-f68c-497c-b58b-38b76551fbb0 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Neutron deleted interface f85faa29-4fe7-4ef1-b746-a1bcad900d9f; detaching it from the instance and deleting it from the info cache
Nov 08 04:11:30 user nova-compute[75014]: DEBUG nova.network.neutron [req-d7e1d19b-92f4-4f28-b639-df2693b9f116 req-2990aeec-f68c-497c-b58b-38b76551fbb0 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:11:30 user nova-compute[75014]: DEBUG nova.compute.manager [req-0a601675-4871-438d-adb3-f484265d29a4 req-288b8a00-3882-4cc6-8fef-dbfe522fc125 service nova] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Received event network-vif-deleted-3f08242a-d68d-4744-8b4c-49bdc29ea557 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:11:30 user nova-compute[75014]: INFO nova.compute.manager [req-0a601675-4871-438d-adb3-f484265d29a4 req-288b8a00-3882-4cc6-8fef-dbfe522fc125 service nova] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Neutron deleted interface 3f08242a-d68d-4744-8b4c-49bdc29ea557; detaching it from the instance and deleting it from the info cache
Nov 08 04:11:30 user nova-compute[75014]: DEBUG nova.network.neutron [req-0a601675-4871-438d-adb3-f484265d29a4 req-288b8a00-3882-4cc6-8fef-dbfe522fc125 service nova] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:11:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-61bf1682-13d2-41d0-bf33-95c195c5e782 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:11:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-61bf1682-13d2-41d0-bf33-95c195c5e782 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:11:30 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:11:30 user nova-compute[75014]: DEBUG nova.compute.manager [req-d7e1d19b-92f4-4f28-b639-df2693b9f116 req-2990aeec-f68c-497c-b58b-38b76551fbb0 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Detach interface failed, port_id=f85faa29-4fe7-4ef1-b746-a1bcad900d9f, reason: Instance 449e9147-efe0-4aa1-af52-557e313bf7fe could not be found. {{(pid=75014) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 04:11:30 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Took 0.79 seconds to deallocate network for instance.
Nov 08 04:11:30 user nova-compute[75014]: DEBUG nova.compute.manager [req-0a601675-4871-438d-adb3-f484265d29a4 req-288b8a00-3882-4cc6-8fef-dbfe522fc125 service nova] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Detach interface failed, port_id=3f08242a-d68d-4744-8b4c-49bdc29ea557, reason: Instance 5bfa6580-e0fe-46b0-b497-8db67806113a could not be found. {{(pid=75014) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 04:11:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-97340d7c-35d7-42a8-953b-9025d508f92c tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:11:30 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-61bf1682-13d2-41d0-bf33-95c195c5e782 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:11:30 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-61bf1682-13d2-41d0-bf33-95c195c5e782 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:11:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-61bf1682-13d2-41d0-bf33-95c195c5e782 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:11:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-97340d7c-35d7-42a8-953b-9025d508f92c tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.169s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:11:30 user nova-compute[75014]: DEBUG nova.compute.manager [req-5d930757-7cb1-480e-a952-ebd65c4fd696 req-321a0e07-4af2-4362-93b5-a6161ed212c8 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Received event network-vif-plugged-f85faa29-4fe7-4ef1-b746-a1bcad900d9f {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:11:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5d930757-7cb1-480e-a952-ebd65c4fd696 req-321a0e07-4af2-4362-93b5-a6161ed212c8 service nova] Acquiring lock "449e9147-efe0-4aa1-af52-557e313bf7fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:11:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5d930757-7cb1-480e-a952-ebd65c4fd696 req-321a0e07-4af2-4362-93b5-a6161ed212c8 service nova] Lock "449e9147-efe0-4aa1-af52-557e313bf7fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:11:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5d930757-7cb1-480e-a952-ebd65c4fd696 req-321a0e07-4af2-4362-93b5-a6161ed212c8 service nova] Lock "449e9147-efe0-4aa1-af52-557e313bf7fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:11:30 user nova-compute[75014]: DEBUG nova.compute.manager [req-5d930757-7cb1-480e-a952-ebd65c4fd696 req-321a0e07-4af2-4362-93b5-a6161ed212c8 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] No waiting events found dispatching network-vif-plugged-f85faa29-4fe7-4ef1-b746-a1bcad900d9f {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:11:30 user nova-compute[75014]: WARNING nova.compute.manager [req-5d930757-7cb1-480e-a952-ebd65c4fd696 req-321a0e07-4af2-4362-93b5-a6161ed212c8 service nova] [instance: 449e9147-efe0-4aa1-af52-557e313bf7fe] Received unexpected event network-vif-plugged-f85faa29-4fe7-4ef1-b746-a1bcad900d9f for instance with vm_state deleted and task_state None.
Nov 08 04:11:30 user nova-compute[75014]: DEBUG nova.compute.manager [req-5d930757-7cb1-480e-a952-ebd65c4fd696 req-321a0e07-4af2-4362-93b5-a6161ed212c8 service nova] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Received event network-vif-unplugged-3f08242a-d68d-4744-8b4c-49bdc29ea557 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:11:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5d930757-7cb1-480e-a952-ebd65c4fd696 req-321a0e07-4af2-4362-93b5-a6161ed212c8 service nova] Acquiring lock "5bfa6580-e0fe-46b0-b497-8db67806113a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:11:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5d930757-7cb1-480e-a952-ebd65c4fd696 req-321a0e07-4af2-4362-93b5-a6161ed212c8 service nova] Lock "5bfa6580-e0fe-46b0-b497-8db67806113a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:11:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5d930757-7cb1-480e-a952-ebd65c4fd696 req-321a0e07-4af2-4362-93b5-a6161ed212c8 service nova] Lock "5bfa6580-e0fe-46b0-b497-8db67806113a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:11:30 user nova-compute[75014]: DEBUG nova.compute.manager [req-5d930757-7cb1-480e-a952-ebd65c4fd696 req-321a0e07-4af2-4362-93b5-a6161ed212c8 service nova] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] No waiting events found dispatching network-vif-unplugged-3f08242a-d68d-4744-8b4c-49bdc29ea557 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:11:30 user nova-compute[75014]: WARNING nova.compute.manager [req-5d930757-7cb1-480e-a952-ebd65c4fd696 req-321a0e07-4af2-4362-93b5-a6161ed212c8 service nova] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Received unexpected event network-vif-unplugged-3f08242a-d68d-4744-8b4c-49bdc29ea557 for instance with vm_state deleted and task_state None.
Nov 08 04:11:30 user nova-compute[75014]: DEBUG nova.compute.manager [req-5d930757-7cb1-480e-a952-ebd65c4fd696 req-321a0e07-4af2-4362-93b5-a6161ed212c8 service nova] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Received event network-vif-plugged-3f08242a-d68d-4744-8b4c-49bdc29ea557 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:11:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5d930757-7cb1-480e-a952-ebd65c4fd696 req-321a0e07-4af2-4362-93b5-a6161ed212c8 service nova] Acquiring lock "5bfa6580-e0fe-46b0-b497-8db67806113a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:11:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5d930757-7cb1-480e-a952-ebd65c4fd696 req-321a0e07-4af2-4362-93b5-a6161ed212c8 service nova] Lock "5bfa6580-e0fe-46b0-b497-8db67806113a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:11:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5d930757-7cb1-480e-a952-ebd65c4fd696 req-321a0e07-4af2-4362-93b5-a6161ed212c8 service nova] Lock "5bfa6580-e0fe-46b0-b497-8db67806113a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:11:30 user nova-compute[75014]: DEBUG nova.compute.manager [req-5d930757-7cb1-480e-a952-ebd65c4fd696 req-321a0e07-4af2-4362-93b5-a6161ed212c8 service nova] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] No waiting events found dispatching network-vif-plugged-3f08242a-d68d-4744-8b4c-49bdc29ea557 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:11:30 user nova-compute[75014]: WARNING nova.compute.manager [req-5d930757-7cb1-480e-a952-ebd65c4fd696 req-321a0e07-4af2-4362-93b5-a6161ed212c8 service nova] [instance: 5bfa6580-e0fe-46b0-b497-8db67806113a] Received unexpected event network-vif-plugged-3f08242a-d68d-4744-8b4c-49bdc29ea557 for instance with vm_state deleted and task_state None.
Nov 08 04:11:30 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-61bf1682-13d2-41d0-bf33-95c195c5e782 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Deleted allocations for instance 449e9147-efe0-4aa1-af52-557e313bf7fe
Nov 08 04:11:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-61bf1682-13d2-41d0-bf33-95c195c5e782 tempest-TestMinimumBasicScenario-696617302 tempest-TestMinimumBasicScenario-696617302-project-member] Lock "449e9147-efe0-4aa1-af52-557e313bf7fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.459s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:11:31 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-97340d7c-35d7-42a8-953b-9025d508f92c tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:11:31 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-97340d7c-35d7-42a8-953b-9025d508f92c tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:11:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-97340d7c-35d7-42a8-953b-9025d508f92c tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.252s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:11:31 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-97340d7c-35d7-42a8-953b-9025d508f92c tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Deleted allocations for instance 5bfa6580-e0fe-46b0-b497-8db67806113a
Nov 08 04:11:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-97340d7c-35d7-42a8-953b-9025d508f92c tempest-ServerBootFromVolumeStableRescueTest-1648299000 tempest-ServerBootFromVolumeStableRescueTest-1648299000-project-member] Lock "5bfa6580-e0fe-46b0-b497-8db67806113a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.296s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:11:33 user nova-compute[75014]: DEBUG nova.compute.manager [req-55921903-fd6d-4198-b66d-e9f8f3e78632 req-001de0f4-6fca-4e43-979e-40f7992f68bd service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Received event network-changed-0fe677fa-7bc0-4ab0-abe1-4078284cb71a {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:11:33 user nova-compute[75014]: DEBUG nova.compute.manager [req-55921903-fd6d-4198-b66d-e9f8f3e78632 req-001de0f4-6fca-4e43-979e-40f7992f68bd service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Refreshing instance network info cache due to event network-changed-0fe677fa-7bc0-4ab0-abe1-4078284cb71a. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:11:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-55921903-fd6d-4198-b66d-e9f8f3e78632 req-001de0f4-6fca-4e43-979e-40f7992f68bd service nova] Acquiring lock "refresh_cache-ace7e2f7-28c3-41e3-b92b-05e834c3968c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:11:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-55921903-fd6d-4198-b66d-e9f8f3e78632 req-001de0f4-6fca-4e43-979e-40f7992f68bd service nova] Acquired lock "refresh_cache-ace7e2f7-28c3-41e3-b92b-05e834c3968c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:11:33 user nova-compute[75014]: DEBUG nova.network.neutron [req-55921903-fd6d-4198-b66d-e9f8f3e78632 req-001de0f4-6fca-4e43-979e-40f7992f68bd service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Refreshing network info cache for port 0fe677fa-7bc0-4ab0-abe1-4078284cb71a {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:11:34 user nova-compute[75014]: DEBUG nova.network.neutron [req-55921903-fd6d-4198-b66d-e9f8f3e78632 req-001de0f4-6fca-4e43-979e-40f7992f68bd service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Updated VIF entry in instance network info cache for port 0fe677fa-7bc0-4ab0-abe1-4078284cb71a. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:11:34 user nova-compute[75014]: DEBUG nova.network.neutron [req-55921903-fd6d-4198-b66d-e9f8f3e78632 req-001de0f4-6fca-4e43-979e-40f7992f68bd service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Updating instance_info_cache with network_info: [{"id": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "address": "fa:16:3e:9c:4b:98", "network": {"id": "11cfca93-63ac-49c6-8cf8-2c7885e21563", "bridge": "br-int", "label": "tempest-TestShelveInstance-1503372709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0174a3477d45e1a6aa8a405b0027b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe677fa-7b", "ovs_interfaceid": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:11:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-55921903-fd6d-4198-b66d-e9f8f3e78632 req-001de0f4-6fca-4e43-979e-40f7992f68bd service nova] Releasing lock "refresh_cache-ace7e2f7-28c3-41e3-b92b-05e834c3968c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:11:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquiring lock "351d7017-81d2-42bd-8d9c-eb820657bb85" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:11:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "351d7017-81d2-42bd-8d9c-eb820657bb85" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:11:34 user nova-compute[75014]: DEBUG nova.compute.manager [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 04:11:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:11:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:11:35 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 04:11:35 user nova-compute[75014]: INFO nova.compute.claims [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Claim successful on node user
Nov 08 04:11:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Acquiring lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:11:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:11:35 user nova-compute[75014]: INFO nova.compute.manager [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Shelve offloading
Nov 08 04:11:35 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:11:35 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:11:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:35 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:11:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.336s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:11:35 user nova-compute[75014]: DEBUG nova.compute.manager [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 04:11:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:35 user nova-compute[75014]: DEBUG nova.compute.manager [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 04:11:35 user nova-compute[75014]: DEBUG nova.network.neutron [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 04:11:35 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 04:11:35 user nova-compute[75014]: DEBUG nova.compute.manager [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 04:11:35 user nova-compute[75014]: DEBUG nova.compute.manager [req-53893680-2148-468d-ae02-c2b438f23914 req-c625ae17-8b7b-485e-afeb-643db7cc5427 service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Received event network-vif-unplugged-0fe677fa-7bc0-4ab0-abe1-4078284cb71a {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:11:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-53893680-2148-468d-ae02-c2b438f23914 req-c625ae17-8b7b-485e-afeb-643db7cc5427 service nova] Acquiring lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:11:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-53893680-2148-468d-ae02-c2b438f23914 req-c625ae17-8b7b-485e-afeb-643db7cc5427 service nova] Lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:11:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-53893680-2148-468d-ae02-c2b438f23914 req-c625ae17-8b7b-485e-afeb-643db7cc5427 service nova] Lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:11:35 user nova-compute[75014]: DEBUG nova.compute.manager [req-53893680-2148-468d-ae02-c2b438f23914 req-c625ae17-8b7b-485e-afeb-643db7cc5427 service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] No waiting events found dispatching network-vif-unplugged-0fe677fa-7bc0-4ab0-abe1-4078284cb71a {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:11:35 user nova-compute[75014]: WARNING nova.compute.manager [req-53893680-2148-468d-ae02-c2b438f23914 req-c625ae17-8b7b-485e-afeb-643db7cc5427 service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Received unexpected event network-vif-unplugged-0fe677fa-7bc0-4ab0-abe1-4078284cb71a for instance with vm_state active and task_state shelving.
Nov 08 04:11:35 user nova-compute[75014]: DEBUG nova.policy [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74a3234564994ff7a7c7fc6166e16aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5003c0e79d42248cd1ff8be29fe3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 04:11:35 user nova-compute[75014]: DEBUG nova.compute.manager [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 04:11:35 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 04:11:35 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Creating image(s)
Nov 08 04:11:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquiring lock "/opt/stack/data/nova/instances/351d7017-81d2-42bd-8d9c-eb820657bb85/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:11:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "/opt/stack/data/nova/instances/351d7017-81d2-42bd-8d9c-eb820657bb85/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:11:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "/opt/stack/data/nova/instances/351d7017-81d2-42bd-8d9c-eb820657bb85/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:11:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.173s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:11:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:11:35 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:36 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Instance destroyed successfully.
Nov 08 04:11:36 user nova-compute[75014]: DEBUG nova.compute.manager [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Acquiring lock "refresh_cache-ace7e2f7-28c3-41e3-b92b-05e834c3968c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Acquired lock "refresh_cache-ace7e2f7-28c3-41e3-b92b-05e834c3968c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG nova.network.neutron [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.201s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/351d7017-81d2-42bd-8d9c-eb820657bb85/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/351d7017-81d2-42bd-8d9c-eb820657bb85/disk 1073741824" returned: 0 in 0.052s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG nova.network.neutron [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Successfully created port: ec6ba361-fe2c-42e8-aa9a-5539139889de {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.173s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Checking if we can resize image /opt/stack/data/nova/instances/351d7017-81d2-42bd-8d9c-eb820657bb85/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351d7017-81d2-42bd-8d9c-eb820657bb85/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351d7017-81d2-42bd-8d9c-eb820657bb85/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Cannot resize image /opt/stack/data/nova/instances/351d7017-81d2-42bd-8d9c-eb820657bb85/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Ensure instance console log exists: /opt/stack/data/nova/instances/351d7017-81d2-42bd-8d9c-eb820657bb85/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG nova.network.neutron [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Updating instance_info_cache with network_info: [{"id": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "address": "fa:16:3e:9c:4b:98", "network": {"id": "11cfca93-63ac-49c6-8cf8-2c7885e21563", "bridge": "br-int", "label": "tempest-TestShelveInstance-1503372709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0174a3477d45e1a6aa8a405b0027b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe677fa-7b", "ovs_interfaceid": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Releasing lock "refresh_cache-ace7e2f7-28c3-41e3-b92b-05e834c3968c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:11:36 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b25630ab-a3b3-4ec7-bd38-3344d90672c9 is timed out.
Nov 08 04:11:36 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Successfully detached device vdb from instance b25630ab-a3b3-4ec7-bd38-3344d90672c9 from the live domain config.
Nov 08 04:11:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BcEQDHAf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:11:36 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:11:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[40837ef3-2056-4bbb-b170-50551e9f67dd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:11:36 user nova-compute[75014]: No targets found.
Nov 08 04:11:36 user nova-compute[75014]: iSNS:
Nov 08 04:11:36 user nova-compute[75014]: No targets found.
Nov 08 04:11:36 user nova-compute[75014]: STATIC:
Nov 08 04:11:36 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:11:36 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:11:36 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:11:36 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26
Nov 08 04:11:36 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:11:36 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:11:36 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437
Nov 08 04:11:36 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:11:36 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:11:36 user nova-compute[75014]: FIRMWARE:
Nov 08 04:11:36 user nova-compute[75014]: No targets found.
Nov 08 04:11:36 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:11:36 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:11:36 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec249ba-3fa6-4039-9cb4-1752ebe64438]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4382fb7-8e25-417b-bcd5-67e0e1a925e4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:11:36 user nova-compute[75014]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)
Nov 08 04:11:36 user nova-compute[75014]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26 (non-flash)
Nov 08 04:11:36 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:11:36 user nova-compute[75014]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)
Nov 08 04:11:36 user nova-compute[75014]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26 (non-flash)
Nov 08 04:11:36 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f03dc7cb640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26'): ({'sdb'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Removing single pathed devices sdb {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd4b167-9ba8-48c8-bee7-c08407b293f2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be247b8-fc0a-4b41-9630-8f1a6be9fea3]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Flushing IO for device /dev/sdb {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG nova.network.neutron [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Successfully updated port: ec6ba361-fe2c-42e8-aa9a-5539139889de {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquiring lock "refresh_cache-351d7017-81d2-42bd-8d9c-eb820657bb85" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquired lock "refresh_cache-351d7017-81d2-42bd-8d9c-eb820657bb85" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG nova.network.neutron [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe89225-1fe7-4ac2-84cd-2b982649f52e]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG nova.compute.manager [req-e4cb5440-980a-4475-90bf-b60691f67096 req-cf146fad-9d7e-472f-ba71-b9442faeb028 service nova] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Received event network-changed-ec6ba361-fe2c-42e8-aa9a-5539139889de {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG nova.compute.manager [req-e4cb5440-980a-4475-90bf-b60691f67096 req-cf146fad-9d7e-472f-ba71-b9442faeb028 service nova] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Refreshing instance network info cache due to event network-changed-ec6ba361-fe2c-42e8-aa9a-5539139889de. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e4cb5440-980a-4475-90bf-b60691f67096 req-cf146fad-9d7e-472f-ba71-b9442faeb028 service nova] Acquiring lock "refresh_cache-351d7017-81d2-42bd-8d9c-eb820657bb85" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b88b88e-c3bb-4c76-b4f5-72bf86570b3c]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] SCSI volumes sdb have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG nova.network.neutron [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a385a8cb-3036-48f2-9f61-dc2f4d1b445d]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:11:36 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26 -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[db76b524-0750-4a9e-87c3-dcc34b2c5cc2]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26, portal: 172.16.0.220,3260]
Nov 08 04:11:37 user nova-compute[75014]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26, portal: 172.16.0.220,3260] successful.
Nov 08 04:11:37 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26 -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:687fb5fd-83e0-4cd8-8605-296b6a461c26 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4f92b4-a97f-4ed6-b35b-334613aa621a]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] <== disconnect_volume: return (321ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:11:37 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Instance destroyed successfully.
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.objects.instance [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lazy-loading 'resources' on Instance uuid ace7e2f7-28c3-41e3-b92b-05e834c3968c {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:09:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1114062548',display_name='tempest-TestShelveInstance-server-1114062548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1114062548',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDciRwDmkXIWJ59cSwLkrq0g6fRWYu1rgIHdChGoGUVHZISbu0npqT6Q3VTBlFFTYXtLW//rqLSyyNUm93IqVTTPMb/uBRfKBfBqHi/1FWKNAmj/2k9FvggMVKvEN4GfIA==',key_name='tempest-TestShelveInstance-26222747',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:10:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad0174a3477d45e1a6aa8a405b0027b8',ramdisk_id='',reservation_id='r-v4udig5g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-958337227',owner_user_name='tempest-TestShelveInstance-958337227-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:10:22Z,user_data=None,user_id='58b14797a2974cb19e3759f51c391509',uuid=ace7e2f7-28c3-41e3-b92b-05e834c3968c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "address": "fa:16:3e:9c:4b:98", "network": {"id": "11cfca93-63ac-49c6-8cf8-2c7885e21563", "bridge": "br-int", "label": "tempest-TestShelveInstance-1503372709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0174a3477d45e1a6aa8a405b0027b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe677fa-7b", "ovs_interfaceid": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Converting VIF {"id": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "address": "fa:16:3e:9c:4b:98", "network": {"id": "11cfca93-63ac-49c6-8cf8-2c7885e21563", "bridge": "br-int", "label": "tempest-TestShelveInstance-1503372709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0174a3477d45e1a6aa8a405b0027b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe677fa-7b", "ovs_interfaceid": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:4b:98,bridge_name='br-int',has_traffic_filtering=True,id=0fe677fa-7bc0-4ab0-abe1-4078284cb71a,network=Network(11cfca93-63ac-49c6-8cf8-2c7885e21563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe677fa-7b') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG os_vif [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:4b:98,bridge_name='br-int',has_traffic_filtering=True,id=0fe677fa-7bc0-4ab0-abe1-4078284cb71a,network=Network(11cfca93-63ac-49c6-8cf8-2c7885e21563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe677fa-7b') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0fe677fa-7b, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea7a7fee-7ffe-452c-92af-1a4e1eb8f079) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:37 user nova-compute[75014]: INFO os_vif [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:4b:98,bridge_name='br-int',has_traffic_filtering=True,id=0fe677fa-7bc0-4ab0-abe1-4078284cb71a,network=Network(11cfca93-63ac-49c6-8cf8-2c7885e21563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe677fa-7b')
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zoZcGiyA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:11:37 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:11:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.network.neutron [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Updating instance_info_cache with network_info: [{"id": "ec6ba361-fe2c-42e8-aa9a-5539139889de", "address": "fa:16:3e:8b:46:82", "network": {"id": "25bc77a0-1460-485f-a61a-a43843631782", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-430613931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e5003c0e79d42248cd1ff8be29fe3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec6ba361-fe", "ovs_interfaceid": "ec6ba361-fe2c-42e8-aa9a-5539139889de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Releasing lock "refresh_cache-351d7017-81d2-42bd-8d9c-eb820657bb85" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.compute.manager [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Instance network_info: |[{"id": "ec6ba361-fe2c-42e8-aa9a-5539139889de", "address": "fa:16:3e:8b:46:82", "network": {"id": "25bc77a0-1460-485f-a61a-a43843631782", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-430613931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e5003c0e79d42248cd1ff8be29fe3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec6ba361-fe", "ovs_interfaceid": "ec6ba361-fe2c-42e8-aa9a-5539139889de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e4cb5440-980a-4475-90bf-b60691f67096 req-cf146fad-9d7e-472f-ba71-b9442faeb028 service nova] Acquired lock "refresh_cache-351d7017-81d2-42bd-8d9c-eb820657bb85" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.network.neutron [req-e4cb5440-980a-4475-90bf-b60691f67096 req-cf146fad-9d7e-472f-ba71-b9442faeb028 service nova] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Refreshing network info cache for port ec6ba361-fe2c-42e8-aa9a-5539139889de {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Start _get_guest_xml network_info=[{"id": "ec6ba361-fe2c-42e8-aa9a-5539139889de", "address": "fa:16:3e:8b:46:82", "network": {"id": "25bc77a0-1460-485f-a61a-a43843631782", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-430613931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e5003c0e79d42248cd1ff8be29fe3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec6ba361-fe", "ovs_interfaceid": "ec6ba361-fe2c-42e8-aa9a-5539139889de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a18208-4b37-4c6b-82c2-46adbb7b037d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:11:37 user nova-compute[75014]: No targets found.
Nov 08 04:11:37 user nova-compute[75014]: iSNS:
Nov 08 04:11:37 user nova-compute[75014]: No targets found.
Nov 08 04:11:37 user nova-compute[75014]: STATIC:
Nov 08 04:11:37 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:11:37 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:11:37 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:11:37 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437
Nov 08 04:11:37 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:11:37 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:11:37 user nova-compute[75014]: FIRMWARE:
Nov 08 04:11:37 user nova-compute[75014]: No targets found.
Nov 08 04:11:37 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:11:37 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:11:37 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:37 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:11:37 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d126ab-344c-40d2-b1ff-a947e1c31f1e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1284933924',display_name='tempest-VolumesSnapshotTestJSON-instance-1284933924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1284933924',id=37,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSa5EchfjoJE8Ph1z0slWigcvKkX3eNIAxFjXMEuVQtMFSl1dl3p7mey3BUJfRUibmFFXHPmf7iwyACPpKRM6S7UMXrtupTM2aqn5xuNcJPRY0QuL/KBr5sz+s728SDJg==',key_name='tempest-keypair-509218668',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e5003c0e79d42248cd1ff8be29fe3b0',ramdisk_id='',reservation_id='r-duyht1s0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-334487690',owner_user_name='tempest-VolumesSnapshotTestJSON-334487690-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:11:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74a3234564994ff7a7c7fc6166e16aef',uuid=351d7017-81d2-42bd-8d9c-eb820657bb85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec6ba361-fe2c-42e8-aa9a-5539139889de", "address": "fa:16:3e:8b:46:82", "network": {"id": "25bc77a0-1460-485f-a61a-a43843631782", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-430613931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e5003c0e79d42248cd1ff8be29fe3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec6ba361-fe", "ovs_interfaceid": "ec6ba361-fe2c-42e8-aa9a-5539139889de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Converting VIF {"id": "ec6ba361-fe2c-42e8-aa9a-5539139889de", "address": "fa:16:3e:8b:46:82", "network": {"id": "25bc77a0-1460-485f-a61a-a43843631782", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-430613931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e5003c0e79d42248cd1ff8be29fe3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec6ba361-fe", "ovs_interfaceid": "ec6ba361-fe2c-42e8-aa9a-5539139889de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:46:82,bridge_name='br-int',has_traffic_filtering=True,id=ec6ba361-fe2c-42e8-aa9a-5539139889de,network=Network(25bc77a0-1460-485f-a61a-a43843631782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec6ba361-fe') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.objects.instance [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lazy-loading 'pci_devices' on Instance uuid 351d7017-81d2-42bd-8d9c-eb820657bb85 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e442488-c193-45ff-941e-9bc2024d6ee7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:11:37 user nova-compute[75014]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)
Nov 08 04:11:37 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:11:37 user nova-compute[75014]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)
Nov 08 04:11:37 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0400614790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437'): ({'sde'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Removing single pathed devices sde {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:11:37 user nova-compute[75014]:   <uuid>351d7017-81d2-42bd-8d9c-eb820657bb85</uuid>
Nov 08 04:11:37 user nova-compute[75014]:   <name>instance-00000025</name>
Nov 08 04:11:37 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:11:37 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:11:37 user nova-compute[75014]:   <metadata>
Nov 08 04:11:37 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:11:37 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:11:37 user nova-compute[75014]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1284933924</nova:name>
Nov 08 04:11:37 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:11:37</nova:creationTime>
Nov 08 04:11:37 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:11:37 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:11:37 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:11:37 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:11:37 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:11:37 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:11:37 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:11:37 user nova-compute[75014]:       <nova:owner>
Nov 08 04:11:37 user nova-compute[75014]:         <nova:user uuid="74a3234564994ff7a7c7fc6166e16aef">tempest-VolumesSnapshotTestJSON-334487690-project-member</nova:user>
Nov 08 04:11:37 user nova-compute[75014]:         <nova:project uuid="9e5003c0e79d42248cd1ff8be29fe3b0">tempest-VolumesSnapshotTestJSON-334487690</nova:project>
Nov 08 04:11:37 user nova-compute[75014]:       </nova:owner>
Nov 08 04:11:37 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:11:37 user nova-compute[75014]:       <nova:ports>
Nov 08 04:11:37 user nova-compute[75014]:         <nova:port uuid="ec6ba361-fe2c-42e8-aa9a-5539139889de">
Nov 08 04:11:37 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 04:11:37 user nova-compute[75014]:         </nova:port>
Nov 08 04:11:37 user nova-compute[75014]:       </nova:ports>
Nov 08 04:11:37 user nova-compute[75014]:     </nova:instance>
Nov 08 04:11:37 user nova-compute[75014]:   </metadata>
Nov 08 04:11:37 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:11:37 user nova-compute[75014]:     <system>
Nov 08 04:11:37 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:11:37 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:11:37 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:11:37 user nova-compute[75014]:       <entry name="serial">351d7017-81d2-42bd-8d9c-eb820657bb85</entry>
Nov 08 04:11:37 user nova-compute[75014]:       <entry name="uuid">351d7017-81d2-42bd-8d9c-eb820657bb85</entry>
Nov 08 04:11:37 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:11:37 user nova-compute[75014]:     </system>
Nov 08 04:11:37 user nova-compute[75014]:   </sysinfo>
Nov 08 04:11:37 user nova-compute[75014]:   <os>
Nov 08 04:11:37 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:11:37 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:11:37 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:11:37 user nova-compute[75014]:   </os>
Nov 08 04:11:37 user nova-compute[75014]:   <features>
Nov 08 04:11:37 user nova-compute[75014]:     <acpi/>
Nov 08 04:11:37 user nova-compute[75014]:     <apic/>
Nov 08 04:11:37 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:11:37 user nova-compute[75014]:   </features>
Nov 08 04:11:37 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:11:37 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:11:37 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:11:37 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:11:37 user nova-compute[75014]:   </clock>
Nov 08 04:11:37 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:11:37 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:11:37 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:11:37 user nova-compute[75014]:   </cpu>
Nov 08 04:11:37 user nova-compute[75014]:   <devices>
Nov 08 04:11:37 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 04:11:37 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 04:11:37 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/351d7017-81d2-42bd-8d9c-eb820657bb85/disk"/>
Nov 08 04:11:37 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:11:37 user nova-compute[75014]:     </disk>
Nov 08 04:11:37 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:11:37 user nova-compute[75014]:       <mac address="fa:16:3e:8b:46:82"/>
Nov 08 04:11:37 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:11:37 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:11:37 user nova-compute[75014]:       <target dev="tapec6ba361-fe"/>
Nov 08 04:11:37 user nova-compute[75014]:     </interface>
Nov 08 04:11:37 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:11:37 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/351d7017-81d2-42bd-8d9c-eb820657bb85/console.log" append="off"/>
Nov 08 04:11:37 user nova-compute[75014]:     </serial>
Nov 08 04:11:37 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:11:37 user nova-compute[75014]:     <video>
Nov 08 04:11:37 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:11:37 user nova-compute[75014]:     </video>
Nov 08 04:11:37 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:11:37 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:11:37 user nova-compute[75014]:     </rng>
Nov 08 04:11:37 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:11:37 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:11:37 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:11:37 user nova-compute[75014]:     </memballoon>
Nov 08 04:11:37 user nova-compute[75014]:   </devices>
Nov 08 04:11:37 user nova-compute[75014]: </domain>
Nov 08 04:11:37 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1284933924',display_name='tempest-VolumesSnapshotTestJSON-instance-1284933924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1284933924',id=37,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSa5EchfjoJE8Ph1z0slWigcvKkX3eNIAxFjXMEuVQtMFSl1dl3p7mey3BUJfRUibmFFXHPmf7iwyACPpKRM6S7UMXrtupTM2aqn5xuNcJPRY0QuL/KBr5sz+s728SDJg==',key_name='tempest-keypair-509218668',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e5003c0e79d42248cd1ff8be29fe3b0',ramdisk_id='',reservation_id='r-duyht1s0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-334487690',owner_user_name='tempest-VolumesSnapshotTestJSON-334487690-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:11:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74a3234564994ff7a7c7fc6166e16aef',uuid=351d7017-81d2-42bd-8d9c-eb820657bb85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec6ba361-fe2c-42e8-aa9a-5539139889de", "address": "fa:16:3e:8b:46:82", "network": {"id": "25bc77a0-1460-485f-a61a-a43843631782", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-430613931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e5003c0e79d42248cd1ff8be29fe3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec6ba361-fe", "ovs_interfaceid": "ec6ba361-fe2c-42e8-aa9a-5539139889de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Converting VIF {"id": "ec6ba361-fe2c-42e8-aa9a-5539139889de", "address": "fa:16:3e:8b:46:82", "network": {"id": "25bc77a0-1460-485f-a61a-a43843631782", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-430613931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e5003c0e79d42248cd1ff8be29fe3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec6ba361-fe", "ovs_interfaceid": "ec6ba361-fe2c-42e8-aa9a-5539139889de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:46:82,bridge_name='br-int',has_traffic_filtering=True,id=ec6ba361-fe2c-42e8-aa9a-5539139889de,network=Network(25bc77a0-1460-485f-a61a-a43843631782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec6ba361-fe') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG os_vif [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:46:82,bridge_name='br-int',has_traffic_filtering=True,id=ec6ba361-fe2c-42e8-aa9a-5539139889de,network=Network(25bc77a0-1460-485f-a61a-a43843631782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec6ba361-fe') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '911935e3-734e-5fe7-9bcc-a0fece68b9ec', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efa56f2-bf30-4a05-9bae-819e338e6d0b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f84baae-a186-48c9-8e7f-855ef50587b8]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Flushing IO for device /dev/sde {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec6ba361-fe, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec6ba361-fe, col_values=(('qos', UUID('41e36362-a8c5-4345-9948-032b9d77d934')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec6ba361-fe, col_values=(('external_ids', {'iface-id': 'ec6ba361-fe2c-42e8-aa9a-5539139889de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:46:82', 'vm-uuid': '351d7017-81d2-42bd-8d9c-eb820657bb85'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5cf644-dd37-4ae0-8fd3-0afce6f14871]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:11:37 user nova-compute[75014]: INFO os_vif [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:46:82,bridge_name='br-int',has_traffic_filtering=True,id=ec6ba361-fe2c-42e8-aa9a-5539139889de,network=Network(25bc77a0-1460-485f-a61a-a43843631782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec6ba361-fe')
Nov 08 04:11:37 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6964fb02-a9e5-4afa-ac0a-df36474e1789]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] SCSI volumes sde have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed527bd7-cc46-485b-842b-2f0df58f96f4]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] No VIF found with MAC fa:16:3e:8b:46:82, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-c23c9e00-b782-4530-bb01-a7a167951c1d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-c23c9e00-b782-4530-bb01-a7a167951c1d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62de58b-c5ec-4ca4-b666-fef54ddc9355]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437, portal: 172.16.0.220,3260]
Nov 08 04:11:37 user nova-compute[75014]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437, portal: 172.16.0.220,3260] successful.
Nov 08 04:11:37 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.compute.manager [req-67fcbaed-c501-4999-9680-52fdc8063220 req-e98d9ed3-009b-4d2b-84a9-c81f2dff703a service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Received event network-vif-plugged-0fe677fa-7bc0-4ab0-abe1-4078284cb71a {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-67fcbaed-c501-4999-9680-52fdc8063220 req-e98d9ed3-009b-4d2b-84a9-c81f2dff703a service nova] Acquiring lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-67fcbaed-c501-4999-9680-52fdc8063220 req-e98d9ed3-009b-4d2b-84a9-c81f2dff703a service nova] Lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-67fcbaed-c501-4999-9680-52fdc8063220 req-e98d9ed3-009b-4d2b-84a9-c81f2dff703a service nova] Lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.compute.manager [req-67fcbaed-c501-4999-9680-52fdc8063220 req-e98d9ed3-009b-4d2b-84a9-c81f2dff703a service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] No waiting events found dispatching network-vif-plugged-0fe677fa-7bc0-4ab0-abe1-4078284cb71a {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:11:37 user nova-compute[75014]: WARNING nova.compute.manager [req-67fcbaed-c501-4999-9680-52fdc8063220 req-e98d9ed3-009b-4d2b-84a9-c81f2dff703a service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Received unexpected event network-vif-plugged-0fe677fa-7bc0-4ab0-abe1-4078284cb71a for instance with vm_state active and task_state shelving.
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.compute.manager [req-67fcbaed-c501-4999-9680-52fdc8063220 req-e98d9ed3-009b-4d2b-84a9-c81f2dff703a service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Received event network-changed-0fe677fa-7bc0-4ab0-abe1-4078284cb71a {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.compute.manager [req-67fcbaed-c501-4999-9680-52fdc8063220 req-e98d9ed3-009b-4d2b-84a9-c81f2dff703a service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Refreshing instance network info cache due to event network-changed-0fe677fa-7bc0-4ab0-abe1-4078284cb71a. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-67fcbaed-c501-4999-9680-52fdc8063220 req-e98d9ed3-009b-4d2b-84a9-c81f2dff703a service nova] Acquiring lock "refresh_cache-ace7e2f7-28c3-41e3-b92b-05e834c3968c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-67fcbaed-c501-4999-9680-52fdc8063220 req-e98d9ed3-009b-4d2b-84a9-c81f2dff703a service nova] Acquired lock "refresh_cache-ace7e2f7-28c3-41e3-b92b-05e834c3968c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.network.neutron [req-67fcbaed-c501-4999-9680-52fdc8063220 req-e98d9ed3-009b-4d2b-84a9-c81f2dff703a service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Refreshing network info cache for port 0fe677fa-7bc0-4ab0-abe1-4078284cb71a {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc85ba8-2a45-449d-93a1-6489323ce812]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.468s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] <== disconnect_volume: return (469ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:11:37 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Deleting instance files /opt/stack/data/nova/instances/ace7e2f7-28c3-41e3-b92b-05e834c3968c_del
Nov 08 04:11:37 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Deletion of /opt/stack/data/nova/instances/ace7e2f7-28c3-41e3-b92b-05e834c3968c_del complete
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.network.neutron [req-e4cb5440-980a-4475-90bf-b60691f67096 req-cf146fad-9d7e-472f-ba71-b9442faeb028 service nova] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Updated VIF entry in instance network info cache for port ec6ba361-fe2c-42e8-aa9a-5539139889de. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG nova.network.neutron [req-e4cb5440-980a-4475-90bf-b60691f67096 req-cf146fad-9d7e-472f-ba71-b9442faeb028 service nova] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Updating instance_info_cache with network_info: [{"id": "ec6ba361-fe2c-42e8-aa9a-5539139889de", "address": "fa:16:3e:8b:46:82", "network": {"id": "25bc77a0-1460-485f-a61a-a43843631782", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-430613931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e5003c0e79d42248cd1ff8be29fe3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec6ba361-fe", "ovs_interfaceid": "ec6ba361-fe2c-42e8-aa9a-5539139889de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:11:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e4cb5440-980a-4475-90bf-b60691f67096 req-cf146fad-9d7e-472f-ba71-b9442faeb028 service nova] Releasing lock "refresh_cache-351d7017-81d2-42bd-8d9c-eb820657bb85" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:11:38 user nova-compute[75014]: DEBUG nova.objects.instance [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lazy-loading 'flavor' on Instance uuid b25630ab-a3b3-4ec7-bd38-3344d90672c9 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:11:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-55925a97-0eba-4a2f-a3eb-cc971c80c2b4 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "b25630ab-a3b3-4ec7-bd38-3344d90672c9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.189s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:11:38 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Updating instance_info_cache with network_info: [{"id": "4f3b192f-a567-463a-b120-1b328e11feaa", "address": "fa:16:3e:70:b6:a1", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3b192f-a5", "ovs_interfaceid": "4f3b192f-a567-463a-b120-1b328e11feaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:11:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-c23c9e00-b782-4530-bb01-a7a167951c1d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:11:38 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 04:11:38 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:11:38 user nova-compute[75014]: DEBUG nova.network.neutron [req-67fcbaed-c501-4999-9680-52fdc8063220 req-e98d9ed3-009b-4d2b-84a9-c81f2dff703a service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Updated VIF entry in instance network info cache for port 0fe677fa-7bc0-4ab0-abe1-4078284cb71a. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:11:38 user nova-compute[75014]: DEBUG nova.network.neutron [req-67fcbaed-c501-4999-9680-52fdc8063220 req-e98d9ed3-009b-4d2b-84a9-c81f2dff703a service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Updating instance_info_cache with network_info: [{"id": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "address": "fa:16:3e:9c:4b:98", "network": {"id": "11cfca93-63ac-49c6-8cf8-2c7885e21563", "bridge": null, "label": "tempest-TestShelveInstance-1503372709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0174a3477d45e1a6aa8a405b0027b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap0fe677fa-7b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:11:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-67fcbaed-c501-4999-9680-52fdc8063220 req-e98d9ed3-009b-4d2b-84a9-c81f2dff703a service nova] Releasing lock "refresh_cache-ace7e2f7-28c3-41e3-b92b-05e834c3968c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:11:38 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Deleted allocations for instance ace7e2f7-28c3-41e3-b92b-05e834c3968c
Nov 08 04:11:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:11:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:11:38 user nova-compute[75014]: DEBUG nova.objects.instance [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lazy-loading 'numa_topology' on Instance uuid ace7e2f7-28c3-41e3-b92b-05e834c3968c {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:11:38 user nova-compute[75014]: DEBUG nova.objects.base [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Object Instance<ace7e2f7-28c3-41e3-b92b-05e834c3968c> lazy-loaded attributes: resources,numa_topology {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:11:39 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:11:39 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:11:39 user nova-compute[75014]: DEBUG nova.compute.manager [req-65ca1a15-762f-4578-b999-0080566af69d req-13dc8a24-e608-4dfb-aafc-c0fd0cdb9f91 service nova] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Received event network-vif-plugged-ec6ba361-fe2c-42e8-aa9a-5539139889de {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:11:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-65ca1a15-762f-4578-b999-0080566af69d req-13dc8a24-e608-4dfb-aafc-c0fd0cdb9f91 service nova] Acquiring lock "351d7017-81d2-42bd-8d9c-eb820657bb85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:11:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-65ca1a15-762f-4578-b999-0080566af69d req-13dc8a24-e608-4dfb-aafc-c0fd0cdb9f91 service nova] Lock "351d7017-81d2-42bd-8d9c-eb820657bb85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:11:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-65ca1a15-762f-4578-b999-0080566af69d req-13dc8a24-e608-4dfb-aafc-c0fd0cdb9f91 service nova] Lock "351d7017-81d2-42bd-8d9c-eb820657bb85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:11:39 user nova-compute[75014]: DEBUG nova.compute.manager [req-65ca1a15-762f-4578-b999-0080566af69d req-13dc8a24-e608-4dfb-aafc-c0fd0cdb9f91 service nova] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] No waiting events found dispatching network-vif-plugged-ec6ba361-fe2c-42e8-aa9a-5539139889de {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:11:39 user nova-compute[75014]: WARNING nova.compute.manager [req-65ca1a15-762f-4578-b999-0080566af69d req-13dc8a24-e608-4dfb-aafc-c0fd0cdb9f91 service nova] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Received unexpected event network-vif-plugged-ec6ba361-fe2c-42e8-aa9a-5539139889de for instance with vm_state building and task_state spawning.
Nov 08 04:11:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.260s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:11:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8e01630d-17c2-4a5f-bfef-159f3bb809ad tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.987s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:11:39 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:11:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:40 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:11:41 user nova-compute[75014]: DEBUG nova.compute.manager [req-4624cf27-c0e6-4443-9474-47f567955d4e req-5061738b-453d-4432-9cd2-945f46fbe358 service nova] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Received event network-vif-plugged-ec6ba361-fe2c-42e8-aa9a-5539139889de {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:11:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4624cf27-c0e6-4443-9474-47f567955d4e req-5061738b-453d-4432-9cd2-945f46fbe358 service nova] Acquiring lock "351d7017-81d2-42bd-8d9c-eb820657bb85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:11:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4624cf27-c0e6-4443-9474-47f567955d4e req-5061738b-453d-4432-9cd2-945f46fbe358 service nova] Lock "351d7017-81d2-42bd-8d9c-eb820657bb85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:11:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4624cf27-c0e6-4443-9474-47f567955d4e req-5061738b-453d-4432-9cd2-945f46fbe358 service nova] Lock "351d7017-81d2-42bd-8d9c-eb820657bb85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:11:41 user nova-compute[75014]: DEBUG nova.compute.manager [req-4624cf27-c0e6-4443-9474-47f567955d4e req-5061738b-453d-4432-9cd2-945f46fbe358 service nova] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] No waiting events found dispatching network-vif-plugged-ec6ba361-fe2c-42e8-aa9a-5539139889de {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:11:41 user nova-compute[75014]: WARNING nova.compute.manager [req-4624cf27-c0e6-4443-9474-47f567955d4e req-5061738b-453d-4432-9cd2-945f46fbe358 service nova] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Received unexpected event network-vif-plugged-ec6ba361-fe2c-42e8-aa9a-5539139889de for instance with vm_state building and task_state spawning.
Nov 08 04:11:41 user nova-compute[75014]: DEBUG nova.compute.manager [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:11:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 04:11:41 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Instance spawned successfully.
Nov 08 04:11:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 04:11:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:11:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:11:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:11:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:11:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:11:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:11:41 user nova-compute[75014]: INFO nova.compute.manager [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Took 5.64 seconds to spawn the instance on the hypervisor.
Nov 08 04:11:41 user nova-compute[75014]: DEBUG nova.compute.manager [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:11:41 user nova-compute[75014]: INFO nova.compute.manager [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Took 6.35 seconds to build instance.
Nov 08 04:11:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0993ef1a-da59-4098-9e85-f4cb7e55e565 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "351d7017-81d2-42bd-8d9c-eb820657bb85" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.447s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:11:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:43 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:11:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:11:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:11:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:11:43 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:11:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25630ab-a3b3-4ec7-bd38-3344d90672c9/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25630ab-a3b3-4ec7-bd38-3344d90672c9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25630ab-a3b3-4ec7-bd38-3344d90672c9/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25630ab-a3b3-4ec7-bd38-3344d90672c9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351d7017-81d2-42bd-8d9c-eb820657bb85/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351d7017-81d2-42bd-8d9c-eb820657bb85/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351d7017-81d2-42bd-8d9c-eb820657bb85/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351d7017-81d2-42bd-8d9c-eb820657bb85/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:11:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:11:45 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:11:45 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:11:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=8352MB free_disk=24.971656799316406GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:11:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:11:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:11:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance c23c9e00-b782-4530-bb01-a7a167951c1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:11:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 781932ce-0bea-466f-95e0-066130d6c410 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:11:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance b25630ab-a3b3-4ec7-bd38-3344d90672c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:11:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:11:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 351d7017-81d2-42bd-8d9c-eb820657bb85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:11:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:11:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:11:46 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:11:46 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:11:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:11:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.333s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:11:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:49 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:11:49 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:11:49 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:11:51 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:11:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:11:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:11:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:11:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:11:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:11:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-df4e5b48-97d3-49ac-8d0c-d4510a71313d tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Acquiring lock "c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:12:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-df4e5b48-97d3-49ac-8d0c-d4510a71313d tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Lock "c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:12:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-df4e5b48-97d3-49ac-8d0c-d4510a71313d tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Acquiring lock "c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:12:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-df4e5b48-97d3-49ac-8d0c-d4510a71313d tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Lock "c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:12:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-df4e5b48-97d3-49ac-8d0c-d4510a71313d tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Lock "c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:12:04 user nova-compute[75014]: INFO nova.compute.manager [None req-df4e5b48-97d3-49ac-8d0c-d4510a71313d tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Terminating instance
Nov 08 04:12:04 user nova-compute[75014]: DEBUG nova.compute.manager [None req-df4e5b48-97d3-49ac-8d0c-d4510a71313d tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:12:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:04 user nova-compute[75014]: DEBUG nova.compute.manager [req-79199d71-2689-424f-bc1e-5541f46f28b1 req-f0d1294e-d830-4186-a743-785b33745333 service nova] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Received event network-vif-unplugged-2f8edc8d-688d-4218-8ab2-5d94deb36ec7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:12:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-79199d71-2689-424f-bc1e-5541f46f28b1 req-f0d1294e-d830-4186-a743-785b33745333 service nova] Acquiring lock "c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:12:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-79199d71-2689-424f-bc1e-5541f46f28b1 req-f0d1294e-d830-4186-a743-785b33745333 service nova] Lock "c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:12:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-79199d71-2689-424f-bc1e-5541f46f28b1 req-f0d1294e-d830-4186-a743-785b33745333 service nova] Lock "c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:12:04 user nova-compute[75014]: DEBUG nova.compute.manager [req-79199d71-2689-424f-bc1e-5541f46f28b1 req-f0d1294e-d830-4186-a743-785b33745333 service nova] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] No waiting events found dispatching network-vif-unplugged-2f8edc8d-688d-4218-8ab2-5d94deb36ec7 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:12:04 user nova-compute[75014]: DEBUG nova.compute.manager [req-79199d71-2689-424f-bc1e-5541f46f28b1 req-f0d1294e-d830-4186-a743-785b33745333 service nova] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Received event network-vif-unplugged-2f8edc8d-688d-4218-8ab2-5d94deb36ec7 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:12:04 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Instance destroyed successfully.
Nov 08 04:12:04 user nova-compute[75014]: DEBUG nova.objects.instance [None req-df4e5b48-97d3-49ac-8d0c-d4510a71313d tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Lazy-loading 'resources' on Instance uuid c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:12:04 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-df4e5b48-97d3-49ac-8d0c-d4510a71313d tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:09:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2078873129',display_name='tempest-VolumesActionsTest-instance-2078873129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2078873129',id=36,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:10:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='326f25150296480b99a0eca140f65204',ramdisk_id='',reservation_id='r-mebc0fg6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-777452474',owner_user_name='tempest-VolumesActionsTest-777452474-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:10:02Z,user_data=None,user_id='b7841ea39b60405b87cc29a2b293ab10',uuid=c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f8edc8d-688d-4218-8ab2-5d94deb36ec7", "address": "fa:16:3e:bd:60:8b", "network": {"id": "5f4fdfa8-0690-4305-9eda-3abf64609f4c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1326493770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "326f25150296480b99a0eca140f65204", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8edc8d-68", "ovs_interfaceid": "2f8edc8d-688d-4218-8ab2-5d94deb36ec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:12:04 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-df4e5b48-97d3-49ac-8d0c-d4510a71313d tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Converting VIF {"id": "2f8edc8d-688d-4218-8ab2-5d94deb36ec7", "address": "fa:16:3e:bd:60:8b", "network": {"id": "5f4fdfa8-0690-4305-9eda-3abf64609f4c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1326493770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "326f25150296480b99a0eca140f65204", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8edc8d-68", "ovs_interfaceid": "2f8edc8d-688d-4218-8ab2-5d94deb36ec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:12:04 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-df4e5b48-97d3-49ac-8d0c-d4510a71313d tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:60:8b,bridge_name='br-int',has_traffic_filtering=True,id=2f8edc8d-688d-4218-8ab2-5d94deb36ec7,network=Network(5f4fdfa8-0690-4305-9eda-3abf64609f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8edc8d-68') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:12:04 user nova-compute[75014]: DEBUG os_vif [None req-df4e5b48-97d3-49ac-8d0c-d4510a71313d tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:60:8b,bridge_name='br-int',has_traffic_filtering=True,id=2f8edc8d-688d-4218-8ab2-5d94deb36ec7,network=Network(5f4fdfa8-0690-4305-9eda-3abf64609f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8edc8d-68') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:12:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f8edc8d-68, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:12:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:12:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a419c2cc-7011-4659-848d-b38b4970731c) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:12:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:12:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:05 user nova-compute[75014]: INFO os_vif [None req-df4e5b48-97d3-49ac-8d0c-d4510a71313d tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:60:8b,bridge_name='br-int',has_traffic_filtering=True,id=2f8edc8d-688d-4218-8ab2-5d94deb36ec7,network=Network(5f4fdfa8-0690-4305-9eda-3abf64609f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8edc8d-68')
Nov 08 04:12:05 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-df4e5b48-97d3-49ac-8d0c-d4510a71313d tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Deleting instance files /opt/stack/data/nova/instances/c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf_del
Nov 08 04:12:05 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-df4e5b48-97d3-49ac-8d0c-d4510a71313d tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Deletion of /opt/stack/data/nova/instances/c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf_del complete
Nov 08 04:12:05 user nova-compute[75014]: INFO nova.compute.manager [None req-df4e5b48-97d3-49ac-8d0c-d4510a71313d tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 08 04:12:05 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-df4e5b48-97d3-49ac-8d0c-d4510a71313d tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:12:05 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:12:05 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:12:05 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:12:05 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Took 0.65 seconds to deallocate network for instance.
Nov 08 04:12:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-df4e5b48-97d3-49ac-8d0c-d4510a71313d tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:12:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-df4e5b48-97d3-49ac-8d0c-d4510a71313d tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:12:05 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-df4e5b48-97d3-49ac-8d0c-d4510a71313d tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:12:05 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-df4e5b48-97d3-49ac-8d0c-d4510a71313d tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:12:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-df4e5b48-97d3-49ac-8d0c-d4510a71313d tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.219s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:12:06 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-df4e5b48-97d3-49ac-8d0c-d4510a71313d tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Deleted allocations for instance c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf
Nov 08 04:12:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-df4e5b48-97d3-49ac-8d0c-d4510a71313d tempest-VolumesActionsTest-777452474 tempest-VolumesActionsTest-777452474-project-member] Lock "c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.766s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:12:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ad229b78-6443-4fb9-8b12-c225bbfc8a31 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "b25630ab-a3b3-4ec7-bd38-3344d90672c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:12:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ad229b78-6443-4fb9-8b12-c225bbfc8a31 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "b25630ab-a3b3-4ec7-bd38-3344d90672c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:12:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ad229b78-6443-4fb9-8b12-c225bbfc8a31 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "b25630ab-a3b3-4ec7-bd38-3344d90672c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:12:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ad229b78-6443-4fb9-8b12-c225bbfc8a31 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "b25630ab-a3b3-4ec7-bd38-3344d90672c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:12:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ad229b78-6443-4fb9-8b12-c225bbfc8a31 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "b25630ab-a3b3-4ec7-bd38-3344d90672c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:12:06 user nova-compute[75014]: INFO nova.compute.manager [None req-ad229b78-6443-4fb9-8b12-c225bbfc8a31 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Terminating instance
Nov 08 04:12:06 user nova-compute[75014]: DEBUG nova.compute.manager [None req-ad229b78-6443-4fb9-8b12-c225bbfc8a31 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:12:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:06 user nova-compute[75014]: DEBUG nova.compute.manager [req-dfc4b9c9-e23b-4e38-87e6-34e9c8927e26 req-cad43d00-1ddb-45e4-8a62-8120096d9d28 service nova] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Received event network-vif-unplugged-4320bd7b-bdf6-400d-9e6e-2d29c34ccf84 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:12:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dfc4b9c9-e23b-4e38-87e6-34e9c8927e26 req-cad43d00-1ddb-45e4-8a62-8120096d9d28 service nova] Acquiring lock "b25630ab-a3b3-4ec7-bd38-3344d90672c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:12:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dfc4b9c9-e23b-4e38-87e6-34e9c8927e26 req-cad43d00-1ddb-45e4-8a62-8120096d9d28 service nova] Lock "b25630ab-a3b3-4ec7-bd38-3344d90672c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:12:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dfc4b9c9-e23b-4e38-87e6-34e9c8927e26 req-cad43d00-1ddb-45e4-8a62-8120096d9d28 service nova] Lock "b25630ab-a3b3-4ec7-bd38-3344d90672c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:12:06 user nova-compute[75014]: DEBUG nova.compute.manager [req-dfc4b9c9-e23b-4e38-87e6-34e9c8927e26 req-cad43d00-1ddb-45e4-8a62-8120096d9d28 service nova] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] No waiting events found dispatching network-vif-unplugged-4320bd7b-bdf6-400d-9e6e-2d29c34ccf84 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:12:06 user nova-compute[75014]: DEBUG nova.compute.manager [req-dfc4b9c9-e23b-4e38-87e6-34e9c8927e26 req-cad43d00-1ddb-45e4-8a62-8120096d9d28 service nova] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Received event network-vif-unplugged-4320bd7b-bdf6-400d-9e6e-2d29c34ccf84 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:12:06 user nova-compute[75014]: DEBUG nova.compute.manager [req-dead7b03-0057-451e-b16b-898849e40ee2 req-ded275fb-40b1-4c71-b983-a1813b59f81d service nova] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Received event network-vif-plugged-2f8edc8d-688d-4218-8ab2-5d94deb36ec7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:12:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dead7b03-0057-451e-b16b-898849e40ee2 req-ded275fb-40b1-4c71-b983-a1813b59f81d service nova] Acquiring lock "c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:12:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dead7b03-0057-451e-b16b-898849e40ee2 req-ded275fb-40b1-4c71-b983-a1813b59f81d service nova] Lock "c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:12:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dead7b03-0057-451e-b16b-898849e40ee2 req-ded275fb-40b1-4c71-b983-a1813b59f81d service nova] Lock "c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:12:06 user nova-compute[75014]: DEBUG nova.compute.manager [req-dead7b03-0057-451e-b16b-898849e40ee2 req-ded275fb-40b1-4c71-b983-a1813b59f81d service nova] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] No waiting events found dispatching network-vif-plugged-2f8edc8d-688d-4218-8ab2-5d94deb36ec7 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:12:06 user nova-compute[75014]: WARNING nova.compute.manager [req-dead7b03-0057-451e-b16b-898849e40ee2 req-ded275fb-40b1-4c71-b983-a1813b59f81d service nova] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Received unexpected event network-vif-plugged-2f8edc8d-688d-4218-8ab2-5d94deb36ec7 for instance with vm_state deleted and task_state None.
Nov 08 04:12:06 user nova-compute[75014]: DEBUG nova.compute.manager [req-dead7b03-0057-451e-b16b-898849e40ee2 req-ded275fb-40b1-4c71-b983-a1813b59f81d service nova] [instance: c7cb3c44-9cdc-49b0-ba9c-043c61d46fcf] Received event network-vif-deleted-2f8edc8d-688d-4218-8ab2-5d94deb36ec7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:12:07 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Instance destroyed successfully.
Nov 08 04:12:07 user nova-compute[75014]: DEBUG nova.objects.instance [None req-ad229b78-6443-4fb9-8b12-c225bbfc8a31 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lazy-loading 'resources' on Instance uuid b25630ab-a3b3-4ec7-bd38-3344d90672c9 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:12:07 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-ad229b78-6443-4fb9-8b12-c225bbfc8a31 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-841779446',display_name='tempest-AttachVolumeNegativeTest-server-841779446',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-841779446',id=34,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYiRuI6Qlrw5LB0w6rGjxj+RuPR9hBpFUKhepgvXYNgL4ISheWawEWS0cIN+5drheKvD0hhBsmbiQzrgZeL7Sgu1v34CnmjYiZJWha7ZmnUqEfdP4APbCpA7ikogdjzZA==',key_name='tempest-keypair-402936703',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:08:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1c9753cb588478a8a93182be3256674',ramdisk_id='',reservation_id='r-qd6pjmx2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1215701914',owner_user_name='tempest-AttachVolumeNegativeTest-1215701914-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:08:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8c674d8b2cf49c08cf254a8095ef8ea',uuid=b25630ab-a3b3-4ec7-bd38-3344d90672c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4320bd7b-bdf6-400d-9e6e-2d29c34ccf84", "address": "fa:16:3e:94:e1:8b", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4320bd7b-bd", "ovs_interfaceid": "4320bd7b-bdf6-400d-9e6e-2d29c34ccf84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:12:07 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-ad229b78-6443-4fb9-8b12-c225bbfc8a31 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Converting VIF {"id": "4320bd7b-bdf6-400d-9e6e-2d29c34ccf84", "address": "fa:16:3e:94:e1:8b", "network": {"id": "f3d67270-d525-45d9-958c-a901d121d510", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-118620804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1c9753cb588478a8a93182be3256674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4320bd7b-bd", "ovs_interfaceid": "4320bd7b-bdf6-400d-9e6e-2d29c34ccf84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:12:07 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-ad229b78-6443-4fb9-8b12-c225bbfc8a31 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:e1:8b,bridge_name='br-int',has_traffic_filtering=True,id=4320bd7b-bdf6-400d-9e6e-2d29c34ccf84,network=Network(f3d67270-d525-45d9-958c-a901d121d510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4320bd7b-bd') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:12:07 user nova-compute[75014]: DEBUG os_vif [None req-ad229b78-6443-4fb9-8b12-c225bbfc8a31 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:e1:8b,bridge_name='br-int',has_traffic_filtering=True,id=4320bd7b-bdf6-400d-9e6e-2d29c34ccf84,network=Network(f3d67270-d525-45d9-958c-a901d121d510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4320bd7b-bd') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:12:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4320bd7b-bd, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:12:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:12:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=899280bd-77ff-43e7-ad60-6f96aa91eafa) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:12:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:12:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:07 user nova-compute[75014]: INFO os_vif [None req-ad229b78-6443-4fb9-8b12-c225bbfc8a31 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:e1:8b,bridge_name='br-int',has_traffic_filtering=True,id=4320bd7b-bdf6-400d-9e6e-2d29c34ccf84,network=Network(f3d67270-d525-45d9-958c-a901d121d510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4320bd7b-bd')
Nov 08 04:12:07 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-ad229b78-6443-4fb9-8b12-c225bbfc8a31 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Deleting instance files /opt/stack/data/nova/instances/b25630ab-a3b3-4ec7-bd38-3344d90672c9_del
Nov 08 04:12:07 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-ad229b78-6443-4fb9-8b12-c225bbfc8a31 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Deletion of /opt/stack/data/nova/instances/b25630ab-a3b3-4ec7-bd38-3344d90672c9_del complete
Nov 08 04:12:07 user nova-compute[75014]: INFO nova.compute.manager [None req-ad229b78-6443-4fb9-8b12-c225bbfc8a31 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 08 04:12:07 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-ad229b78-6443-4fb9-8b12-c225bbfc8a31 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:12:07 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:12:07 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:12:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:07 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:12:07 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Took 0.73 seconds to deallocate network for instance.
Nov 08 04:12:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ad229b78-6443-4fb9-8b12-c225bbfc8a31 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:12:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ad229b78-6443-4fb9-8b12-c225bbfc8a31 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:12:08 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-ad229b78-6443-4fb9-8b12-c225bbfc8a31 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:12:08 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-ad229b78-6443-4fb9-8b12-c225bbfc8a31 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:12:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ad229b78-6443-4fb9-8b12-c225bbfc8a31 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.188s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:12:08 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-ad229b78-6443-4fb9-8b12-c225bbfc8a31 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Deleted allocations for instance b25630ab-a3b3-4ec7-bd38-3344d90672c9
Nov 08 04:12:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ad229b78-6443-4fb9-8b12-c225bbfc8a31 tempest-AttachVolumeNegativeTest-1215701914 tempest-AttachVolumeNegativeTest-1215701914-project-member] Lock "b25630ab-a3b3-4ec7-bd38-3344d90672c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.991s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:12:08 user nova-compute[75014]: DEBUG nova.compute.manager [req-4ccd6158-4d22-4f47-ad9f-4603cb1ded8f req-2a6e1dca-2cd1-4eef-a807-6b4b7d0c96bd service nova] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Received event network-vif-plugged-4320bd7b-bdf6-400d-9e6e-2d29c34ccf84 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:12:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4ccd6158-4d22-4f47-ad9f-4603cb1ded8f req-2a6e1dca-2cd1-4eef-a807-6b4b7d0c96bd service nova] Acquiring lock "b25630ab-a3b3-4ec7-bd38-3344d90672c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:12:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4ccd6158-4d22-4f47-ad9f-4603cb1ded8f req-2a6e1dca-2cd1-4eef-a807-6b4b7d0c96bd service nova] Lock "b25630ab-a3b3-4ec7-bd38-3344d90672c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:12:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4ccd6158-4d22-4f47-ad9f-4603cb1ded8f req-2a6e1dca-2cd1-4eef-a807-6b4b7d0c96bd service nova] Lock "b25630ab-a3b3-4ec7-bd38-3344d90672c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:12:08 user nova-compute[75014]: DEBUG nova.compute.manager [req-4ccd6158-4d22-4f47-ad9f-4603cb1ded8f req-2a6e1dca-2cd1-4eef-a807-6b4b7d0c96bd service nova] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] No waiting events found dispatching network-vif-plugged-4320bd7b-bdf6-400d-9e6e-2d29c34ccf84 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:12:08 user nova-compute[75014]: WARNING nova.compute.manager [req-4ccd6158-4d22-4f47-ad9f-4603cb1ded8f req-2a6e1dca-2cd1-4eef-a807-6b4b7d0c96bd service nova] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Received unexpected event network-vif-plugged-4320bd7b-bdf6-400d-9e6e-2d29c34ccf84 for instance with vm_state deleted and task_state None.
Nov 08 04:12:08 user nova-compute[75014]: DEBUG nova.compute.manager [req-c521e7e7-3f7d-499c-a68c-f64fa34c98c6 req-3b030c10-7def-4a07-8968-4a08dbd2bfbb service nova] [instance: b25630ab-a3b3-4ec7-bd38-3344d90672c9] Received event network-vif-deleted-4320bd7b-bdf6-400d-9e6e-2d29c34ccf84 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:12:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:21 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:24 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Acquiring lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:12:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:12:32 user nova-compute[75014]: DEBUG nova.compute.manager [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 04:12:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:12:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:12:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 04:12:32 user nova-compute[75014]: INFO nova.compute.claims [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Claim successful on node user
Nov 08 04:12:33 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:12:33 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:12:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.294s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:12:33 user nova-compute[75014]: DEBUG nova.compute.manager [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 04:12:33 user nova-compute[75014]: DEBUG nova.compute.manager [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 04:12:33 user nova-compute[75014]: DEBUG nova.network.neutron [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 04:12:33 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 04:12:33 user nova-compute[75014]: DEBUG nova.compute.manager [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 04:12:33 user nova-compute[75014]: DEBUG nova.policy [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41f64f5dd3754997a7a4d2fc193748a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769c7ba95ad41339b55e9baab80af07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 04:12:33 user nova-compute[75014]: DEBUG nova.compute.manager [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 04:12:33 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 04:12:33 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Creating image(s)
Nov 08 04:12:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Acquiring lock "/opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:12:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lock "/opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:12:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lock "/opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:12:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:12:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.196s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:12:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:12:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:12:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:12:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.185s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:12:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:12:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk 1073741824" returned: 0 in 0.057s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:12:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:12:33 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:12:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.219s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:12:34 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Checking if we can resize image /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 04:12:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:12:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:12:34 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Cannot resize image /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 04:12:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 04:12:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Ensure instance console log exists: /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:12:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:12:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:12:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:12:34 user nova-compute[75014]: DEBUG nova.network.neutron [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Successfully created port: 79c0199e-5d4c-4727-a0f5-75bae036c112 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 04:12:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:35 user nova-compute[75014]: DEBUG nova.network.neutron [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Successfully updated port: 79c0199e-5d4c-4727-a0f5-75bae036c112 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 04:12:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Acquiring lock "refresh_cache-077303d8-0afd-4c60-ad9a-1bd29bff4d2d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:12:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Acquired lock "refresh_cache-077303d8-0afd-4c60-ad9a-1bd29bff4d2d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:12:35 user nova-compute[75014]: DEBUG nova.network.neutron [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:12:35 user nova-compute[75014]: DEBUG nova.compute.manager [req-67a26e6e-dc1b-4dc1-8687-4169a9d9237f req-5bc2ca24-36c1-4aa6-89ad-e24edb0a1c69 service nova] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Received event network-changed-79c0199e-5d4c-4727-a0f5-75bae036c112 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:12:35 user nova-compute[75014]: DEBUG nova.compute.manager [req-67a26e6e-dc1b-4dc1-8687-4169a9d9237f req-5bc2ca24-36c1-4aa6-89ad-e24edb0a1c69 service nova] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Refreshing instance network info cache due to event network-changed-79c0199e-5d4c-4727-a0f5-75bae036c112. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:12:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-67a26e6e-dc1b-4dc1-8687-4169a9d9237f req-5bc2ca24-36c1-4aa6-89ad-e24edb0a1c69 service nova] Acquiring lock "refresh_cache-077303d8-0afd-4c60-ad9a-1bd29bff4d2d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:12:35 user nova-compute[75014]: DEBUG nova.network.neutron [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG nova.network.neutron [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Updating instance_info_cache with network_info: [{"id": "79c0199e-5d4c-4727-a0f5-75bae036c112", "address": "fa:16:3e:57:01:6d", "network": {"id": "a47305e7-0cb6-456a-bcde-ab03a8ea643e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-429065517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c769c7ba95ad41339b55e9baab80af07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79c0199e-5d", "ovs_interfaceid": "79c0199e-5d4c-4727-a0f5-75bae036c112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Releasing lock "refresh_cache-077303d8-0afd-4c60-ad9a-1bd29bff4d2d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG nova.compute.manager [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Instance network_info: |[{"id": "79c0199e-5d4c-4727-a0f5-75bae036c112", "address": "fa:16:3e:57:01:6d", "network": {"id": "a47305e7-0cb6-456a-bcde-ab03a8ea643e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-429065517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c769c7ba95ad41339b55e9baab80af07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79c0199e-5d", "ovs_interfaceid": "79c0199e-5d4c-4727-a0f5-75bae036c112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-67a26e6e-dc1b-4dc1-8687-4169a9d9237f req-5bc2ca24-36c1-4aa6-89ad-e24edb0a1c69 service nova] Acquired lock "refresh_cache-077303d8-0afd-4c60-ad9a-1bd29bff4d2d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG nova.network.neutron [req-67a26e6e-dc1b-4dc1-8687-4169a9d9237f req-5bc2ca24-36c1-4aa6-89ad-e24edb0a1c69 service nova] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Refreshing network info cache for port 79c0199e-5d4c-4727-a0f5-75bae036c112 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Start _get_guest_xml network_info=[{"id": "79c0199e-5d4c-4727-a0f5-75bae036c112", "address": "fa:16:3e:57:01:6d", "network": {"id": "a47305e7-0cb6-456a-bcde-ab03a8ea643e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-429065517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c769c7ba95ad41339b55e9baab80af07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79c0199e-5d", "ovs_interfaceid": "79c0199e-5d4c-4727-a0f5-75bae036c112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:12:36 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:12:36 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:12:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:12:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-64286730',display_name='tempest-ServersNegativeTestJSON-server-64286730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-64286730',id=38,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c769c7ba95ad41339b55e9baab80af07',ramdisk_id='',reservation_id='r-3ba98ji5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1651832936',owner_user_name='tempest-ServersNegativeTestJSON-1651832936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:12:33Z,user_data=None,user_id='41f64f5dd3754997a7a4d2fc193748a2',uuid=077303d8-0afd-4c60-ad9a-1bd29bff4d2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79c0199e-5d4c-4727-a0f5-75bae036c112", "address": "fa:16:3e:57:01:6d", "network": {"id": "a47305e7-0cb6-456a-bcde-ab03a8ea643e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-429065517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c769c7ba95ad41339b55e9baab80af07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79c0199e-5d", "ovs_interfaceid": "79c0199e-5d4c-4727-a0f5-75bae036c112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Converting VIF {"id": "79c0199e-5d4c-4727-a0f5-75bae036c112", "address": "fa:16:3e:57:01:6d", "network": {"id": "a47305e7-0cb6-456a-bcde-ab03a8ea643e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-429065517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c769c7ba95ad41339b55e9baab80af07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79c0199e-5d", "ovs_interfaceid": "79c0199e-5d4c-4727-a0f5-75bae036c112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:01:6d,bridge_name='br-int',has_traffic_filtering=True,id=79c0199e-5d4c-4727-a0f5-75bae036c112,network=Network(a47305e7-0cb6-456a-bcde-ab03a8ea643e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79c0199e-5d') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG nova.objects.instance [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lazy-loading 'pci_devices' on Instance uuid 077303d8-0afd-4c60-ad9a-1bd29bff4d2d {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:12:36 user nova-compute[75014]:   <uuid>077303d8-0afd-4c60-ad9a-1bd29bff4d2d</uuid>
Nov 08 04:12:36 user nova-compute[75014]:   <name>instance-00000026</name>
Nov 08 04:12:36 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:12:36 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:12:36 user nova-compute[75014]:   <metadata>
Nov 08 04:12:36 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:12:36 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:12:36 user nova-compute[75014]:       <nova:name>tempest-ServersNegativeTestJSON-server-64286730</nova:name>
Nov 08 04:12:36 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:12:36</nova:creationTime>
Nov 08 04:12:36 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:12:36 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:12:36 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:12:36 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:12:36 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:12:36 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:12:36 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:12:36 user nova-compute[75014]:       <nova:owner>
Nov 08 04:12:36 user nova-compute[75014]:         <nova:user uuid="41f64f5dd3754997a7a4d2fc193748a2">tempest-ServersNegativeTestJSON-1651832936-project-member</nova:user>
Nov 08 04:12:36 user nova-compute[75014]:         <nova:project uuid="c769c7ba95ad41339b55e9baab80af07">tempest-ServersNegativeTestJSON-1651832936</nova:project>
Nov 08 04:12:36 user nova-compute[75014]:       </nova:owner>
Nov 08 04:12:36 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:12:36 user nova-compute[75014]:       <nova:ports>
Nov 08 04:12:36 user nova-compute[75014]:         <nova:port uuid="79c0199e-5d4c-4727-a0f5-75bae036c112">
Nov 08 04:12:36 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 04:12:36 user nova-compute[75014]:         </nova:port>
Nov 08 04:12:36 user nova-compute[75014]:       </nova:ports>
Nov 08 04:12:36 user nova-compute[75014]:     </nova:instance>
Nov 08 04:12:36 user nova-compute[75014]:   </metadata>
Nov 08 04:12:36 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:12:36 user nova-compute[75014]:     <system>
Nov 08 04:12:36 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:12:36 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:12:36 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:12:36 user nova-compute[75014]:       <entry name="serial">077303d8-0afd-4c60-ad9a-1bd29bff4d2d</entry>
Nov 08 04:12:36 user nova-compute[75014]:       <entry name="uuid">077303d8-0afd-4c60-ad9a-1bd29bff4d2d</entry>
Nov 08 04:12:36 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:12:36 user nova-compute[75014]:     </system>
Nov 08 04:12:36 user nova-compute[75014]:   </sysinfo>
Nov 08 04:12:36 user nova-compute[75014]:   <os>
Nov 08 04:12:36 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:12:36 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:12:36 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:12:36 user nova-compute[75014]:   </os>
Nov 08 04:12:36 user nova-compute[75014]:   <features>
Nov 08 04:12:36 user nova-compute[75014]:     <acpi/>
Nov 08 04:12:36 user nova-compute[75014]:     <apic/>
Nov 08 04:12:36 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:12:36 user nova-compute[75014]:   </features>
Nov 08 04:12:36 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:12:36 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:12:36 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:12:36 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:12:36 user nova-compute[75014]:   </clock>
Nov 08 04:12:36 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:12:36 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:12:36 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:12:36 user nova-compute[75014]:   </cpu>
Nov 08 04:12:36 user nova-compute[75014]:   <devices>
Nov 08 04:12:36 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 04:12:36 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 04:12:36 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk"/>
Nov 08 04:12:36 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:12:36 user nova-compute[75014]:     </disk>
Nov 08 04:12:36 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:12:36 user nova-compute[75014]:       <mac address="fa:16:3e:57:01:6d"/>
Nov 08 04:12:36 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:12:36 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:12:36 user nova-compute[75014]:       <target dev="tap79c0199e-5d"/>
Nov 08 04:12:36 user nova-compute[75014]:     </interface>
Nov 08 04:12:36 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:12:36 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/console.log" append="off"/>
Nov 08 04:12:36 user nova-compute[75014]:     </serial>
Nov 08 04:12:36 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:12:36 user nova-compute[75014]:     <video>
Nov 08 04:12:36 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:12:36 user nova-compute[75014]:     </video>
Nov 08 04:12:36 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:12:36 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:12:36 user nova-compute[75014]:     </rng>
Nov 08 04:12:36 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:12:36 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:12:36 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:12:36 user nova-compute[75014]:     </memballoon>
Nov 08 04:12:36 user nova-compute[75014]:   </devices>
Nov 08 04:12:36 user nova-compute[75014]: </domain>
Nov 08 04:12:36 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:12:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-64286730',display_name='tempest-ServersNegativeTestJSON-server-64286730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-64286730',id=38,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c769c7ba95ad41339b55e9baab80af07',ramdisk_id='',reservation_id='r-3ba98ji5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1651832936',owner_user_name='tempest-ServersNegativeTestJSON-1651832936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:12:33Z,user_data=None,user_id='41f64f5dd3754997a7a4d2fc193748a2',uuid=077303d8-0afd-4c60-ad9a-1bd29bff4d2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79c0199e-5d4c-4727-a0f5-75bae036c112", "address": "fa:16:3e:57:01:6d", "network": {"id": "a47305e7-0cb6-456a-bcde-ab03a8ea643e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-429065517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c769c7ba95ad41339b55e9baab80af07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79c0199e-5d", "ovs_interfaceid": "79c0199e-5d4c-4727-a0f5-75bae036c112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Converting VIF {"id": "79c0199e-5d4c-4727-a0f5-75bae036c112", "address": "fa:16:3e:57:01:6d", "network": {"id": "a47305e7-0cb6-456a-bcde-ab03a8ea643e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-429065517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c769c7ba95ad41339b55e9baab80af07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79c0199e-5d", "ovs_interfaceid": "79c0199e-5d4c-4727-a0f5-75bae036c112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:01:6d,bridge_name='br-int',has_traffic_filtering=True,id=79c0199e-5d4c-4727-a0f5-75bae036c112,network=Network(a47305e7-0cb6-456a-bcde-ab03a8ea643e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79c0199e-5d') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG os_vif [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:01:6d,bridge_name='br-int',has_traffic_filtering=True,id=79c0199e-5d4c-4727-a0f5-75bae036c112,network=Network(a47305e7-0cb6-456a-bcde-ab03a8ea643e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79c0199e-5d') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'abed9ab1-f688-5700-aa08-db44a23e4154', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79c0199e-5d, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap79c0199e-5d, col_values=(('qos', UUID('2ae94324-ecde-489a-91f9-ba4c4409ea49')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap79c0199e-5d, col_values=(('external_ids', {'iface-id': '79c0199e-5d4c-4727-a0f5-75bae036c112', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:01:6d', 'vm-uuid': '077303d8-0afd-4c60-ad9a-1bd29bff4d2d'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:36 user nova-compute[75014]: INFO os_vif [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:01:6d,bridge_name='br-int',has_traffic_filtering=True,id=79c0199e-5d4c-4727-a0f5-75bae036c112,network=Network(a47305e7-0cb6-456a-bcde-ab03a8ea643e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79c0199e-5d')
Nov 08 04:12:36 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] No VIF found with MAC fa:16:3e:57:01:6d, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG nova.network.neutron [req-67a26e6e-dc1b-4dc1-8687-4169a9d9237f req-5bc2ca24-36c1-4aa6-89ad-e24edb0a1c69 service nova] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Updated VIF entry in instance network info cache for port 79c0199e-5d4c-4727-a0f5-75bae036c112. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG nova.network.neutron [req-67a26e6e-dc1b-4dc1-8687-4169a9d9237f req-5bc2ca24-36c1-4aa6-89ad-e24edb0a1c69 service nova] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Updating instance_info_cache with network_info: [{"id": "79c0199e-5d4c-4727-a0f5-75bae036c112", "address": "fa:16:3e:57:01:6d", "network": {"id": "a47305e7-0cb6-456a-bcde-ab03a8ea643e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-429065517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c769c7ba95ad41339b55e9baab80af07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79c0199e-5d", "ovs_interfaceid": "79c0199e-5d4c-4727-a0f5-75bae036c112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:12:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-67a26e6e-dc1b-4dc1-8687-4169a9d9237f req-5bc2ca24-36c1-4aa6-89ad-e24edb0a1c69 service nova] Releasing lock "refresh_cache-077303d8-0afd-4c60-ad9a-1bd29bff4d2d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:12:37 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:12:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:39 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:12:39 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:12:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-781932ce-0bea-466f-95e0-066130d6c410" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:12:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-781932ce-0bea-466f-95e0-066130d6c410" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:12:39 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 04:12:39 user nova-compute[75014]: DEBUG nova.compute.manager [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:12:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 04:12:39 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Instance spawned successfully.
Nov 08 04:12:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 04:12:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:12:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:12:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:12:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:12:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:12:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:12:40 user nova-compute[75014]: INFO nova.compute.manager [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Took 6.66 seconds to spawn the instance on the hypervisor.
Nov 08 04:12:40 user nova-compute[75014]: DEBUG nova.compute.manager [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:12:40 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Updating instance_info_cache with network_info: [{"id": "5b680c90-914d-4583-a698-dccacaff9987", "address": "fa:16:3e:48:9a:fe", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b680c90-91", "ovs_interfaceid": "5b680c90-914d-4583-a698-dccacaff9987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:12:40 user nova-compute[75014]: INFO nova.compute.manager [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Took 7.34 seconds to build instance.
Nov 08 04:12:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-781932ce-0bea-466f-95e0-066130d6c410" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:12:40 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 04:12:40 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:12:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ed40c15a-b90e-4a0d-a60c-4ed49fdba911 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.453s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:12:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:40 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:12:40 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:12:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:41 user nova-compute[75014]: DEBUG nova.compute.manager [req-500b78d2-8953-4621-9b0f-fe1a48f81291 req-960a94ab-321b-49db-a64e-0b32f8ef39e8 service nova] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Received event network-vif-plugged-79c0199e-5d4c-4727-a0f5-75bae036c112 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:12:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-500b78d2-8953-4621-9b0f-fe1a48f81291 req-960a94ab-321b-49db-a64e-0b32f8ef39e8 service nova] Acquiring lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:12:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-500b78d2-8953-4621-9b0f-fe1a48f81291 req-960a94ab-321b-49db-a64e-0b32f8ef39e8 service nova] Lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:12:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-500b78d2-8953-4621-9b0f-fe1a48f81291 req-960a94ab-321b-49db-a64e-0b32f8ef39e8 service nova] Lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:12:41 user nova-compute[75014]: DEBUG nova.compute.manager [req-500b78d2-8953-4621-9b0f-fe1a48f81291 req-960a94ab-321b-49db-a64e-0b32f8ef39e8 service nova] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] No waiting events found dispatching network-vif-plugged-79c0199e-5d4c-4727-a0f5-75bae036c112 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:12:41 user nova-compute[75014]: WARNING nova.compute.manager [req-500b78d2-8953-4621-9b0f-fe1a48f81291 req-960a94ab-321b-49db-a64e-0b32f8ef39e8 service nova] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Received unexpected event network-vif-plugged-79c0199e-5d4c-4727-a0f5-75bae036c112 for instance with vm_state active and task_state None.
Nov 08 04:12:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:43 user nova-compute[75014]: DEBUG nova.objects.instance [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lazy-loading 'flavor' on Instance uuid 781932ce-0bea-466f-95e0-066130d6c410 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:12:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "refresh_cache-781932ce-0bea-466f-95e0-066130d6c410" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:12:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquired lock "refresh_cache-781932ce-0bea-466f-95e0-066130d6c410" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:12:43 user nova-compute[75014]: DEBUG nova.network.neutron [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:12:43 user nova-compute[75014]: DEBUG nova.objects.instance [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lazy-loading 'info_cache' on Instance uuid 781932ce-0bea-466f-95e0-066130d6c410 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:12:43 user nova-compute[75014]: DEBUG nova.objects.base [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Object Instance<781932ce-0bea-466f-95e0-066130d6c410> lazy-loaded attributes: flavor,info_cache {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:12:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-dff19b8e-1826-4ca3-b6bc-2e1d55891ca3 req-1a2f9c48-8228-40b3-80e2-ec891d0adcea service nova] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Received event network-vif-plugged-79c0199e-5d4c-4727-a0f5-75bae036c112 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:12:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dff19b8e-1826-4ca3-b6bc-2e1d55891ca3 req-1a2f9c48-8228-40b3-80e2-ec891d0adcea service nova] Acquiring lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:12:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dff19b8e-1826-4ca3-b6bc-2e1d55891ca3 req-1a2f9c48-8228-40b3-80e2-ec891d0adcea service nova] Lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:12:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dff19b8e-1826-4ca3-b6bc-2e1d55891ca3 req-1a2f9c48-8228-40b3-80e2-ec891d0adcea service nova] Lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:12:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-dff19b8e-1826-4ca3-b6bc-2e1d55891ca3 req-1a2f9c48-8228-40b3-80e2-ec891d0adcea service nova] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] No waiting events found dispatching network-vif-plugged-79c0199e-5d4c-4727-a0f5-75bae036c112 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:12:43 user nova-compute[75014]: WARNING nova.compute.manager [req-dff19b8e-1826-4ca3-b6bc-2e1d55891ca3 req-1a2f9c48-8228-40b3-80e2-ec891d0adcea service nova] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Received unexpected event network-vif-plugged-79c0199e-5d4c-4727-a0f5-75bae036c112 for instance with vm_state active and task_state None.
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.network.neutron [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Updating instance_info_cache with network_info: [{"id": "5b680c90-914d-4583-a698-dccacaff9987", "address": "fa:16:3e:48:9a:fe", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b680c90-91", "ovs_interfaceid": "5b680c90-914d-4583-a698-dccacaff9987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Releasing lock "refresh_cache-781932ce-0bea-466f-95e0-066130d6c410" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:12:44 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Instance destroyed successfully.
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.objects.instance [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lazy-loading 'resources' on Instance uuid 781932ce-0bea-466f-95e0-066130d6c410 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.objects.base [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Object Instance<781932ce-0bea-466f-95e0-066130d6c410> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:04:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1668777333',display_name='tempest-AttachVolumeTestJSON-server-1668777333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1668777333',id=30,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6mnajMRsnB5A1jMf0Mqu/aGiRIJo9flQ+tedJW4Ejb4b/2emSY8dSQLEz7A16dKqzr7/OWo32j5VNwQAstah+AeC8v3Pb8Vhpq9T/r/uwJR3q73i8uI1OSr10mvZVNRA==',key_name='tempest-keypair-919667976',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:04:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b61b5c5a54c743f78e97623c26050864',ramdisk_id='',reservation_id='r-k47t6zf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1095291946',owner_user_name='tempest-AttachVolumeTestJSON-1095291946-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:10:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8794d413cb745f2b855a808c052c8fd',uuid=781932ce-0bea-466f-95e0-066130d6c410,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5b680c90-914d-4583-a698-dccacaff9987", "address": "fa:16:3e:48:9a:fe", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b680c90-91", "ovs_interfaceid": "5b680c90-914d-4583-a698-dccacaff9987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Converting VIF {"id": "5b680c90-914d-4583-a698-dccacaff9987", "address": "fa:16:3e:48:9a:fe", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b680c90-91", "ovs_interfaceid": "5b680c90-914d-4583-a698-dccacaff9987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:9a:fe,bridge_name='br-int',has_traffic_filtering=True,id=5b680c90-914d-4583-a698-dccacaff9987,network=Network(b7df3975-2e50-4d96-8a34-26abf02bea76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b680c90-91') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG os_vif [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:9a:fe,bridge_name='br-int',has_traffic_filtering=True,id=5b680c90-914d-4583-a698-dccacaff9987,network=Network(b7df3975-2e50-4d96-8a34-26abf02bea76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b680c90-91') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b680c90-91, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=35e6ae57-0ae0-43f6-bf2d-2754c4992c87) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:12:44 user nova-compute[75014]: INFO os_vif [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:9a:fe,bridge_name='br-int',has_traffic_filtering=True,id=5b680c90-914d-4583-a698-dccacaff9987,network=Network(b7df3975-2e50-4d96-8a34-26abf02bea76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b680c90-91')
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Start _get_guest_xml network_info=[{"id": "5b680c90-914d-4583-a698-dccacaff9987", "address": "fa:16:3e:48:9a:fe", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b680c90-91", "ovs_interfaceid": "5b680c90-914d-4583-a698-dccacaff9987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.objects.instance [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lazy-loading 'numa_topology' on Instance uuid 781932ce-0bea-466f-95e0-066130d6c410 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.objects.base [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Object Instance<781932ce-0bea-466f-95e0-066130d6c410> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:12:44 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:12:44 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.objects.instance [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lazy-loading 'vcpu_model' on Instance uuid 781932ce-0bea-466f-95e0-066130d6c410 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.objects.base [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Object Instance<781932ce-0bea-466f-95e0-066130d6c410> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:04:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1668777333',display_name='tempest-AttachVolumeTestJSON-server-1668777333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1668777333',id=30,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6mnajMRsnB5A1jMf0Mqu/aGiRIJo9flQ+tedJW4Ejb4b/2emSY8dSQLEz7A16dKqzr7/OWo32j5VNwQAstah+AeC8v3Pb8Vhpq9T/r/uwJR3q73i8uI1OSr10mvZVNRA==',key_name='tempest-keypair-919667976',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:04:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b61b5c5a54c743f78e97623c26050864',ramdisk_id='',reservation_id='r-k47t6zf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1095291946',owner_user_name='tempest-AttachVolumeTestJSON-1095291946-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:10:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8794d413cb745f2b855a808c052c8fd',uuid=781932ce-0bea-466f-95e0-066130d6c410,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5b680c90-914d-4583-a698-dccacaff9987", "address": "fa:16:3e:48:9a:fe", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b680c90-91", "ovs_interfaceid": "5b680c90-914d-4583-a698-dccacaff9987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Converting VIF {"id": "5b680c90-914d-4583-a698-dccacaff9987", "address": "fa:16:3e:48:9a:fe", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b680c90-91", "ovs_interfaceid": "5b680c90-914d-4583-a698-dccacaff9987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:9a:fe,bridge_name='br-int',has_traffic_filtering=True,id=5b680c90-914d-4583-a698-dccacaff9987,network=Network(b7df3975-2e50-4d96-8a34-26abf02bea76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b680c90-91') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.objects.instance [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lazy-loading 'pci_devices' on Instance uuid 781932ce-0bea-466f-95e0-066130d6c410 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.objects.base [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Object Instance<781932ce-0bea-466f-95e0-066130d6c410> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:12:44 user nova-compute[75014]:   <uuid>781932ce-0bea-466f-95e0-066130d6c410</uuid>
Nov 08 04:12:44 user nova-compute[75014]:   <name>instance-0000001e</name>
Nov 08 04:12:44 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:12:44 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:12:44 user nova-compute[75014]:   <metadata>
Nov 08 04:12:44 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:12:44 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:12:44 user nova-compute[75014]:       <nova:name>tempest-AttachVolumeTestJSON-server-1668777333</nova:name>
Nov 08 04:12:44 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:12:44</nova:creationTime>
Nov 08 04:12:44 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:12:44 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:12:44 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:12:44 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:12:44 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:12:44 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:12:44 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:12:44 user nova-compute[75014]:       <nova:owner>
Nov 08 04:12:44 user nova-compute[75014]:         <nova:user uuid="f8794d413cb745f2b855a808c052c8fd">tempest-AttachVolumeTestJSON-1095291946-project-member</nova:user>
Nov 08 04:12:44 user nova-compute[75014]:         <nova:project uuid="b61b5c5a54c743f78e97623c26050864">tempest-AttachVolumeTestJSON-1095291946</nova:project>
Nov 08 04:12:44 user nova-compute[75014]:       </nova:owner>
Nov 08 04:12:44 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:12:44 user nova-compute[75014]:       <nova:ports>
Nov 08 04:12:44 user nova-compute[75014]:         <nova:port uuid="5b680c90-914d-4583-a698-dccacaff9987">
Nov 08 04:12:44 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 04:12:44 user nova-compute[75014]:         </nova:port>
Nov 08 04:12:44 user nova-compute[75014]:       </nova:ports>
Nov 08 04:12:44 user nova-compute[75014]:     </nova:instance>
Nov 08 04:12:44 user nova-compute[75014]:   </metadata>
Nov 08 04:12:44 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:12:44 user nova-compute[75014]:     <system>
Nov 08 04:12:44 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:12:44 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:12:44 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:12:44 user nova-compute[75014]:       <entry name="serial">781932ce-0bea-466f-95e0-066130d6c410</entry>
Nov 08 04:12:44 user nova-compute[75014]:       <entry name="uuid">781932ce-0bea-466f-95e0-066130d6c410</entry>
Nov 08 04:12:44 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:12:44 user nova-compute[75014]:     </system>
Nov 08 04:12:44 user nova-compute[75014]:   </sysinfo>
Nov 08 04:12:44 user nova-compute[75014]:   <os>
Nov 08 04:12:44 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:12:44 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:12:44 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:12:44 user nova-compute[75014]:   </os>
Nov 08 04:12:44 user nova-compute[75014]:   <features>
Nov 08 04:12:44 user nova-compute[75014]:     <acpi/>
Nov 08 04:12:44 user nova-compute[75014]:     <apic/>
Nov 08 04:12:44 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:12:44 user nova-compute[75014]:   </features>
Nov 08 04:12:44 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:12:44 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:12:44 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:12:44 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:12:44 user nova-compute[75014]:   </clock>
Nov 08 04:12:44 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:12:44 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:12:44 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:12:44 user nova-compute[75014]:   </cpu>
Nov 08 04:12:44 user nova-compute[75014]:   <devices>
Nov 08 04:12:44 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 04:12:44 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 04:12:44 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk"/>
Nov 08 04:12:44 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:12:44 user nova-compute[75014]:     </disk>
Nov 08 04:12:44 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:12:44 user nova-compute[75014]:       <mac address="fa:16:3e:48:9a:fe"/>
Nov 08 04:12:44 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:12:44 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:12:44 user nova-compute[75014]:       <target dev="tap5b680c90-91"/>
Nov 08 04:12:44 user nova-compute[75014]:     </interface>
Nov 08 04:12:44 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:12:44 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/console.log" append="off"/>
Nov 08 04:12:44 user nova-compute[75014]:     </serial>
Nov 08 04:12:44 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:12:44 user nova-compute[75014]:     <video>
Nov 08 04:12:44 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:12:44 user nova-compute[75014]:     </video>
Nov 08 04:12:44 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:12:44 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:12:44 user nova-compute[75014]:     </rng>
Nov 08 04:12:44 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:12:44 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:12:44 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:12:44 user nova-compute[75014]:     </memballoon>
Nov 08 04:12:44 user nova-compute[75014]:   </devices>
Nov 08 04:12:44 user nova-compute[75014]: </domain>
Nov 08 04:12:44 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.objects.instance [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lazy-loading 'trusted_certs' on Instance uuid 781932ce-0bea-466f-95e0-066130d6c410 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.objects.base [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Object Instance<781932ce-0bea-466f-95e0-066130d6c410> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.182s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Checking if we can resize image /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 04:12:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:12:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:12:45 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Cannot resize image /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 04:12:45 user nova-compute[75014]: DEBUG nova.objects.instance [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lazy-loading 'migration_context' on Instance uuid 781932ce-0bea-466f-95e0-066130d6c410 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:12:45 user nova-compute[75014]: DEBUG nova.objects.base [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Object Instance<781932ce-0bea-466f-95e0-066130d6c410> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:12:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:04:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1668777333',display_name='tempest-AttachVolumeTestJSON-server-1668777333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1668777333',id=30,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6mnajMRsnB5A1jMf0Mqu/aGiRIJo9flQ+tedJW4Ejb4b/2emSY8dSQLEz7A16dKqzr7/OWo32j5VNwQAstah+AeC8v3Pb8Vhpq9T/r/uwJR3q73i8uI1OSr10mvZVNRA==',key_name='tempest-keypair-919667976',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:04:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='b61b5c5a54c743f78e97623c26050864',ramdisk_id='',reservation_id='r-k47t6zf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1095291946',owner_user_name='tempest-AttachVolumeTestJSON-1095291946-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:10:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8794d413cb745f2b855a808c052c8fd',uuid=781932ce-0bea-466f-95e0-066130d6c410,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5b680c90-914d-4583-a698-dccacaff9987", "address": "fa:16:3e:48:9a:fe", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b680c90-91", "ovs_interfaceid": "5b680c90-914d-4583-a698-dccacaff9987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:12:45 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Converting VIF {"id": "5b680c90-914d-4583-a698-dccacaff9987", "address": "fa:16:3e:48:9a:fe", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b680c90-91", "ovs_interfaceid": "5b680c90-914d-4583-a698-dccacaff9987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:12:45 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:9a:fe,bridge_name='br-int',has_traffic_filtering=True,id=5b680c90-914d-4583-a698-dccacaff9987,network=Network(b7df3975-2e50-4d96-8a34-26abf02bea76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b680c90-91') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:12:45 user nova-compute[75014]: DEBUG os_vif [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:9a:fe,bridge_name='br-int',has_traffic_filtering=True,id=5b680c90-914d-4583-a698-dccacaff9987,network=Network(b7df3975-2e50-4d96-8a34-26abf02bea76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b680c90-91') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:12:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:12:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:12:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7dc1abc2-ddd1-5964-9fb6-60149b0dc5e0', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:12:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:12:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b680c90-91, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:12:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b680c90-91, col_values=(('qos', UUID('8b0894df-f894-40a3-b7eb-b1bbfdfe11d9')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:12:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b680c90-91, col_values=(('external_ids', {'iface-id': '5b680c90-914d-4583-a698-dccacaff9987', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:9a:fe', 'vm-uuid': '781932ce-0bea-466f-95e0-066130d6c410'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:12:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:12:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:45 user nova-compute[75014]: INFO os_vif [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:9a:fe,bridge_name='br-int',has_traffic_filtering=True,id=5b680c90-914d-4583-a698-dccacaff9987,network=Network(b7df3975-2e50-4d96-8a34-26abf02bea76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b680c90-91')
Nov 08 04:12:45 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:12:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:12:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:12:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:12:45 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:12:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Acquiring lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:12:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:12:46 user nova-compute[75014]: DEBUG nova.compute.manager [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 04:12:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:12:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:12:46 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 04:12:46 user nova-compute[75014]: INFO nova.compute.claims [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Claim successful on node user
Nov 08 04:12:46 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:46 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:46 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:46 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:12:46 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:12:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.490s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:12:46 user nova-compute[75014]: DEBUG nova.compute.manager [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 04:12:46 user nova-compute[75014]: DEBUG nova.compute.manager [req-64ccc511-f310-409a-85ba-c04450f3359b req-f26eb715-2265-4a5d-a953-e7e05bd601ee service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Received event network-vif-plugged-5b680c90-914d-4583-a698-dccacaff9987 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:12:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-64ccc511-f310-409a-85ba-c04450f3359b req-f26eb715-2265-4a5d-a953-e7e05bd601ee service nova] Acquiring lock "781932ce-0bea-466f-95e0-066130d6c410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:12:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-64ccc511-f310-409a-85ba-c04450f3359b req-f26eb715-2265-4a5d-a953-e7e05bd601ee service nova] Lock "781932ce-0bea-466f-95e0-066130d6c410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:12:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-64ccc511-f310-409a-85ba-c04450f3359b req-f26eb715-2265-4a5d-a953-e7e05bd601ee service nova] Lock "781932ce-0bea-466f-95e0-066130d6c410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:12:46 user nova-compute[75014]: DEBUG nova.compute.manager [req-64ccc511-f310-409a-85ba-c04450f3359b req-f26eb715-2265-4a5d-a953-e7e05bd601ee service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] No waiting events found dispatching network-vif-plugged-5b680c90-914d-4583-a698-dccacaff9987 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:12:46 user nova-compute[75014]: WARNING nova.compute.manager [req-64ccc511-f310-409a-85ba-c04450f3359b req-f26eb715-2265-4a5d-a953-e7e05bd601ee service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Received unexpected event network-vif-plugged-5b680c90-914d-4583-a698-dccacaff9987 for instance with vm_state stopped and task_state powering-on.
Nov 08 04:12:46 user nova-compute[75014]: DEBUG nova.compute.manager [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 04:12:46 user nova-compute[75014]: DEBUG nova.network.neutron [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 04:12:46 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 04:12:46 user nova-compute[75014]: DEBUG nova.compute.manager [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 04:12:47 user nova-compute[75014]: DEBUG nova.policy [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1fe1a418bca44d0ca8c5a2a9ba7777c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7e7ba2cb0b4038927288ab2157a8eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 04:12:47 user nova-compute[75014]: DEBUG nova.compute.manager [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 04:12:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 04:12:47 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Creating image(s)
Nov 08 04:12:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Acquiring lock "/opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:12:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lock "/opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:12:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lock "/opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:12:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:12:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:12:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.195s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:12:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:12:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:12:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:12:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:12:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:12:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.205s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:12:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:12:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk 1073741824" returned: 0 in 0.055s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:12:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:12:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:12:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:12:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:12:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.205s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:12:47 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 04:12:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:12:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:12:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:12:48 user nova-compute[75014]: DEBUG nova.network.neutron [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Successfully created port: a4210bed-2f6f-4c2b-ad92-fce0779168f9 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 04:12:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:12:48 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Cannot resize image /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 04:12:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 04:12:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Ensure instance console log exists: /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:12:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:12:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:12:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:12:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:12:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:12:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:12:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:12:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:12:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351d7017-81d2-42bd-8d9c-eb820657bb85/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:12:48 user nova-compute[75014]: DEBUG nova.network.neutron [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Successfully updated port: a4210bed-2f6f-4c2b-ad92-fce0779168f9 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 04:12:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Acquiring lock "refresh_cache-01754a6d-8f7b-46ad-b166-defe74eb9dd0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:12:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Acquired lock "refresh_cache-01754a6d-8f7b-46ad-b166-defe74eb9dd0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:12:48 user nova-compute[75014]: DEBUG nova.network.neutron [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:12:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351d7017-81d2-42bd-8d9c-eb820657bb85/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:12:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351d7017-81d2-42bd-8d9c-eb820657bb85/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:12:48 user nova-compute[75014]: DEBUG nova.network.neutron [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 04:12:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351d7017-81d2-42bd-8d9c-eb820657bb85/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:12:48 user nova-compute[75014]: DEBUG nova.compute.manager [req-930f4a3f-0c96-4622-8773-f48c93a7b8df req-4767f80e-27ac-496e-96be-1fc441988e57 service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Received event network-vif-plugged-5b680c90-914d-4583-a698-dccacaff9987 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:12:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-930f4a3f-0c96-4622-8773-f48c93a7b8df req-4767f80e-27ac-496e-96be-1fc441988e57 service nova] Acquiring lock "781932ce-0bea-466f-95e0-066130d6c410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:12:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-930f4a3f-0c96-4622-8773-f48c93a7b8df req-4767f80e-27ac-496e-96be-1fc441988e57 service nova] Lock "781932ce-0bea-466f-95e0-066130d6c410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:12:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-930f4a3f-0c96-4622-8773-f48c93a7b8df req-4767f80e-27ac-496e-96be-1fc441988e57 service nova] Lock "781932ce-0bea-466f-95e0-066130d6c410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:12:48 user nova-compute[75014]: DEBUG nova.compute.manager [req-930f4a3f-0c96-4622-8773-f48c93a7b8df req-4767f80e-27ac-496e-96be-1fc441988e57 service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] No waiting events found dispatching network-vif-plugged-5b680c90-914d-4583-a698-dccacaff9987 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:12:48 user nova-compute[75014]: WARNING nova.compute.manager [req-930f4a3f-0c96-4622-8773-f48c93a7b8df req-4767f80e-27ac-496e-96be-1fc441988e57 service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Received unexpected event network-vif-plugged-5b680c90-914d-4583-a698-dccacaff9987 for instance with vm_state stopped and task_state powering-on.
Nov 08 04:12:48 user nova-compute[75014]: DEBUG nova.compute.manager [req-930f4a3f-0c96-4622-8773-f48c93a7b8df req-4767f80e-27ac-496e-96be-1fc441988e57 service nova] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Received event network-changed-a4210bed-2f6f-4c2b-ad92-fce0779168f9 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:12:48 user nova-compute[75014]: DEBUG nova.compute.manager [req-930f4a3f-0c96-4622-8773-f48c93a7b8df req-4767f80e-27ac-496e-96be-1fc441988e57 service nova] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Refreshing instance network info cache due to event network-changed-a4210bed-2f6f-4c2b-ad92-fce0779168f9. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:12:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-930f4a3f-0c96-4622-8773-f48c93a7b8df req-4767f80e-27ac-496e-96be-1fc441988e57 service nova] Acquiring lock "refresh_cache-01754a6d-8f7b-46ad-b166-defe74eb9dd0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.compute.manager [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:12:49 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:12:49 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=8409MB free_disk=25.025440216064453GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:12:49 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Instance rebooted successfully.
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.compute.manager [None req-5a36f768-ddb5-4bce-b710-80fa1bce22bc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.network.neutron [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Updating instance_info_cache with network_info: [{"id": "a4210bed-2f6f-4c2b-ad92-fce0779168f9", "address": "fa:16:3e:23:ba:ba", "network": {"id": "a5c06b2d-3ef9-4f4e-9537-b065082d1a10", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-102893709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a7e7ba2cb0b4038927288ab2157a8eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4210bed-2f", "ovs_interfaceid": "a4210bed-2f6f-4c2b-ad92-fce0779168f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Releasing lock "refresh_cache-01754a6d-8f7b-46ad-b166-defe74eb9dd0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.compute.manager [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Instance network_info: |[{"id": "a4210bed-2f6f-4c2b-ad92-fce0779168f9", "address": "fa:16:3e:23:ba:ba", "network": {"id": "a5c06b2d-3ef9-4f4e-9537-b065082d1a10", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-102893709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a7e7ba2cb0b4038927288ab2157a8eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4210bed-2f", "ovs_interfaceid": "a4210bed-2f6f-4c2b-ad92-fce0779168f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-930f4a3f-0c96-4622-8773-f48c93a7b8df req-4767f80e-27ac-496e-96be-1fc441988e57 service nova] Acquired lock "refresh_cache-01754a6d-8f7b-46ad-b166-defe74eb9dd0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.network.neutron [req-930f4a3f-0c96-4622-8773-f48c93a7b8df req-4767f80e-27ac-496e-96be-1fc441988e57 service nova] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Refreshing network info cache for port a4210bed-2f6f-4c2b-ad92-fce0779168f9 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Start _get_guest_xml network_info=[{"id": "a4210bed-2f6f-4c2b-ad92-fce0779168f9", "address": "fa:16:3e:23:ba:ba", "network": {"id": "a5c06b2d-3ef9-4f4e-9537-b065082d1a10", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-102893709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a7e7ba2cb0b4038927288ab2157a8eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4210bed-2f", "ovs_interfaceid": "a4210bed-2f6f-4c2b-ad92-fce0779168f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:12:49 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:12:49 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance c23c9e00-b782-4530-bb01-a7a167951c1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 781932ce-0bea-466f-95e0-066130d6c410 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 351d7017-81d2-42bd-8d9c-eb820657bb85 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 077303d8-0afd-4c60-ad9a-1bd29bff4d2d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 01754a6d-8f7b-46ad-b166-defe74eb9dd0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:12:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1881370906',display_name='tempest-TestServerVolumeAttachmentScenario-server-1881370906',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1881370906',id=39,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3M1sDRB0GIEtgmJ4Lbnj4DpfKwKPusqsP9tla7u4fzj1rQk1tbSp5VGsqayI1/zi4p0WIYWfUvoCtlBaP03tIoYXAgDeD4kBxhw5YOfJm6XVYVPr6pvRLB1LuQTnkFQw==',key_name='tempest-keypair-548927297',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a7e7ba2cb0b4038927288ab2157a8eb',ramdisk_id='',reservation_id='r-1svzq22d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2003968374',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2003968374-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:12:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fe1a418bca44d0ca8c5a2a9ba7777c9',uuid=01754a6d-8f7b-46ad-b166-defe74eb9dd0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4210bed-2f6f-4c2b-ad92-fce0779168f9", "address": "fa:16:3e:23:ba:ba", "network": {"id": "a5c06b2d-3ef9-4f4e-9537-b065082d1a10", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-102893709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a7e7ba2cb0b4038927288ab2157a8eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4210bed-2f", "ovs_interfaceid": "a4210bed-2f6f-4c2b-ad92-fce0779168f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Converting VIF {"id": "a4210bed-2f6f-4c2b-ad92-fce0779168f9", "address": "fa:16:3e:23:ba:ba", "network": {"id": "a5c06b2d-3ef9-4f4e-9537-b065082d1a10", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-102893709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a7e7ba2cb0b4038927288ab2157a8eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4210bed-2f", "ovs_interfaceid": "a4210bed-2f6f-4c2b-ad92-fce0779168f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:ba:ba,bridge_name='br-int',has_traffic_filtering=True,id=a4210bed-2f6f-4c2b-ad92-fce0779168f9,network=Network(a5c06b2d-3ef9-4f4e-9537-b065082d1a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4210bed-2f') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.objects.instance [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lazy-loading 'pci_devices' on Instance uuid 01754a6d-8f7b-46ad-b166-defe74eb9dd0 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:12:49 user nova-compute[75014]:   <uuid>01754a6d-8f7b-46ad-b166-defe74eb9dd0</uuid>
Nov 08 04:12:49 user nova-compute[75014]:   <name>instance-00000027</name>
Nov 08 04:12:49 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:12:49 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:12:49 user nova-compute[75014]:   <metadata>
Nov 08 04:12:49 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:12:49 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:12:49 user nova-compute[75014]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1881370906</nova:name>
Nov 08 04:12:49 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:12:49</nova:creationTime>
Nov 08 04:12:49 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:12:49 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:12:49 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:12:49 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:12:49 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:12:49 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:12:49 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:12:49 user nova-compute[75014]:       <nova:owner>
Nov 08 04:12:49 user nova-compute[75014]:         <nova:user uuid="1fe1a418bca44d0ca8c5a2a9ba7777c9">tempest-TestServerVolumeAttachmentScenario-2003968374-project-member</nova:user>
Nov 08 04:12:49 user nova-compute[75014]:         <nova:project uuid="2a7e7ba2cb0b4038927288ab2157a8eb">tempest-TestServerVolumeAttachmentScenario-2003968374</nova:project>
Nov 08 04:12:49 user nova-compute[75014]:       </nova:owner>
Nov 08 04:12:49 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:12:49 user nova-compute[75014]:       <nova:ports>
Nov 08 04:12:49 user nova-compute[75014]:         <nova:port uuid="a4210bed-2f6f-4c2b-ad92-fce0779168f9">
Nov 08 04:12:49 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 04:12:49 user nova-compute[75014]:         </nova:port>
Nov 08 04:12:49 user nova-compute[75014]:       </nova:ports>
Nov 08 04:12:49 user nova-compute[75014]:     </nova:instance>
Nov 08 04:12:49 user nova-compute[75014]:   </metadata>
Nov 08 04:12:49 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:12:49 user nova-compute[75014]:     <system>
Nov 08 04:12:49 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:12:49 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:12:49 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:12:49 user nova-compute[75014]:       <entry name="serial">01754a6d-8f7b-46ad-b166-defe74eb9dd0</entry>
Nov 08 04:12:49 user nova-compute[75014]:       <entry name="uuid">01754a6d-8f7b-46ad-b166-defe74eb9dd0</entry>
Nov 08 04:12:49 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:12:49 user nova-compute[75014]:     </system>
Nov 08 04:12:49 user nova-compute[75014]:   </sysinfo>
Nov 08 04:12:49 user nova-compute[75014]:   <os>
Nov 08 04:12:49 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:12:49 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:12:49 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:12:49 user nova-compute[75014]:   </os>
Nov 08 04:12:49 user nova-compute[75014]:   <features>
Nov 08 04:12:49 user nova-compute[75014]:     <acpi/>
Nov 08 04:12:49 user nova-compute[75014]:     <apic/>
Nov 08 04:12:49 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:12:49 user nova-compute[75014]:   </features>
Nov 08 04:12:49 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:12:49 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:12:49 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:12:49 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:12:49 user nova-compute[75014]:   </clock>
Nov 08 04:12:49 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:12:49 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:12:49 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:12:49 user nova-compute[75014]:   </cpu>
Nov 08 04:12:49 user nova-compute[75014]:   <devices>
Nov 08 04:12:49 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 04:12:49 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 04:12:49 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk"/>
Nov 08 04:12:49 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:12:49 user nova-compute[75014]:     </disk>
Nov 08 04:12:49 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:12:49 user nova-compute[75014]:       <mac address="fa:16:3e:23:ba:ba"/>
Nov 08 04:12:49 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:12:49 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:12:49 user nova-compute[75014]:       <target dev="tapa4210bed-2f"/>
Nov 08 04:12:49 user nova-compute[75014]:     </interface>
Nov 08 04:12:49 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:12:49 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/console.log" append="off"/>
Nov 08 04:12:49 user nova-compute[75014]:     </serial>
Nov 08 04:12:49 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:12:49 user nova-compute[75014]:     <video>
Nov 08 04:12:49 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:12:49 user nova-compute[75014]:     </video>
Nov 08 04:12:49 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:12:49 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:12:49 user nova-compute[75014]:     </rng>
Nov 08 04:12:49 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:12:49 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:12:49 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:12:49 user nova-compute[75014]:     </memballoon>
Nov 08 04:12:49 user nova-compute[75014]:   </devices>
Nov 08 04:12:49 user nova-compute[75014]: </domain>
Nov 08 04:12:49 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:12:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1881370906',display_name='tempest-TestServerVolumeAttachmentScenario-server-1881370906',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1881370906',id=39,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3M1sDRB0GIEtgmJ4Lbnj4DpfKwKPusqsP9tla7u4fzj1rQk1tbSp5VGsqayI1/zi4p0WIYWfUvoCtlBaP03tIoYXAgDeD4kBxhw5YOfJm6XVYVPr6pvRLB1LuQTnkFQw==',key_name='tempest-keypair-548927297',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a7e7ba2cb0b4038927288ab2157a8eb',ramdisk_id='',reservation_id='r-1svzq22d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2003968374',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2003968374-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:12:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fe1a418bca44d0ca8c5a2a9ba7777c9',uuid=01754a6d-8f7b-46ad-b166-defe74eb9dd0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4210bed-2f6f-4c2b-ad92-fce0779168f9", "address": "fa:16:3e:23:ba:ba", "network": {"id": "a5c06b2d-3ef9-4f4e-9537-b065082d1a10", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-102893709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a7e7ba2cb0b4038927288ab2157a8eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4210bed-2f", "ovs_interfaceid": "a4210bed-2f6f-4c2b-ad92-fce0779168f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Converting VIF {"id": "a4210bed-2f6f-4c2b-ad92-fce0779168f9", "address": "fa:16:3e:23:ba:ba", "network": {"id": "a5c06b2d-3ef9-4f4e-9537-b065082d1a10", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-102893709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a7e7ba2cb0b4038927288ab2157a8eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4210bed-2f", "ovs_interfaceid": "a4210bed-2f6f-4c2b-ad92-fce0779168f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:ba:ba,bridge_name='br-int',has_traffic_filtering=True,id=a4210bed-2f6f-4c2b-ad92-fce0779168f9,network=Network(a5c06b2d-3ef9-4f4e-9537-b065082d1a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4210bed-2f') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG os_vif [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:ba:ba,bridge_name='br-int',has_traffic_filtering=True,id=a4210bed-2f6f-4c2b-ad92-fce0779168f9,network=Network(a5c06b2d-3ef9-4f4e-9537-b065082d1a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4210bed-2f') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '51f1cc37-ac48-5e58-b5e3-323025638d02', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4210bed-2f, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4210bed-2f, col_values=(('qos', UUID('341c7d3d-365a-4472-a99d-9245e210cae6')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4210bed-2f, col_values=(('external_ids', {'iface-id': 'a4210bed-2f6f-4c2b-ad92-fce0779168f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:ba:ba', 'vm-uuid': '01754a6d-8f7b-46ad-b166-defe74eb9dd0'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:49 user nova-compute[75014]: INFO os_vif [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:ba:ba,bridge_name='br-int',has_traffic_filtering=True,id=a4210bed-2f6f-4c2b-ad92-fce0779168f9,network=Network(a5c06b2d-3ef9-4f4e-9537-b065082d1a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4210bed-2f')
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] No VIF found with MAC fa:16:3e:23:ba:ba, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.416s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.network.neutron [req-930f4a3f-0c96-4622-8773-f48c93a7b8df req-4767f80e-27ac-496e-96be-1fc441988e57 service nova] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Updated VIF entry in instance network info cache for port a4210bed-2f6f-4c2b-ad92-fce0779168f9. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG nova.network.neutron [req-930f4a3f-0c96-4622-8773-f48c93a7b8df req-4767f80e-27ac-496e-96be-1fc441988e57 service nova] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Updating instance_info_cache with network_info: [{"id": "a4210bed-2f6f-4c2b-ad92-fce0779168f9", "address": "fa:16:3e:23:ba:ba", "network": {"id": "a5c06b2d-3ef9-4f4e-9537-b065082d1a10", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-102893709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a7e7ba2cb0b4038927288ab2157a8eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4210bed-2f", "ovs_interfaceid": "a4210bed-2f6f-4c2b-ad92-fce0779168f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:12:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-930f4a3f-0c96-4622-8773-f48c93a7b8df req-4767f80e-27ac-496e-96be-1fc441988e57 service nova] Releasing lock "refresh_cache-01754a6d-8f7b-46ad-b166-defe74eb9dd0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:12:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:51 user nova-compute[75014]: DEBUG nova.compute.manager [req-22594e98-a819-46d4-80db-74abe00793f8 req-1e136bad-3221-4cfc-ae30-a988573d5135 service nova] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Received event network-vif-plugged-a4210bed-2f6f-4c2b-ad92-fce0779168f9 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:12:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-22594e98-a819-46d4-80db-74abe00793f8 req-1e136bad-3221-4cfc-ae30-a988573d5135 service nova] Acquiring lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:12:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-22594e98-a819-46d4-80db-74abe00793f8 req-1e136bad-3221-4cfc-ae30-a988573d5135 service nova] Lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:12:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-22594e98-a819-46d4-80db-74abe00793f8 req-1e136bad-3221-4cfc-ae30-a988573d5135 service nova] Lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:12:51 user nova-compute[75014]: DEBUG nova.compute.manager [req-22594e98-a819-46d4-80db-74abe00793f8 req-1e136bad-3221-4cfc-ae30-a988573d5135 service nova] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] No waiting events found dispatching network-vif-plugged-a4210bed-2f6f-4c2b-ad92-fce0779168f9 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:12:51 user nova-compute[75014]: WARNING nova.compute.manager [req-22594e98-a819-46d4-80db-74abe00793f8 req-1e136bad-3221-4cfc-ae30-a988573d5135 service nova] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Received unexpected event network-vif-plugged-a4210bed-2f6f-4c2b-ad92-fce0779168f9 for instance with vm_state building and task_state spawning.
Nov 08 04:12:51 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:12:51 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:12:51 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:12:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:53 user nova-compute[75014]: DEBUG nova.compute.manager [req-3a96bc14-5555-4728-a3cf-87cf0237c5d1 req-926872a5-46da-458b-a318-5f341f770f7e service nova] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Received event network-vif-plugged-a4210bed-2f6f-4c2b-ad92-fce0779168f9 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:12:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3a96bc14-5555-4728-a3cf-87cf0237c5d1 req-926872a5-46da-458b-a318-5f341f770f7e service nova] Acquiring lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:12:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3a96bc14-5555-4728-a3cf-87cf0237c5d1 req-926872a5-46da-458b-a318-5f341f770f7e service nova] Lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:12:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3a96bc14-5555-4728-a3cf-87cf0237c5d1 req-926872a5-46da-458b-a318-5f341f770f7e service nova] Lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:12:53 user nova-compute[75014]: DEBUG nova.compute.manager [req-3a96bc14-5555-4728-a3cf-87cf0237c5d1 req-926872a5-46da-458b-a318-5f341f770f7e service nova] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] No waiting events found dispatching network-vif-plugged-a4210bed-2f6f-4c2b-ad92-fce0779168f9 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:12:53 user nova-compute[75014]: WARNING nova.compute.manager [req-3a96bc14-5555-4728-a3cf-87cf0237c5d1 req-926872a5-46da-458b-a318-5f341f770f7e service nova] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Received unexpected event network-vif-plugged-a4210bed-2f6f-4c2b-ad92-fce0779168f9 for instance with vm_state building and task_state spawning.
Nov 08 04:12:53 user nova-compute[75014]: DEBUG nova.compute.manager [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:12:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 04:12:53 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Instance spawned successfully.
Nov 08 04:12:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 04:12:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:12:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:12:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:12:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:12:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:12:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:12:54 user nova-compute[75014]: INFO nova.compute.manager [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Took 6.90 seconds to spawn the instance on the hypervisor.
Nov 08 04:12:54 user nova-compute[75014]: DEBUG nova.compute.manager [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:12:54 user nova-compute[75014]: INFO nova.compute.manager [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Took 7.80 seconds to build instance.
Nov 08 04:12:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-34f9b349-4772-4764-897b-22b559d9802b tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.924s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:12:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:12:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:13:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:13:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:13:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:13:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:13:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:13:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:13:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:13:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:13:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:13:24 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:13:25 user nova-compute[75014]: DEBUG nova.compute.manager [req-52a47ea2-99fc-4b47-a012-56b5f49f3d2c req-3b0283e2-fe83-42bb-a18d-24883eefaa5c service nova] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Received event network-changed-ec6ba361-fe2c-42e8-aa9a-5539139889de {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:13:25 user nova-compute[75014]: DEBUG nova.compute.manager [req-52a47ea2-99fc-4b47-a012-56b5f49f3d2c req-3b0283e2-fe83-42bb-a18d-24883eefaa5c service nova] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Refreshing instance network info cache due to event network-changed-ec6ba361-fe2c-42e8-aa9a-5539139889de. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:13:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-52a47ea2-99fc-4b47-a012-56b5f49f3d2c req-3b0283e2-fe83-42bb-a18d-24883eefaa5c service nova] Acquiring lock "refresh_cache-351d7017-81d2-42bd-8d9c-eb820657bb85" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:13:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-52a47ea2-99fc-4b47-a012-56b5f49f3d2c req-3b0283e2-fe83-42bb-a18d-24883eefaa5c service nova] Acquired lock "refresh_cache-351d7017-81d2-42bd-8d9c-eb820657bb85" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:13:25 user nova-compute[75014]: DEBUG nova.network.neutron [req-52a47ea2-99fc-4b47-a012-56b5f49f3d2c req-3b0283e2-fe83-42bb-a18d-24883eefaa5c service nova] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Refreshing network info cache for port ec6ba361-fe2c-42e8-aa9a-5539139889de {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:13:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquiring lock "351d7017-81d2-42bd-8d9c-eb820657bb85" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:13:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "351d7017-81d2-42bd-8d9c-eb820657bb85" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:13:26 user nova-compute[75014]: DEBUG nova.objects.instance [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lazy-loading 'flavor' on Instance uuid 351d7017-81d2-42bd-8d9c-eb820657bb85 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:13:26 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Ignoring supplied device name: /dev/vdb
Nov 08 04:13:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "351d7017-81d2-42bd-8d9c-eb820657bb85" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:13:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquiring lock "351d7017-81d2-42bd-8d9c-eb820657bb85" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:13:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "351d7017-81d2-42bd-8d9c-eb820657bb85" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:13:26 user nova-compute[75014]: INFO nova.compute.manager [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Attaching volume b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 to /dev/vdb
Nov 08 04:13:26 user nova-compute[75014]: DEBUG nova.network.neutron [req-52a47ea2-99fc-4b47-a012-56b5f49f3d2c req-3b0283e2-fe83-42bb-a18d-24883eefaa5c service nova] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Updated VIF entry in instance network info cache for port ec6ba361-fe2c-42e8-aa9a-5539139889de. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:13:26 user nova-compute[75014]: DEBUG nova.network.neutron [req-52a47ea2-99fc-4b47-a012-56b5f49f3d2c req-3b0283e2-fe83-42bb-a18d-24883eefaa5c service nova] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Updating instance_info_cache with network_info: [{"id": "ec6ba361-fe2c-42e8-aa9a-5539139889de", "address": "fa:16:3e:8b:46:82", "network": {"id": "25bc77a0-1460-485f-a61a-a43843631782", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-430613931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e5003c0e79d42248cd1ff8be29fe3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec6ba361-fe", "ovs_interfaceid": "ec6ba361-fe2c-42e8-aa9a-5539139889de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:13:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-52a47ea2-99fc-4b47-a012-56b5f49f3d2c req-3b0283e2-fe83-42bb-a18d-24883eefaa5c service nova] Releasing lock "refresh_cache-351d7017-81d2-42bd-8d9c-eb820657bb85" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:13:26 user nova-compute[75014]: DEBUG os_brick.utils [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:13:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:13:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8a6df4-16ec-4e95-8b74-2bc5a3a3c52c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:13:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:13:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f812cf1-3667-4767-b4a8-dad9b9cd27ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:13:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:13:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddf4ece-660c-43e0-911e-7fa0110ff52f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:13:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e72291-4bea-4504-8943-0288e2dc6e58]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:13:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:13:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:13:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:13:26 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:13:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[84835eb4-f902-420d-868e-a78c654f12d6]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:13:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:13:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:13:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:13:26 user nova-compute[75014]: DEBUG os_brick.utils [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:13:26 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Updating existing volume attachment record: 3c142622-370d-4d1e-9705-2867e05abbac {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Acquiring lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:13:27 user nova-compute[75014]: INFO nova.compute.manager [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Unshelving
Nov 08 04:13:27 user nova-compute[75014]: INFO nova.virt.block_device [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Booting with volume e0ec0452-90f2-48e1-b99a-b6a460342437 at /dev/vda
Nov 08 04:13:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG nova.compute.manager [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG os_brick.utils [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9989a0c-729d-4ac0-9f5b-8a8525ef320c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5270254-e8eb-4410-a72f-f931efa059db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a74c6a-3bc9-41ae-a57b-6967067fcf05]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[58aaf9af-f503-45a4-b09e-3c80c946b06a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:13:27 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:13:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[005bc91c-5294-4031-8f55-c9223a9919ea]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG os_brick.utils [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Updating existing volume attachment record: ee495615-d64f-411e-bbe5-0ca69f51ef23 {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 04:13:27 user nova-compute[75014]: INFO nova.compute.claims [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Claim successful on node user
Nov 08 04:13:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.376s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG nova.compute.manager [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG nova.compute.manager [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 04:13:27 user nova-compute[75014]: DEBUG nova.network.neutron [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 04:13:27 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 04:13:27 user nova-compute[75014]: DEBUG nova.compute.manager [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 04:13:28 user nova-compute[75014]: DEBUG nova.policy [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8398fcf62a014e7f943bff6fcc3f72f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9ecaed30ba4ad1a9d5eaca02633604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 04:13:28 user nova-compute[75014]: INFO nova.virt.block_device [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Booting with volume 31cf2118-895b-4150-a0c1-bbb83999f429 at /dev/vda
Nov 08 04:13:28 user nova-compute[75014]: DEBUG os_brick.utils [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:13:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:13:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a63e458-fa6b-40a0-9fe1-0376e9b6d524]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:13:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:13:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57b1f5c-145a-439d-bbf2-a652540873e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:13:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:13:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9666c9-d52d-4577-a619-75178ed41946]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:13:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5845483-7f1c-4b04-962d-bba1fb991ef9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:13:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:13:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:13:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:13:28 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:13:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cd3e4b-f2e7-4729-bb2b-e434cb8497eb]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:13:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:13:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:13:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:13:28 user nova-compute[75014]: DEBUG os_brick.utils [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:13:28 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Updating existing volume attachment record: 925dfb15-3c85-4335-bfa5-dc3eaca6b141 {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:13:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:13:28 user nova-compute[75014]: DEBUG nova.network.neutron [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Successfully created port: 80b71c76-357d-449c-8c5c-a1b28b1e6756 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 04:13:29 user nova-compute[75014]: DEBUG nova.network.neutron [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Successfully updated port: 80b71c76-357d-449c-8c5c-a1b28b1e6756 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 04:13:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "refresh_cache-9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:13:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquired lock "refresh_cache-9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:13:29 user nova-compute[75014]: DEBUG nova.network.neutron [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:13:29 user nova-compute[75014]: DEBUG nova.compute.manager [req-5c51b113-9267-4f0e-9101-975431acc368 req-328f6aca-9d3e-4b1e-adb6-91ec1e872936 service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Received event network-changed-80b71c76-357d-449c-8c5c-a1b28b1e6756 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:13:29 user nova-compute[75014]: DEBUG nova.compute.manager [req-5c51b113-9267-4f0e-9101-975431acc368 req-328f6aca-9d3e-4b1e-adb6-91ec1e872936 service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Refreshing instance network info cache due to event network-changed-80b71c76-357d-449c-8c5c-a1b28b1e6756. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:13:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5c51b113-9267-4f0e-9101-975431acc368 req-328f6aca-9d3e-4b1e-adb6-91ec1e872936 service nova] Acquiring lock "refresh_cache-9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:13:29 user nova-compute[75014]: DEBUG nova.network.neutron [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 04:13:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:13:29 user nova-compute[75014]: DEBUG nova.network.neutron [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Updating instance_info_cache with network_info: [{"id": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "address": "fa:16:3e:61:82:36", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b71c76-35", "ovs_interfaceid": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:13:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Releasing lock "refresh_cache-9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:13:29 user nova-compute[75014]: DEBUG nova.compute.manager [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Instance network_info: |[{"id": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "address": "fa:16:3e:61:82:36", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b71c76-35", "ovs_interfaceid": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 04:13:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5c51b113-9267-4f0e-9101-975431acc368 req-328f6aca-9d3e-4b1e-adb6-91ec1e872936 service nova] Acquired lock "refresh_cache-9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:13:29 user nova-compute[75014]: DEBUG nova.network.neutron [req-5c51b113-9267-4f0e-9101-975431acc368 req-328f6aca-9d3e-4b1e-adb6-91ec1e872936 service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Refreshing network info cache for port 80b71c76-357d-449c-8c5c-a1b28b1e6756 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:13:30 user nova-compute[75014]: DEBUG nova.network.neutron [req-5c51b113-9267-4f0e-9101-975431acc368 req-328f6aca-9d3e-4b1e-adb6-91ec1e872936 service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Updated VIF entry in instance network info cache for port 80b71c76-357d-449c-8c5c-a1b28b1e6756. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:13:30 user nova-compute[75014]: DEBUG nova.network.neutron [req-5c51b113-9267-4f0e-9101-975431acc368 req-328f6aca-9d3e-4b1e-adb6-91ec1e872936 service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Updating instance_info_cache with network_info: [{"id": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "address": "fa:16:3e:61:82:36", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b71c76-35", "ovs_interfaceid": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:13:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5c51b113-9267-4f0e-9101-975431acc368 req-328f6aca-9d3e-4b1e-adb6-91ec1e872936 service nova] Releasing lock "refresh_cache-9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:13:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:13:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:13:37 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:13:38 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:13:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:13:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:13:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:13:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:13:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:13:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:13:40 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:13:40 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:13:40 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Didn't find any instances for network info cache update. {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 04:13:40 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:13:41 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:13:42 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:13:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:13:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:13:46 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:13:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:13:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:13:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:13:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:13:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:13:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:13:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:13:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:13:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:13:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:13:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:13:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:13:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351d7017-81d2-42bd-8d9c-eb820657bb85/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351d7017-81d2-42bd-8d9c-eb820657bb85/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:13:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351d7017-81d2-42bd-8d9c-eb820657bb85/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351d7017-81d2-42bd-8d9c-eb820657bb85/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:13:48 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:13:48 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:13:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=8170MB free_disk=24.95724868774414GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:13:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:13:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:13:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance c23c9e00-b782-4530-bb01-a7a167951c1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:13:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 781932ce-0bea-466f-95e0-066130d6c410 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:13:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 351d7017-81d2-42bd-8d9c-eb820657bb85 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:13:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 077303d8-0afd-4c60-ad9a-1bd29bff4d2d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:13:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 01754a6d-8f7b-46ad-b166-defe74eb9dd0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:13:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance ace7e2f7-28c3-41e3-b92b-05e834c3968c has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 08 04:13:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:13:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:13:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:13:49 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:13:49 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:13:49 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:13:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.379s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:13:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:13:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:13:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:13:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:13:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:13:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:13:51 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:13:51 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:13:53 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:13:54 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:13:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKykrPvN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:13:57 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:13:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:13:57 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:13:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:13:57 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6a0937-33e7-45d6-a24b-5a73642cc443]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:13:57 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b34f699-eafe-47b3-9cff-034c9206497d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474] added
Nov 08 04:13:57 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0c84cd-020c-44de-93c9-0eb038159054]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f06aa6-9dea-48f0-b9b9-f0bfc34d53e7]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XKykrPvN {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XKykrPvN" returned: 0 in 0.028s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0505050d-5474-4bf3-826e-6b5850284c96]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XKykrPvN'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c503062-3170-4add-8863-dc2c5b40768f]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4c91c7-d3cf-4e4a-afa6-d0aad4f0260c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:13:57 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:13:57 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f13e7a-6b46-4bbc-9cbf-fa08741c1fe6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474, portal: 172.16.0.220,3260]
Nov 08 04:13:57 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474, portal: 172.16.0.220,3260] successful.
Nov 08 04:13:57 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f446c8-abe7-418f-b648-bf17034a6487]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8037f64-feb4-485e-8c43-4d434b1652ec]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:13:57 user nova-compute[75014]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 (non-flash)
Nov 08 04:13:57 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:13:57 user nova-compute[75014]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 (non-flash)
Nov 08 04:13:57 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05a4038-790b-4aa6-89c5-499f55684827]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: None {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:13:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:13:58 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:13:58 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKykrPvN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:13:58 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:13:58 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23335643133336461', 'path': '/dev/sdb'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:13:58 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335643133336461', 'path': '/dev/sdb'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:13:58 user nova-compute[75014]: DEBUG nova.objects.instance [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lazy-loading 'flavor' on Instance uuid 351d7017-81d2-42bd-8d9c-eb820657bb85 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:13:58 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 04:13:58 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:13:58 user nova-compute[75014]:   <source dev="/dev/sdb"/>
Nov 08 04:13:58 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:13:58 user nova-compute[75014]:   <serial>b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474</serial>
Nov 08 04:13:58 user nova-compute[75014]: </disk>
Nov 08 04:13:58 user nova-compute[75014]:  {{(pid=75014) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 04:13:59 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:13:59 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:13:59 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] No VIF found with MAC fa:16:3e:8b:46:82, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:13:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-8c8a5b06-79e5-4dda-b183-03a609cffc64 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "351d7017-81d2-42bd-8d9c-eb820657bb85" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.891s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:13:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:14:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:14:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:14:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:14:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG nova.compute.manager [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 04:14:14 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Creating image(s)
Nov 08 04:14:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Did not create local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Ensure instance console log exists: /opt/stack/data/nova/instances/9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Start _get_guest_xml network_info=[{"id": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "address": "fa:16:3e:61:82:36", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b71c76-35", "ovs_interfaceid": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LTbZRhoy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7', 'attached_at': '', 'detached_at': '', 'volume_id': '31cf2118-895b-4150-a0c1-bbb83999f429', 'serial': '31cf2118-895b-4150-a0c1-bbb83999f429'}, 'device_type': 'disk', 'attachment_id': '925dfb15-3c85-4335-bfa5-dc3eaca6b141', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:14:14 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:14:14 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG nova.objects.instance [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lazy-loading 'pci_requests' on Instance uuid ace7e2f7-28c3-41e3-b92b-05e834c3968c {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LTbZRhoy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:14:14 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:14:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:14:14 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:14:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:14:14 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:14:14 user nova-compute[75014]: DEBUG nova.objects.instance [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lazy-loading 'numa_topology' on Instance uuid ace7e2f7-28c3-41e3-b92b-05e834c3968c {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 04:14:14 user nova-compute[75014]: INFO nova.compute.claims [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Claim successful on node user
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80752c1-3706-48cc-af52-cdb97cf58910]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:14:14 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f89f3f-66de-4f17-a74b-66ef5e386513]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429] added
Nov 08 04:14:14 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[39751603-3e8f-475d-92d2-861ccf4940b8]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8cadbf-ef6e-42cc-9452-2e63edaeb245]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LTbZRhoy {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LTbZRhoy" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4685cd29-c873-4b34-add6-21b17257afe3]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LTbZRhoy'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4228ccc0-ec1c-4401-a4ef-caaa26650877]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[024d7281-1f45-4dab-a526-cab1cd9af48c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:14:14 user nova-compute[75014]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 (non-flash)
Nov 08 04:14:14 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:14:14 user nova-compute[75014]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 (non-flash)
Nov 08 04:14:14 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a322c1ad-041c-4679-b568-d191ac4cfa5e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429, portal: 172.16.0.220,3260]
Nov 08 04:14:14 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429, portal: 172.16.0.220,3260] successful.
Nov 08 04:14:14 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9975f649-0033-4874-9680-3f536dbbd2de]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c377de9c-b3f3-4c38-8296-365db8c5a06a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:14:14 user nova-compute[75014]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 (non-flash)
Nov 08 04:14:14 user nova-compute[75014]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:14:14 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:14:14 user nova-compute[75014]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 (non-flash)
Nov 08 04:14:14 user nova-compute[75014]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:14:14 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[966f08b9-2fd9-44c6-ac4a-6f98a99d666b]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LTbZRhoy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:14:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:14:14 user nova-compute[75014]: INFO nova.network.neutron [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Updating port 0fe677fa-7bc0-4ab0-abe1-4078284cb71a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Acquiring lock "refresh_cache-ace7e2f7-28c3-41e3-b92b-05e834c3968c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Acquired lock "refresh_cache-ace7e2f7-28c3-41e3-b92b-05e834c3968c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.network.neutron [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.compute.manager [req-03f5d5ce-9a8d-4be7-8ca4-3b78c1cbbdfa req-5f40eb82-152e-4a35-b229-b332c991e843 service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Received event network-changed-0fe677fa-7bc0-4ab0-abe1-4078284cb71a {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.compute.manager [req-03f5d5ce-9a8d-4be7-8ca4-3b78c1cbbdfa req-5f40eb82-152e-4a35-b229-b332c991e843 service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Refreshing instance network info cache due to event network-changed-0fe677fa-7bc0-4ab0-abe1-4078284cb71a. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-03f5d5ce-9a8d-4be7-8ca4-3b78c1cbbdfa req-5f40eb82-152e-4a35-b229-b332c991e843 service nova] Acquiring lock "refresh_cache-ace7e2f7-28c3-41e3-b92b-05e834c3968c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26232333963623132', 'path': '/dev/sdc'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232333963623132', 'path': '/dev/sdc'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:13:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-508013248',display_name='tempest-ServerActionsTestOtherA-server-508013248',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-508013248',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrmtIbZxgIG+Mj0FCPzPyxgkvpjo1RlPcXcxfMKotFzO42Fyp9FxpoU2iamZDPiUFM+ibJrBLSV5KEQ2GBDLuvdHnBp4eyBffs9QFbrBPe1RSRIG54GYFQAZ3CvgZJG1Q==',key_name='tempest-keypair-516992333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b9ecaed30ba4ad1a9d5eaca02633604',ramdisk_id='',reservation_id='r-6xy5m0zg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-537496863',owner_user_name='tempest-ServerActionsTestOtherA-537496863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:13:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8398fcf62a014e7f943bff6fcc3f72f3',uuid=9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "address": "fa:16:3e:61:82:36", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b71c76-35", "ovs_interfaceid": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Converting VIF {"id": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "address": "fa:16:3e:61:82:36", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b71c76-35", "ovs_interfaceid": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:82:36,bridge_name='br-int',has_traffic_filtering=True,id=80b71c76-357d-449c-8c5c-a1b28b1e6756,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b71c76-35') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.objects.instance [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:14:15 user nova-compute[75014]:   <uuid>9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7</uuid>
Nov 08 04:14:15 user nova-compute[75014]:   <name>instance-00000028</name>
Nov 08 04:14:15 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:14:15 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:14:15 user nova-compute[75014]:   <metadata>
Nov 08 04:14:15 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:14:15 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:14:15 user nova-compute[75014]:       <nova:name>tempest-ServerActionsTestOtherA-server-508013248</nova:name>
Nov 08 04:14:15 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:14:14</nova:creationTime>
Nov 08 04:14:15 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:14:15 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:14:15 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:14:15 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:14:15 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:14:15 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:14:15 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:14:15 user nova-compute[75014]:       <nova:owner>
Nov 08 04:14:15 user nova-compute[75014]:         <nova:user uuid="8398fcf62a014e7f943bff6fcc3f72f3">tempest-ServerActionsTestOtherA-537496863-project-member</nova:user>
Nov 08 04:14:15 user nova-compute[75014]:         <nova:project uuid="7b9ecaed30ba4ad1a9d5eaca02633604">tempest-ServerActionsTestOtherA-537496863</nova:project>
Nov 08 04:14:15 user nova-compute[75014]:       </nova:owner>
Nov 08 04:14:15 user nova-compute[75014]:       <nova:ports>
Nov 08 04:14:15 user nova-compute[75014]:         <nova:port uuid="80b71c76-357d-449c-8c5c-a1b28b1e6756">
Nov 08 04:14:15 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 04:14:15 user nova-compute[75014]:         </nova:port>
Nov 08 04:14:15 user nova-compute[75014]:       </nova:ports>
Nov 08 04:14:15 user nova-compute[75014]:     </nova:instance>
Nov 08 04:14:15 user nova-compute[75014]:   </metadata>
Nov 08 04:14:15 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:14:15 user nova-compute[75014]:     <system>
Nov 08 04:14:15 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:14:15 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:14:15 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:14:15 user nova-compute[75014]:       <entry name="serial">9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7</entry>
Nov 08 04:14:15 user nova-compute[75014]:       <entry name="uuid">9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7</entry>
Nov 08 04:14:15 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:14:15 user nova-compute[75014]:     </system>
Nov 08 04:14:15 user nova-compute[75014]:   </sysinfo>
Nov 08 04:14:15 user nova-compute[75014]:   <os>
Nov 08 04:14:15 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:14:15 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:14:15 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:14:15 user nova-compute[75014]:   </os>
Nov 08 04:14:15 user nova-compute[75014]:   <features>
Nov 08 04:14:15 user nova-compute[75014]:     <acpi/>
Nov 08 04:14:15 user nova-compute[75014]:     <apic/>
Nov 08 04:14:15 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:14:15 user nova-compute[75014]:   </features>
Nov 08 04:14:15 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:14:15 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:14:15 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:14:15 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:14:15 user nova-compute[75014]:   </clock>
Nov 08 04:14:15 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:14:15 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:14:15 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:14:15 user nova-compute[75014]:   </cpu>
Nov 08 04:14:15 user nova-compute[75014]:   <devices>
Nov 08 04:14:15 user nova-compute[75014]:     <disk type="block" device="disk">
Nov 08 04:14:15 user nova-compute[75014]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:14:15 user nova-compute[75014]:       <source dev="/dev/sdc"/>
Nov 08 04:14:15 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:14:15 user nova-compute[75014]:       <serial>31cf2118-895b-4150-a0c1-bbb83999f429</serial>
Nov 08 04:14:15 user nova-compute[75014]:     </disk>
Nov 08 04:14:15 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:14:15 user nova-compute[75014]:       <mac address="fa:16:3e:61:82:36"/>
Nov 08 04:14:15 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:14:15 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:14:15 user nova-compute[75014]:       <target dev="tap80b71c76-35"/>
Nov 08 04:14:15 user nova-compute[75014]:     </interface>
Nov 08 04:14:15 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:14:15 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7/console.log" append="off"/>
Nov 08 04:14:15 user nova-compute[75014]:     </serial>
Nov 08 04:14:15 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:14:15 user nova-compute[75014]:     <video>
Nov 08 04:14:15 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:14:15 user nova-compute[75014]:     </video>
Nov 08 04:14:15 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:14:15 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:14:15 user nova-compute[75014]:     </rng>
Nov 08 04:14:15 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:14:15 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:14:15 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:14:15 user nova-compute[75014]:     </memballoon>
Nov 08 04:14:15 user nova-compute[75014]:   </devices>
Nov 08 04:14:15 user nova-compute[75014]: </domain>
Nov 08 04:14:15 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:13:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-508013248',display_name='tempest-ServerActionsTestOtherA-server-508013248',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-508013248',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrmtIbZxgIG+Mj0FCPzPyxgkvpjo1RlPcXcxfMKotFzO42Fyp9FxpoU2iamZDPiUFM+ibJrBLSV5KEQ2GBDLuvdHnBp4eyBffs9QFbrBPe1RSRIG54GYFQAZ3CvgZJG1Q==',key_name='tempest-keypair-516992333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b9ecaed30ba4ad1a9d5eaca02633604',ramdisk_id='',reservation_id='r-6xy5m0zg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-537496863',owner_user_name='tempest-ServerActionsTestOtherA-537496863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:13:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8398fcf62a014e7f943bff6fcc3f72f3',uuid=9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "address": "fa:16:3e:61:82:36", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b71c76-35", "ovs_interfaceid": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Converting VIF {"id": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "address": "fa:16:3e:61:82:36", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b71c76-35", "ovs_interfaceid": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:82:36,bridge_name='br-int',has_traffic_filtering=True,id=80b71c76-357d-449c-8c5c-a1b28b1e6756,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b71c76-35') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG os_vif [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:82:36,bridge_name='br-int',has_traffic_filtering=True,id=80b71c76-357d-449c-8c5c-a1b28b1e6756,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b71c76-35') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '78aa2d7c-ac12-5d52-b1cc-d3f53734b445', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80b71c76-35, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80b71c76-35, col_values=(('qos', UUID('305ee777-26e2-4db6-8ec9-d3bdceedf8ee')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80b71c76-35, col_values=(('external_ids', {'iface-id': '80b71c76-357d-449c-8c5c-a1b28b1e6756', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:82:36', 'vm-uuid': '9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:15 user nova-compute[75014]: INFO os_vif [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:82:36,bridge_name='br-int',has_traffic_filtering=True,id=80b71c76-357d-449c-8c5c-a1b28b1e6756,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b71c76-35')
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.network.neutron [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Updating instance_info_cache with network_info: [{"id": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "address": "fa:16:3e:9c:4b:98", "network": {"id": "11cfca93-63ac-49c6-8cf8-2c7885e21563", "bridge": "br-int", "label": "tempest-TestShelveInstance-1503372709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0174a3477d45e1a6aa8a405b0027b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe677fa-7b", "ovs_interfaceid": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Releasing lock "refresh_cache-ace7e2f7-28c3-41e3-b92b-05e834c3968c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 04:14:15 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Creating image(s)
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Did not create local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Ensure instance console log exists: /opt/stack/data/nova/instances/ace7e2f7-28c3-41e3-b92b-05e834c3968c/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Start _get_guest_xml network_info=[{"id": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "address": "fa:16:3e:9c:4b:98", "network": {"id": "11cfca93-63ac-49c6-8cf8-2c7885e21563", "bridge": "br-int", "label": "tempest-TestShelveInstance-1503372709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0174a3477d45e1a6aa8a405b0027b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe677fa-7b", "ovs_interfaceid": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zoZcGiyA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ace7e2f7-28c3-41e3-b92b-05e834c3968c', 'attached_at': '', 'detached_at': '', 'volume_id': 'e0ec0452-90f2-48e1-b99a-b6a460342437', 'serial': 'e0ec0452-90f2-48e1-b99a-b6a460342437'}, 'device_type': 'disk', 'attachment_id': 'ee495615-d64f-411e-bbe5-0ca69f51ef23', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-03f5d5ce-9a8d-4be7-8ca4-3b78c1cbbdfa req-5f40eb82-152e-4a35-b229-b332c991e843 service nova] Acquired lock "refresh_cache-ace7e2f7-28c3-41e3-b92b-05e834c3968c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.network.neutron [req-03f5d5ce-9a8d-4be7-8ca4-3b78c1cbbdfa req-5f40eb82-152e-4a35-b229-b332c991e843 service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Refreshing network info cache for port 0fe677fa-7bc0-4ab0-abe1-4078284cb71a {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] No VIF found with MAC fa:16:3e:61:82:36, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:14:15 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:14:15 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:14:15 user nova-compute[75014]: DEBUG nova.objects.instance [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lazy-loading 'vcpu_model' on Instance uuid ace7e2f7-28c3-41e3-b92b-05e834c3968c {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG nova.objects.base [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Object Instance<ace7e2f7-28c3-41e3-b92b-05e834c3968c> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zoZcGiyA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:14:16 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:14:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:14:16 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:14:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:14:16 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cc6686-9242-417f-8f4d-5e03b9f2086c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:14:16 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2e8c78-a465-4534-8e79-d53f9540af49]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437] added
Nov 08 04:14:16 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cebee2-9687-4d41-8c69-a75c0722446b]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[548947e6-d46b-432e-9b7b-8685637909c8]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zoZcGiyA {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zoZcGiyA" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[456bf5ab-837b-4c68-96a0-0949bf3c5320]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zoZcGiyA'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[45540f0d-4e6a-405e-bc00-3257f542faa1]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[150afb32-00c0-4129-b0d3-a7088450cf6f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:14:16 user nova-compute[75014]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 (non-flash)
Nov 08 04:14:16 user nova-compute[75014]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:14:16 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:14:16 user nova-compute[75014]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 (non-flash)
Nov 08 04:14:16 user nova-compute[75014]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:14:16 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7bb41b-206d-4f23-a98f-042da4e05f9c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437, portal: 172.16.0.220,3260]
Nov 08 04:14:16 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437, portal: 172.16.0.220,3260] successful.
Nov 08 04:14:16 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec654c9-34c1-41af-b6c7-fc502015d326]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[398844fe-94ef-4fba-8cc9-916582e83273]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:14:16 user nova-compute[75014]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 (non-flash)
Nov 08 04:14:16 user nova-compute[75014]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:14:16 user nova-compute[75014]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)
Nov 08 04:14:16 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:14:16 user nova-compute[75014]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 (non-flash)
Nov 08 04:14:16 user nova-compute[75014]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:14:16 user nova-compute[75014]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)
Nov 08 04:14:16 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34c202e-4653-4d4c-8dfa-3aa48068df51]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: None {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG nova.network.neutron [req-03f5d5ce-9a8d-4be7-8ca4-3b78c1cbbdfa req-5f40eb82-152e-4a35-b229-b332c991e843 service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Updated VIF entry in instance network info cache for port 0fe677fa-7bc0-4ab0-abe1-4078284cb71a. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG nova.network.neutron [req-03f5d5ce-9a8d-4be7-8ca4-3b78c1cbbdfa req-5f40eb82-152e-4a35-b229-b332c991e843 service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Updating instance_info_cache with network_info: [{"id": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "address": "fa:16:3e:9c:4b:98", "network": {"id": "11cfca93-63ac-49c6-8cf8-2c7885e21563", "bridge": "br-int", "label": "tempest-TestShelveInstance-1503372709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0174a3477d45e1a6aa8a405b0027b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe677fa-7b", "ovs_interfaceid": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:14:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-03f5d5ce-9a8d-4be7-8ca4-3b78c1cbbdfa req-5f40eb82-152e-4a35-b229-b332c991e843 service nova] Releasing lock "refresh_cache-ace7e2f7-28c3-41e3-b92b-05e834c3968c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zoZcGiyA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '26362323930666465', 'path': '/dev/sdd'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362323930666465', 'path': '/dev/sdd'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T04:09:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1114062548',display_name='tempest-TestShelveInstance-server-1114062548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1114062548',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-26222747',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:10:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ad0174a3477d45e1a6aa8a405b0027b8',ramdisk_id='',reservation_id='r-v4udig5g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-958337227',owner_user_name='tempest-TestShelveInstance-958337227-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:13:27Z,user_data=None,user_id='58b14797a2974cb19e3759f51c391509',uuid=ace7e2f7-28c3-41e3-b92b-05e834c3968c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "address": "fa:16:3e:9c:4b:98", "network": {"id": "11cfca93-63ac-49c6-8cf8-2c7885e21563", "bridge": "br-int", "label": "tempest-TestShelveInstance-1503372709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0174a3477d45e1a6aa8a405b0027b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe677fa-7b", "ovs_interfaceid": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Converting VIF {"id": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "address": "fa:16:3e:9c:4b:98", "network": {"id": "11cfca93-63ac-49c6-8cf8-2c7885e21563", "bridge": "br-int", "label": "tempest-TestShelveInstance-1503372709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0174a3477d45e1a6aa8a405b0027b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe677fa-7b", "ovs_interfaceid": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:4b:98,bridge_name='br-int',has_traffic_filtering=True,id=0fe677fa-7bc0-4ab0-abe1-4078284cb71a,network=Network(11cfca93-63ac-49c6-8cf8-2c7885e21563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe677fa-7b') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG nova.objects.instance [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lazy-loading 'pci_devices' on Instance uuid ace7e2f7-28c3-41e3-b92b-05e834c3968c {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG nova.objects.base [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Object Instance<ace7e2f7-28c3-41e3-b92b-05e834c3968c> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:14:17 user nova-compute[75014]:   <uuid>ace7e2f7-28c3-41e3-b92b-05e834c3968c</uuid>
Nov 08 04:14:17 user nova-compute[75014]:   <name>instance-00000023</name>
Nov 08 04:14:17 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:14:17 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:14:17 user nova-compute[75014]:   <metadata>
Nov 08 04:14:17 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:14:17 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:14:17 user nova-compute[75014]:       <nova:name>tempest-TestShelveInstance-server-1114062548</nova:name>
Nov 08 04:14:17 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:14:15</nova:creationTime>
Nov 08 04:14:17 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:14:17 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:14:17 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:14:17 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:14:17 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:14:17 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:14:17 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:14:17 user nova-compute[75014]:       <nova:owner>
Nov 08 04:14:17 user nova-compute[75014]:         <nova:user uuid="58b14797a2974cb19e3759f51c391509">tempest-TestShelveInstance-958337227-project-member</nova:user>
Nov 08 04:14:17 user nova-compute[75014]:         <nova:project uuid="ad0174a3477d45e1a6aa8a405b0027b8">tempest-TestShelveInstance-958337227</nova:project>
Nov 08 04:14:17 user nova-compute[75014]:       </nova:owner>
Nov 08 04:14:17 user nova-compute[75014]:       <nova:ports>
Nov 08 04:14:17 user nova-compute[75014]:         <nova:port uuid="0fe677fa-7bc0-4ab0-abe1-4078284cb71a">
Nov 08 04:14:17 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 04:14:17 user nova-compute[75014]:         </nova:port>
Nov 08 04:14:17 user nova-compute[75014]:       </nova:ports>
Nov 08 04:14:17 user nova-compute[75014]:     </nova:instance>
Nov 08 04:14:17 user nova-compute[75014]:   </metadata>
Nov 08 04:14:17 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:14:17 user nova-compute[75014]:     <system>
Nov 08 04:14:17 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:14:17 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:14:17 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:14:17 user nova-compute[75014]:       <entry name="serial">ace7e2f7-28c3-41e3-b92b-05e834c3968c</entry>
Nov 08 04:14:17 user nova-compute[75014]:       <entry name="uuid">ace7e2f7-28c3-41e3-b92b-05e834c3968c</entry>
Nov 08 04:14:17 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:14:17 user nova-compute[75014]:     </system>
Nov 08 04:14:17 user nova-compute[75014]:   </sysinfo>
Nov 08 04:14:17 user nova-compute[75014]:   <os>
Nov 08 04:14:17 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:14:17 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:14:17 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:14:17 user nova-compute[75014]:   </os>
Nov 08 04:14:17 user nova-compute[75014]:   <features>
Nov 08 04:14:17 user nova-compute[75014]:     <acpi/>
Nov 08 04:14:17 user nova-compute[75014]:     <apic/>
Nov 08 04:14:17 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:14:17 user nova-compute[75014]:   </features>
Nov 08 04:14:17 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:14:17 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:14:17 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:14:17 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:14:17 user nova-compute[75014]:   </clock>
Nov 08 04:14:17 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:14:17 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:14:17 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:14:17 user nova-compute[75014]:   </cpu>
Nov 08 04:14:17 user nova-compute[75014]:   <devices>
Nov 08 04:14:17 user nova-compute[75014]:     <disk type="block" device="disk">
Nov 08 04:14:17 user nova-compute[75014]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:14:17 user nova-compute[75014]:       <source dev="/dev/sdd"/>
Nov 08 04:14:17 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:14:17 user nova-compute[75014]:       <serial>e0ec0452-90f2-48e1-b99a-b6a460342437</serial>
Nov 08 04:14:17 user nova-compute[75014]:     </disk>
Nov 08 04:14:17 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:14:17 user nova-compute[75014]:       <mac address="fa:16:3e:9c:4b:98"/>
Nov 08 04:14:17 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:14:17 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:14:17 user nova-compute[75014]:       <target dev="tap0fe677fa-7b"/>
Nov 08 04:14:17 user nova-compute[75014]:     </interface>
Nov 08 04:14:17 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:14:17 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/ace7e2f7-28c3-41e3-b92b-05e834c3968c/console.log" append="off"/>
Nov 08 04:14:17 user nova-compute[75014]:     </serial>
Nov 08 04:14:17 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:14:17 user nova-compute[75014]:     <video>
Nov 08 04:14:17 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:14:17 user nova-compute[75014]:     </video>
Nov 08 04:14:17 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:14:17 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:14:17 user nova-compute[75014]:     </rng>
Nov 08 04:14:17 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:14:17 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:14:17 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:14:17 user nova-compute[75014]:     </memballoon>
Nov 08 04:14:17 user nova-compute[75014]:   </devices>
Nov 08 04:14:17 user nova-compute[75014]: </domain>
Nov 08 04:14:17 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T04:09:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1114062548',display_name='tempest-TestShelveInstance-server-1114062548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1114062548',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-26222747',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:10:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ad0174a3477d45e1a6aa8a405b0027b8',ramdisk_id='',reservation_id='r-v4udig5g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-958337227',owner_user_name='tempest-TestShelveInstance-958337227-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:13:27Z,user_data=None,user_id='58b14797a2974cb19e3759f51c391509',uuid=ace7e2f7-28c3-41e3-b92b-05e834c3968c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "address": "fa:16:3e:9c:4b:98", "network": {"id": "11cfca93-63ac-49c6-8cf8-2c7885e21563", "bridge": "br-int", "label": "tempest-TestShelveInstance-1503372709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0174a3477d45e1a6aa8a405b0027b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe677fa-7b", "ovs_interfaceid": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Converting VIF {"id": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "address": "fa:16:3e:9c:4b:98", "network": {"id": "11cfca93-63ac-49c6-8cf8-2c7885e21563", "bridge": "br-int", "label": "tempest-TestShelveInstance-1503372709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0174a3477d45e1a6aa8a405b0027b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe677fa-7b", "ovs_interfaceid": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:4b:98,bridge_name='br-int',has_traffic_filtering=True,id=0fe677fa-7bc0-4ab0-abe1-4078284cb71a,network=Network(11cfca93-63ac-49c6-8cf8-2c7885e21563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe677fa-7b') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG os_vif [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:4b:98,bridge_name='br-int',has_traffic_filtering=True,id=0fe677fa-7bc0-4ab0-abe1-4078284cb71a,network=Network(11cfca93-63ac-49c6-8cf8-2c7885e21563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe677fa-7b') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '89ec231d-9d9c-5ce4-bbe1-d3e1c7c59e1b', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0fe677fa-7b, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0fe677fa-7b, col_values=(('qos', UUID('b0846bc4-1524-4836-803b-4fe1086bdd25')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0fe677fa-7b, col_values=(('external_ids', {'iface-id': '0fe677fa-7bc0-4ab0-abe1-4078284cb71a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:4b:98', 'vm-uuid': 'ace7e2f7-28c3-41e3-b92b-05e834c3968c'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:17 user nova-compute[75014]: INFO os_vif [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:4b:98,bridge_name='br-int',has_traffic_filtering=True,id=0fe677fa-7bc0-4ab0-abe1-4078284cb71a,network=Network(11cfca93-63ac-49c6-8cf8-2c7885e21563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe677fa-7b')
Nov 08 04:14:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] No VIF found with MAC fa:16:3e:9c:4b:98, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG nova.compute.manager [req-22856296-4abf-4faf-b4f5-187a1f6914ba req-c1ce659e-e10d-43a2-a9f6-55288b017e22 service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Received event network-vif-plugged-80b71c76-357d-449c-8c5c-a1b28b1e6756 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-22856296-4abf-4faf-b4f5-187a1f6914ba req-c1ce659e-e10d-43a2-a9f6-55288b017e22 service nova] Acquiring lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-22856296-4abf-4faf-b4f5-187a1f6914ba req-c1ce659e-e10d-43a2-a9f6-55288b017e22 service nova] Lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-22856296-4abf-4faf-b4f5-187a1f6914ba req-c1ce659e-e10d-43a2-a9f6-55288b017e22 service nova] Lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:14:17 user nova-compute[75014]: DEBUG nova.compute.manager [req-22856296-4abf-4faf-b4f5-187a1f6914ba req-c1ce659e-e10d-43a2-a9f6-55288b017e22 service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] No waiting events found dispatching network-vif-plugged-80b71c76-357d-449c-8c5c-a1b28b1e6756 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:14:17 user nova-compute[75014]: WARNING nova.compute.manager [req-22856296-4abf-4faf-b4f5-187a1f6914ba req-c1ce659e-e10d-43a2-a9f6-55288b017e22 service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Received unexpected event network-vif-plugged-80b71c76-357d-449c-8c5c-a1b28b1e6756 for instance with vm_state building and task_state spawning.
Nov 08 04:14:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:19 user nova-compute[75014]: DEBUG nova.compute.manager [req-cbb8021c-7f32-4211-b429-d8d9ccc19de9 req-ba487ecb-43b8-4c37-be6f-fc652e165f8e service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Received event network-vif-plugged-80b71c76-357d-449c-8c5c-a1b28b1e6756 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:14:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-cbb8021c-7f32-4211-b429-d8d9ccc19de9 req-ba487ecb-43b8-4c37-be6f-fc652e165f8e service nova] Acquiring lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:14:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-cbb8021c-7f32-4211-b429-d8d9ccc19de9 req-ba487ecb-43b8-4c37-be6f-fc652e165f8e service nova] Lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:14:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-cbb8021c-7f32-4211-b429-d8d9ccc19de9 req-ba487ecb-43b8-4c37-be6f-fc652e165f8e service nova] Lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:14:19 user nova-compute[75014]: DEBUG nova.compute.manager [req-cbb8021c-7f32-4211-b429-d8d9ccc19de9 req-ba487ecb-43b8-4c37-be6f-fc652e165f8e service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] No waiting events found dispatching network-vif-plugged-80b71c76-357d-449c-8c5c-a1b28b1e6756 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:14:19 user nova-compute[75014]: WARNING nova.compute.manager [req-cbb8021c-7f32-4211-b429-d8d9ccc19de9 req-ba487ecb-43b8-4c37-be6f-fc652e165f8e service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Received unexpected event network-vif-plugged-80b71c76-357d-449c-8c5c-a1b28b1e6756 for instance with vm_state building and task_state spawning.
Nov 08 04:14:19 user nova-compute[75014]: DEBUG nova.compute.manager [req-cbb8021c-7f32-4211-b429-d8d9ccc19de9 req-ba487ecb-43b8-4c37-be6f-fc652e165f8e service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Received event network-vif-plugged-0fe677fa-7bc0-4ab0-abe1-4078284cb71a {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:14:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-cbb8021c-7f32-4211-b429-d8d9ccc19de9 req-ba487ecb-43b8-4c37-be6f-fc652e165f8e service nova] Acquiring lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:14:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-cbb8021c-7f32-4211-b429-d8d9ccc19de9 req-ba487ecb-43b8-4c37-be6f-fc652e165f8e service nova] Lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:14:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-cbb8021c-7f32-4211-b429-d8d9ccc19de9 req-ba487ecb-43b8-4c37-be6f-fc652e165f8e service nova] Lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:14:19 user nova-compute[75014]: DEBUG nova.compute.manager [req-cbb8021c-7f32-4211-b429-d8d9ccc19de9 req-ba487ecb-43b8-4c37-be6f-fc652e165f8e service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] No waiting events found dispatching network-vif-plugged-0fe677fa-7bc0-4ab0-abe1-4078284cb71a {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:14:19 user nova-compute[75014]: WARNING nova.compute.manager [req-cbb8021c-7f32-4211-b429-d8d9ccc19de9 req-ba487ecb-43b8-4c37-be6f-fc652e165f8e service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Received unexpected event network-vif-plugged-0fe677fa-7bc0-4ab0-abe1-4078284cb71a for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 04:14:19 user nova-compute[75014]: DEBUG nova.compute.manager [req-cbb8021c-7f32-4211-b429-d8d9ccc19de9 req-ba487ecb-43b8-4c37-be6f-fc652e165f8e service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Received event network-vif-plugged-0fe677fa-7bc0-4ab0-abe1-4078284cb71a {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:14:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-cbb8021c-7f32-4211-b429-d8d9ccc19de9 req-ba487ecb-43b8-4c37-be6f-fc652e165f8e service nova] Acquiring lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:14:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-cbb8021c-7f32-4211-b429-d8d9ccc19de9 req-ba487ecb-43b8-4c37-be6f-fc652e165f8e service nova] Lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:14:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-cbb8021c-7f32-4211-b429-d8d9ccc19de9 req-ba487ecb-43b8-4c37-be6f-fc652e165f8e service nova] Lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:14:19 user nova-compute[75014]: DEBUG nova.compute.manager [req-cbb8021c-7f32-4211-b429-d8d9ccc19de9 req-ba487ecb-43b8-4c37-be6f-fc652e165f8e service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] No waiting events found dispatching network-vif-plugged-0fe677fa-7bc0-4ab0-abe1-4078284cb71a {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:14:19 user nova-compute[75014]: WARNING nova.compute.manager [req-cbb8021c-7f32-4211-b429-d8d9ccc19de9 req-ba487ecb-43b8-4c37-be6f-fc652e165f8e service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Received unexpected event network-vif-plugged-0fe677fa-7bc0-4ab0-abe1-4078284cb71a for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 04:14:20 user nova-compute[75014]: DEBUG nova.compute.manager [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:14:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 04:14:20 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Instance spawned successfully.
Nov 08 04:14:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 04:14:21 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:14:21 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:14:21 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:14:21 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:14:21 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:14:21 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:14:21 user nova-compute[75014]: INFO nova.compute.manager [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Took 6.78 seconds to spawn the instance on the hypervisor.
Nov 08 04:14:21 user nova-compute[75014]: DEBUG nova.compute.manager [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:14:21 user nova-compute[75014]: INFO nova.compute.manager [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Took 53.80 seconds to build instance.
Nov 08 04:14:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-81b04d9a-330b-4fc5-8d58-ff826983a8c6 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 53.985s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:14:21 user nova-compute[75014]: DEBUG nova.compute.manager [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:14:21 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 04:14:21 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Instance spawned successfully.
Nov 08 04:14:21 user nova-compute[75014]: DEBUG nova.compute.manager [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:14:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ce3f8504-5c36-4819-8e88-0bec1f24184c tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 54.616s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:14:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Acquiring lock "c0e5ed96-313f-41ce-92ac-904b64ce2b3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:14:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lock "c0e5ed96-313f-41ce-92ac-904b64ce2b3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:14:24 user nova-compute[75014]: DEBUG nova.compute.manager [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 04:14:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:14:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:14:24 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 04:14:24 user nova-compute[75014]: INFO nova.compute.claims [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Claim successful on node user
Nov 08 04:14:24 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:14:24 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:14:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:14:24 user nova-compute[75014]: DEBUG nova.compute.manager [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 04:14:25 user nova-compute[75014]: DEBUG nova.compute.manager [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 04:14:25 user nova-compute[75014]: DEBUG nova.network.neutron [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 04:14:25 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 04:14:25 user nova-compute[75014]: DEBUG nova.compute.manager [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 04:14:25 user nova-compute[75014]: DEBUG nova.policy [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41f64f5dd3754997a7a4d2fc193748a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769c7ba95ad41339b55e9baab80af07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 04:14:25 user nova-compute[75014]: DEBUG nova.compute.manager [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 04:14:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 04:14:25 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Creating image(s)
Nov 08 04:14:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Acquiring lock "/opt/stack/data/nova/instances/c0e5ed96-313f-41ce-92ac-904b64ce2b3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:14:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lock "/opt/stack/data/nova/instances/c0e5ed96-313f-41ce-92ac-904b64ce2b3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:14:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lock "/opt/stack/data/nova/instances/c0e5ed96-313f-41ce-92ac-904b64ce2b3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:14:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.262s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:14:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:14:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.259s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/c0e5ed96-313f-41ce-92ac-904b64ce2b3e/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/c0e5ed96-313f-41ce-92ac-904b64ce2b3e/disk 1073741824" returned: 0 in 0.082s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.353s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:14:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:26 user nova-compute[75014]: DEBUG nova.network.neutron [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Successfully created port: cca91a10-8d17-4dcc-978d-259d5adcb160 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 04:14:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.255s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:26 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c0e5ed96-313f-41ce-92ac-904b64ce2b3e/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 04:14:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e5ed96-313f-41ce-92ac-904b64ce2b3e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e5ed96-313f-41ce-92ac-904b64ce2b3e/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:26 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Cannot resize image /opt/stack/data/nova/instances/c0e5ed96-313f-41ce-92ac-904b64ce2b3e/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 04:14:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 04:14:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Ensure instance console log exists: /opt/stack/data/nova/instances/c0e5ed96-313f-41ce-92ac-904b64ce2b3e/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:14:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:14:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:14:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG nova.network.neutron [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Successfully updated port: cca91a10-8d17-4dcc-978d-259d5adcb160 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG nova.compute.manager [req-0fffbee7-5973-43c0-a097-62261207e4ac req-0be3bb71-8038-48c8-b8f2-82b700f41e3e service nova] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Received event network-changed-cca91a10-8d17-4dcc-978d-259d5adcb160 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG nova.compute.manager [req-0fffbee7-5973-43c0-a097-62261207e4ac req-0be3bb71-8038-48c8-b8f2-82b700f41e3e service nova] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Refreshing instance network info cache due to event network-changed-cca91a10-8d17-4dcc-978d-259d5adcb160. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0fffbee7-5973-43c0-a097-62261207e4ac req-0be3bb71-8038-48c8-b8f2-82b700f41e3e service nova] Acquiring lock "refresh_cache-c0e5ed96-313f-41ce-92ac-904b64ce2b3e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0fffbee7-5973-43c0-a097-62261207e4ac req-0be3bb71-8038-48c8-b8f2-82b700f41e3e service nova] Acquired lock "refresh_cache-c0e5ed96-313f-41ce-92ac-904b64ce2b3e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG nova.network.neutron [req-0fffbee7-5973-43c0-a097-62261207e4ac req-0be3bb71-8038-48c8-b8f2-82b700f41e3e service nova] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Refreshing network info cache for port cca91a10-8d17-4dcc-978d-259d5adcb160 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Acquiring lock "refresh_cache-c0e5ed96-313f-41ce-92ac-904b64ce2b3e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG nova.network.neutron [req-0fffbee7-5973-43c0-a097-62261207e4ac req-0be3bb71-8038-48c8-b8f2-82b700f41e3e service nova] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG nova.network.neutron [req-0fffbee7-5973-43c0-a097-62261207e4ac req-0be3bb71-8038-48c8-b8f2-82b700f41e3e service nova] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0fffbee7-5973-43c0-a097-62261207e4ac req-0be3bb71-8038-48c8-b8f2-82b700f41e3e service nova] Releasing lock "refresh_cache-c0e5ed96-313f-41ce-92ac-904b64ce2b3e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Acquired lock "refresh_cache-c0e5ed96-313f-41ce-92ac-904b64ce2b3e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG nova.network.neutron [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG nova.network.neutron [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG nova.network.neutron [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Updating instance_info_cache with network_info: [{"id": "cca91a10-8d17-4dcc-978d-259d5adcb160", "address": "fa:16:3e:27:67:e5", "network": {"id": "a47305e7-0cb6-456a-bcde-ab03a8ea643e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-429065517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c769c7ba95ad41339b55e9baab80af07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca91a10-8d", "ovs_interfaceid": "cca91a10-8d17-4dcc-978d-259d5adcb160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Releasing lock "refresh_cache-c0e5ed96-313f-41ce-92ac-904b64ce2b3e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG nova.compute.manager [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Instance network_info: |[{"id": "cca91a10-8d17-4dcc-978d-259d5adcb160", "address": "fa:16:3e:27:67:e5", "network": {"id": "a47305e7-0cb6-456a-bcde-ab03a8ea643e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-429065517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c769c7ba95ad41339b55e9baab80af07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca91a10-8d", "ovs_interfaceid": "cca91a10-8d17-4dcc-978d-259d5adcb160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Start _get_guest_xml network_info=[{"id": "cca91a10-8d17-4dcc-978d-259d5adcb160", "address": "fa:16:3e:27:67:e5", "network": {"id": "a47305e7-0cb6-456a-bcde-ab03a8ea643e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-429065517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c769c7ba95ad41339b55e9baab80af07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca91a10-8d", "ovs_interfaceid": "cca91a10-8d17-4dcc-978d-259d5adcb160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:14:27 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:14:27 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:14:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:14:27 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:14:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:14:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1605100981',display_name='tempest-ServersNegativeTestJSON-server-1605100981',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1605100981',id=41,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c769c7ba95ad41339b55e9baab80af07',ramdisk_id='',reservation_id='r-tltwjwzl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1651832936',owner_user_name='tempest-ServersNegativeTestJSON-1651832936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:14:25Z,user_data=None,user_id='41f64f5dd3754997a7a4d2fc193748a2',uuid=c0e5ed96-313f-41ce-92ac-904b64ce2b3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cca91a10-8d17-4dcc-978d-259d5adcb160", "address": "fa:16:3e:27:67:e5", "network": {"id": "a47305e7-0cb6-456a-bcde-ab03a8ea643e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-429065517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c769c7ba95ad41339b55e9baab80af07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca91a10-8d", "ovs_interfaceid": "cca91a10-8d17-4dcc-978d-259d5adcb160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:14:28 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Converting VIF {"id": "cca91a10-8d17-4dcc-978d-259d5adcb160", "address": "fa:16:3e:27:67:e5", "network": {"id": "a47305e7-0cb6-456a-bcde-ab03a8ea643e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-429065517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c769c7ba95ad41339b55e9baab80af07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca91a10-8d", "ovs_interfaceid": "cca91a10-8d17-4dcc-978d-259d5adcb160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:14:28 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:67:e5,bridge_name='br-int',has_traffic_filtering=True,id=cca91a10-8d17-4dcc-978d-259d5adcb160,network=Network(a47305e7-0cb6-456a-bcde-ab03a8ea643e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcca91a10-8d') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:14:28 user nova-compute[75014]: DEBUG nova.objects.instance [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lazy-loading 'pci_devices' on Instance uuid c0e5ed96-313f-41ce-92ac-904b64ce2b3e {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:14:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:14:28 user nova-compute[75014]:   <uuid>c0e5ed96-313f-41ce-92ac-904b64ce2b3e</uuid>
Nov 08 04:14:28 user nova-compute[75014]:   <name>instance-00000029</name>
Nov 08 04:14:28 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:14:28 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:14:28 user nova-compute[75014]:   <metadata>
Nov 08 04:14:28 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:14:28 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:14:28 user nova-compute[75014]:       <nova:name>tempest-ServersNegativeTestJSON-server-1605100981</nova:name>
Nov 08 04:14:28 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:14:27</nova:creationTime>
Nov 08 04:14:28 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:14:28 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:14:28 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:14:28 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:14:28 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:14:28 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:14:28 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:14:28 user nova-compute[75014]:       <nova:owner>
Nov 08 04:14:28 user nova-compute[75014]:         <nova:user uuid="41f64f5dd3754997a7a4d2fc193748a2">tempest-ServersNegativeTestJSON-1651832936-project-member</nova:user>
Nov 08 04:14:28 user nova-compute[75014]:         <nova:project uuid="c769c7ba95ad41339b55e9baab80af07">tempest-ServersNegativeTestJSON-1651832936</nova:project>
Nov 08 04:14:28 user nova-compute[75014]:       </nova:owner>
Nov 08 04:14:28 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:14:28 user nova-compute[75014]:       <nova:ports>
Nov 08 04:14:28 user nova-compute[75014]:         <nova:port uuid="cca91a10-8d17-4dcc-978d-259d5adcb160">
Nov 08 04:14:28 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 04:14:28 user nova-compute[75014]:         </nova:port>
Nov 08 04:14:28 user nova-compute[75014]:       </nova:ports>
Nov 08 04:14:28 user nova-compute[75014]:     </nova:instance>
Nov 08 04:14:28 user nova-compute[75014]:   </metadata>
Nov 08 04:14:28 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:14:28 user nova-compute[75014]:     <system>
Nov 08 04:14:28 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:14:28 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:14:28 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:14:28 user nova-compute[75014]:       <entry name="serial">c0e5ed96-313f-41ce-92ac-904b64ce2b3e</entry>
Nov 08 04:14:28 user nova-compute[75014]:       <entry name="uuid">c0e5ed96-313f-41ce-92ac-904b64ce2b3e</entry>
Nov 08 04:14:28 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:14:28 user nova-compute[75014]:     </system>
Nov 08 04:14:28 user nova-compute[75014]:   </sysinfo>
Nov 08 04:14:28 user nova-compute[75014]:   <os>
Nov 08 04:14:28 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:14:28 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:14:28 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:14:28 user nova-compute[75014]:   </os>
Nov 08 04:14:28 user nova-compute[75014]:   <features>
Nov 08 04:14:28 user nova-compute[75014]:     <acpi/>
Nov 08 04:14:28 user nova-compute[75014]:     <apic/>
Nov 08 04:14:28 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:14:28 user nova-compute[75014]:   </features>
Nov 08 04:14:28 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:14:28 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:14:28 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:14:28 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:14:28 user nova-compute[75014]:   </clock>
Nov 08 04:14:28 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:14:28 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:14:28 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:14:28 user nova-compute[75014]:   </cpu>
Nov 08 04:14:28 user nova-compute[75014]:   <devices>
Nov 08 04:14:28 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 04:14:28 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 04:14:28 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/c0e5ed96-313f-41ce-92ac-904b64ce2b3e/disk"/>
Nov 08 04:14:28 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:14:28 user nova-compute[75014]:     </disk>
Nov 08 04:14:28 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:14:28 user nova-compute[75014]:       <mac address="fa:16:3e:27:67:e5"/>
Nov 08 04:14:28 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:14:28 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:14:28 user nova-compute[75014]:       <target dev="tapcca91a10-8d"/>
Nov 08 04:14:28 user nova-compute[75014]:     </interface>
Nov 08 04:14:28 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:14:28 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/c0e5ed96-313f-41ce-92ac-904b64ce2b3e/console.log" append="off"/>
Nov 08 04:14:28 user nova-compute[75014]:     </serial>
Nov 08 04:14:28 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:14:28 user nova-compute[75014]:     <video>
Nov 08 04:14:28 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:14:28 user nova-compute[75014]:     </video>
Nov 08 04:14:28 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:14:28 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:14:28 user nova-compute[75014]:     </rng>
Nov 08 04:14:28 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:14:28 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:14:28 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:14:28 user nova-compute[75014]:     </memballoon>
Nov 08 04:14:28 user nova-compute[75014]:   </devices>
Nov 08 04:14:28 user nova-compute[75014]: </domain>
Nov 08 04:14:28 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:14:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:14:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1605100981',display_name='tempest-ServersNegativeTestJSON-server-1605100981',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1605100981',id=41,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c769c7ba95ad41339b55e9baab80af07',ramdisk_id='',reservation_id='r-tltwjwzl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1651832936',owner_user_name='tempest-ServersNegativeTestJSON-1651832936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:14:25Z,user_data=None,user_id='41f64f5dd3754997a7a4d2fc193748a2',uuid=c0e5ed96-313f-41ce-92ac-904b64ce2b3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cca91a10-8d17-4dcc-978d-259d5adcb160", "address": "fa:16:3e:27:67:e5", "network": {"id": "a47305e7-0cb6-456a-bcde-ab03a8ea643e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-429065517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c769c7ba95ad41339b55e9baab80af07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca91a10-8d", "ovs_interfaceid": "cca91a10-8d17-4dcc-978d-259d5adcb160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:14:28 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Converting VIF {"id": "cca91a10-8d17-4dcc-978d-259d5adcb160", "address": "fa:16:3e:27:67:e5", "network": {"id": "a47305e7-0cb6-456a-bcde-ab03a8ea643e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-429065517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c769c7ba95ad41339b55e9baab80af07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca91a10-8d", "ovs_interfaceid": "cca91a10-8d17-4dcc-978d-259d5adcb160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:14:28 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:67:e5,bridge_name='br-int',has_traffic_filtering=True,id=cca91a10-8d17-4dcc-978d-259d5adcb160,network=Network(a47305e7-0cb6-456a-bcde-ab03a8ea643e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcca91a10-8d') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:14:28 user nova-compute[75014]: DEBUG os_vif [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:67:e5,bridge_name='br-int',has_traffic_filtering=True,id=cca91a10-8d17-4dcc-978d-259d5adcb160,network=Network(a47305e7-0cb6-456a-bcde-ab03a8ea643e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcca91a10-8d') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:14:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:14:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:14:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f69854a-0d1c-55fd-b5c5-8e18cb50b2c2', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:14:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:14:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcca91a10-8d, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:14:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcca91a10-8d, col_values=(('qos', UUID('e55ec6d7-2e7e-4235-a9ee-ac38af492c86')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:14:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcca91a10-8d, col_values=(('external_ids', {'iface-id': 'cca91a10-8d17-4dcc-978d-259d5adcb160', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:67:e5', 'vm-uuid': 'c0e5ed96-313f-41ce-92ac-904b64ce2b3e'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:14:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:14:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:28 user nova-compute[75014]: INFO os_vif [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:67:e5,bridge_name='br-int',has_traffic_filtering=True,id=cca91a10-8d17-4dcc-978d-259d5adcb160,network=Network(a47305e7-0cb6-456a-bcde-ab03a8ea643e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcca91a10-8d')
Nov 08 04:14:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:14:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] No VIF found with MAC fa:16:3e:27:67:e5, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:14:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:29 user nova-compute[75014]: DEBUG nova.compute.manager [req-8a4a4132-84dc-4d62-bf29-397aeb2223f7 req-554c381a-c0cf-409f-a66b-43107ed3b951 service nova] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Received event network-vif-plugged-cca91a10-8d17-4dcc-978d-259d5adcb160 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:14:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8a4a4132-84dc-4d62-bf29-397aeb2223f7 req-554c381a-c0cf-409f-a66b-43107ed3b951 service nova] Acquiring lock "c0e5ed96-313f-41ce-92ac-904b64ce2b3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:14:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8a4a4132-84dc-4d62-bf29-397aeb2223f7 req-554c381a-c0cf-409f-a66b-43107ed3b951 service nova] Lock "c0e5ed96-313f-41ce-92ac-904b64ce2b3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:14:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8a4a4132-84dc-4d62-bf29-397aeb2223f7 req-554c381a-c0cf-409f-a66b-43107ed3b951 service nova] Lock "c0e5ed96-313f-41ce-92ac-904b64ce2b3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:14:29 user nova-compute[75014]: DEBUG nova.compute.manager [req-8a4a4132-84dc-4d62-bf29-397aeb2223f7 req-554c381a-c0cf-409f-a66b-43107ed3b951 service nova] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] No waiting events found dispatching network-vif-plugged-cca91a10-8d17-4dcc-978d-259d5adcb160 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:14:29 user nova-compute[75014]: WARNING nova.compute.manager [req-8a4a4132-84dc-4d62-bf29-397aeb2223f7 req-554c381a-c0cf-409f-a66b-43107ed3b951 service nova] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Received unexpected event network-vif-plugged-cca91a10-8d17-4dcc-978d-259d5adcb160 for instance with vm_state building and task_state spawning.
Nov 08 04:14:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:32 user nova-compute[75014]: DEBUG nova.compute.manager [req-56a98b7e-cba7-4f74-be83-468b02ba5718 req-43092ddb-259b-4664-a0e9-aa91c1ebd0ad service nova] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Received event network-vif-plugged-cca91a10-8d17-4dcc-978d-259d5adcb160 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:14:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-56a98b7e-cba7-4f74-be83-468b02ba5718 req-43092ddb-259b-4664-a0e9-aa91c1ebd0ad service nova] Acquiring lock "c0e5ed96-313f-41ce-92ac-904b64ce2b3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:14:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-56a98b7e-cba7-4f74-be83-468b02ba5718 req-43092ddb-259b-4664-a0e9-aa91c1ebd0ad service nova] Lock "c0e5ed96-313f-41ce-92ac-904b64ce2b3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:14:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-56a98b7e-cba7-4f74-be83-468b02ba5718 req-43092ddb-259b-4664-a0e9-aa91c1ebd0ad service nova] Lock "c0e5ed96-313f-41ce-92ac-904b64ce2b3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:14:32 user nova-compute[75014]: DEBUG nova.compute.manager [req-56a98b7e-cba7-4f74-be83-468b02ba5718 req-43092ddb-259b-4664-a0e9-aa91c1ebd0ad service nova] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] No waiting events found dispatching network-vif-plugged-cca91a10-8d17-4dcc-978d-259d5adcb160 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:14:32 user nova-compute[75014]: WARNING nova.compute.manager [req-56a98b7e-cba7-4f74-be83-468b02ba5718 req-43092ddb-259b-4664-a0e9-aa91c1ebd0ad service nova] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Received unexpected event network-vif-plugged-cca91a10-8d17-4dcc-978d-259d5adcb160 for instance with vm_state building and task_state spawning.
Nov 08 04:14:32 user nova-compute[75014]: DEBUG nova.compute.manager [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:14:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 04:14:32 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Instance spawned successfully.
Nov 08 04:14:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 04:14:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:14:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:14:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:14:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:14:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:14:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:14:32 user nova-compute[75014]: INFO nova.compute.manager [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Took 7.08 seconds to spawn the instance on the hypervisor.
Nov 08 04:14:32 user nova-compute[75014]: DEBUG nova.compute.manager [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:14:32 user nova-compute[75014]: INFO nova.compute.manager [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Took 8.04 seconds to build instance.
Nov 08 04:14:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-962c6a99-76b4-4d0b-9d69-9d2913f3f52f tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lock "c0e5ed96-313f-41ce-92ac-904b64ce2b3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.181s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:14:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d5c296e7-c7a0-48bc-97bc-5a074fdae21b tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "781932ce-0bea-466f-95e0-066130d6c410" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:14:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d5c296e7-c7a0-48bc-97bc-5a074fdae21b tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "781932ce-0bea-466f-95e0-066130d6c410" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:14:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d5c296e7-c7a0-48bc-97bc-5a074fdae21b tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "781932ce-0bea-466f-95e0-066130d6c410-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:14:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d5c296e7-c7a0-48bc-97bc-5a074fdae21b tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "781932ce-0bea-466f-95e0-066130d6c410-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:14:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d5c296e7-c7a0-48bc-97bc-5a074fdae21b tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "781932ce-0bea-466f-95e0-066130d6c410-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:14:35 user nova-compute[75014]: INFO nova.compute.manager [None req-d5c296e7-c7a0-48bc-97bc-5a074fdae21b tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Terminating instance
Nov 08 04:14:35 user nova-compute[75014]: DEBUG nova.compute.manager [None req-d5c296e7-c7a0-48bc-97bc-5a074fdae21b tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:14:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:35 user nova-compute[75014]: DEBUG nova.compute.manager [req-1f2a431b-0895-44d2-827a-6763ac8b56cc req-21f73410-705f-4987-abb2-372de664d9ae service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Received event network-vif-unplugged-5b680c90-914d-4583-a698-dccacaff9987 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:14:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1f2a431b-0895-44d2-827a-6763ac8b56cc req-21f73410-705f-4987-abb2-372de664d9ae service nova] Acquiring lock "781932ce-0bea-466f-95e0-066130d6c410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:14:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1f2a431b-0895-44d2-827a-6763ac8b56cc req-21f73410-705f-4987-abb2-372de664d9ae service nova] Lock "781932ce-0bea-466f-95e0-066130d6c410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:14:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1f2a431b-0895-44d2-827a-6763ac8b56cc req-21f73410-705f-4987-abb2-372de664d9ae service nova] Lock "781932ce-0bea-466f-95e0-066130d6c410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:14:35 user nova-compute[75014]: DEBUG nova.compute.manager [req-1f2a431b-0895-44d2-827a-6763ac8b56cc req-21f73410-705f-4987-abb2-372de664d9ae service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] No waiting events found dispatching network-vif-unplugged-5b680c90-914d-4583-a698-dccacaff9987 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:14:35 user nova-compute[75014]: DEBUG nova.compute.manager [req-1f2a431b-0895-44d2-827a-6763ac8b56cc req-21f73410-705f-4987-abb2-372de664d9ae service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Received event network-vif-unplugged-5b680c90-914d-4583-a698-dccacaff9987 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:14:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:35 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Instance destroyed successfully.
Nov 08 04:14:35 user nova-compute[75014]: DEBUG nova.objects.instance [None req-d5c296e7-c7a0-48bc-97bc-5a074fdae21b tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lazy-loading 'resources' on Instance uuid 781932ce-0bea-466f-95e0-066130d6c410 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:14:35 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-d5c296e7-c7a0-48bc-97bc-5a074fdae21b tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:04:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1668777333',display_name='tempest-AttachVolumeTestJSON-server-1668777333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1668777333',id=30,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6mnajMRsnB5A1jMf0Mqu/aGiRIJo9flQ+tedJW4Ejb4b/2emSY8dSQLEz7A16dKqzr7/OWo32j5VNwQAstah+AeC8v3Pb8Vhpq9T/r/uwJR3q73i8uI1OSr10mvZVNRA==',key_name='tempest-keypair-919667976',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:04:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b61b5c5a54c743f78e97623c26050864',ramdisk_id='',reservation_id='r-k47t6zf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1095291946',owner_user_name='tempest-AttachVolumeTestJSON-1095291946-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:12:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8794d413cb745f2b855a808c052c8fd',uuid=781932ce-0bea-466f-95e0-066130d6c410,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b680c90-914d-4583-a698-dccacaff9987", "address": "fa:16:3e:48:9a:fe", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b680c90-91", "ovs_interfaceid": "5b680c90-914d-4583-a698-dccacaff9987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:14:35 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-d5c296e7-c7a0-48bc-97bc-5a074fdae21b tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Converting VIF {"id": "5b680c90-914d-4583-a698-dccacaff9987", "address": "fa:16:3e:48:9a:fe", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b680c90-91", "ovs_interfaceid": "5b680c90-914d-4583-a698-dccacaff9987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:14:35 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-d5c296e7-c7a0-48bc-97bc-5a074fdae21b tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:9a:fe,bridge_name='br-int',has_traffic_filtering=True,id=5b680c90-914d-4583-a698-dccacaff9987,network=Network(b7df3975-2e50-4d96-8a34-26abf02bea76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b680c90-91') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:14:35 user nova-compute[75014]: DEBUG os_vif [None req-d5c296e7-c7a0-48bc-97bc-5a074fdae21b tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:9a:fe,bridge_name='br-int',has_traffic_filtering=True,id=5b680c90-914d-4583-a698-dccacaff9987,network=Network(b7df3975-2e50-4d96-8a34-26abf02bea76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b680c90-91') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:14:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b680c90-91, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:14:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:14:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b0894df-f894-40a3-b7eb-b1bbfdfe11d9) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:14:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:35 user nova-compute[75014]: INFO os_vif [None req-d5c296e7-c7a0-48bc-97bc-5a074fdae21b tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:9a:fe,bridge_name='br-int',has_traffic_filtering=True,id=5b680c90-914d-4583-a698-dccacaff9987,network=Network(b7df3975-2e50-4d96-8a34-26abf02bea76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b680c90-91')
Nov 08 04:14:35 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-d5c296e7-c7a0-48bc-97bc-5a074fdae21b tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Deleting instance files /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410_del
Nov 08 04:14:35 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-d5c296e7-c7a0-48bc-97bc-5a074fdae21b tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Deletion of /opt/stack/data/nova/instances/781932ce-0bea-466f-95e0-066130d6c410_del complete
Nov 08 04:14:36 user nova-compute[75014]: INFO nova.compute.manager [None req-d5c296e7-c7a0-48bc-97bc-5a074fdae21b tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 08 04:14:36 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-d5c296e7-c7a0-48bc-97bc-5a074fdae21b tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:14:36 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:14:36 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 781932ce-0bea-466f-95e0-066130d6c410] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:14:37 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:14:37 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Took 1.20 seconds to deallocate network for instance.
Nov 08 04:14:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d5c296e7-c7a0-48bc-97bc-5a074fdae21b tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:14:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d5c296e7-c7a0-48bc-97bc-5a074fdae21b tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:14:37 user nova-compute[75014]: DEBUG nova.compute.manager [req-62985394-430a-4f30-a01f-285176976052 req-8ed0c60a-4e56-4573-aa19-35862e395203 service nova] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Received event network-changed-a4210bed-2f6f-4c2b-ad92-fce0779168f9 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:14:37 user nova-compute[75014]: DEBUG nova.compute.manager [req-62985394-430a-4f30-a01f-285176976052 req-8ed0c60a-4e56-4573-aa19-35862e395203 service nova] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Refreshing instance network info cache due to event network-changed-a4210bed-2f6f-4c2b-ad92-fce0779168f9. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:14:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-62985394-430a-4f30-a01f-285176976052 req-8ed0c60a-4e56-4573-aa19-35862e395203 service nova] Acquiring lock "refresh_cache-01754a6d-8f7b-46ad-b166-defe74eb9dd0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:14:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-62985394-430a-4f30-a01f-285176976052 req-8ed0c60a-4e56-4573-aa19-35862e395203 service nova] Acquired lock "refresh_cache-01754a6d-8f7b-46ad-b166-defe74eb9dd0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:14:37 user nova-compute[75014]: DEBUG nova.network.neutron [req-62985394-430a-4f30-a01f-285176976052 req-8ed0c60a-4e56-4573-aa19-35862e395203 service nova] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Refreshing network info cache for port a4210bed-2f6f-4c2b-ad92-fce0779168f9 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:14:37 user nova-compute[75014]: DEBUG nova.compute.manager [req-7383e1c3-2f6d-47e0-a6ef-7ab9191c6b7b req-b2488e09-7f89-4cd2-a38c-20eae43ad866 service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Received event network-vif-plugged-5b680c90-914d-4583-a698-dccacaff9987 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:14:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-7383e1c3-2f6d-47e0-a6ef-7ab9191c6b7b req-b2488e09-7f89-4cd2-a38c-20eae43ad866 service nova] Acquiring lock "781932ce-0bea-466f-95e0-066130d6c410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:14:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-7383e1c3-2f6d-47e0-a6ef-7ab9191c6b7b req-b2488e09-7f89-4cd2-a38c-20eae43ad866 service nova] Lock "781932ce-0bea-466f-95e0-066130d6c410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:14:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-7383e1c3-2f6d-47e0-a6ef-7ab9191c6b7b req-b2488e09-7f89-4cd2-a38c-20eae43ad866 service nova] Lock "781932ce-0bea-466f-95e0-066130d6c410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:14:37 user nova-compute[75014]: DEBUG nova.compute.manager [req-7383e1c3-2f6d-47e0-a6ef-7ab9191c6b7b req-b2488e09-7f89-4cd2-a38c-20eae43ad866 service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] No waiting events found dispatching network-vif-plugged-5b680c90-914d-4583-a698-dccacaff9987 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:14:37 user nova-compute[75014]: WARNING nova.compute.manager [req-7383e1c3-2f6d-47e0-a6ef-7ab9191c6b7b req-b2488e09-7f89-4cd2-a38c-20eae43ad866 service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Received unexpected event network-vif-plugged-5b680c90-914d-4583-a698-dccacaff9987 for instance with vm_state deleted and task_state None.
Nov 08 04:14:37 user nova-compute[75014]: DEBUG nova.compute.manager [req-7383e1c3-2f6d-47e0-a6ef-7ab9191c6b7b req-b2488e09-7f89-4cd2-a38c-20eae43ad866 service nova] [instance: 781932ce-0bea-466f-95e0-066130d6c410] Received event network-vif-deleted-5b680c90-914d-4583-a698-dccacaff9987 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:14:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:37 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-d5c296e7-c7a0-48bc-97bc-5a074fdae21b tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:14:37 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-d5c296e7-c7a0-48bc-97bc-5a074fdae21b tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:14:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d5c296e7-c7a0-48bc-97bc-5a074fdae21b tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:14:37 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-d5c296e7-c7a0-48bc-97bc-5a074fdae21b tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Deleted allocations for instance 781932ce-0bea-466f-95e0-066130d6c410
Nov 08 04:14:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d5c296e7-c7a0-48bc-97bc-5a074fdae21b tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "781932ce-0bea-466f-95e0-066130d6c410" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.024s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:14:38 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:14:38 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:14:38 user nova-compute[75014]: DEBUG nova.network.neutron [req-62985394-430a-4f30-a01f-285176976052 req-8ed0c60a-4e56-4573-aa19-35862e395203 service nova] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Updated VIF entry in instance network info cache for port a4210bed-2f6f-4c2b-ad92-fce0779168f9. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:14:38 user nova-compute[75014]: DEBUG nova.network.neutron [req-62985394-430a-4f30-a01f-285176976052 req-8ed0c60a-4e56-4573-aa19-35862e395203 service nova] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Updating instance_info_cache with network_info: [{"id": "a4210bed-2f6f-4c2b-ad92-fce0779168f9", "address": "fa:16:3e:23:ba:ba", "network": {"id": "a5c06b2d-3ef9-4f4e-9537-b065082d1a10", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-102893709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a7e7ba2cb0b4038927288ab2157a8eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4210bed-2f", "ovs_interfaceid": "a4210bed-2f6f-4c2b-ad92-fce0779168f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:14:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-62985394-430a-4f30-a01f-285176976052 req-8ed0c60a-4e56-4573-aa19-35862e395203 service nova] Releasing lock "refresh_cache-01754a6d-8f7b-46ad-b166-defe74eb9dd0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:14:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Acquiring lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:14:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:14:39 user nova-compute[75014]: DEBUG nova.objects.instance [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lazy-loading 'flavor' on Instance uuid 01754a6d-8f7b-46ad-b166-defe74eb9dd0 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:14:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:14:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Acquiring lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:14:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:14:39 user nova-compute[75014]: INFO nova.compute.manager [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Attaching volume 05dfb807-9eb5-4100-ad23-30706035cdb3 to /dev/vdb
Nov 08 04:14:40 user nova-compute[75014]: DEBUG os_brick.utils [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:14:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:40 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ea9334-6577-4928-9622-35a82cb65b56]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:14:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:40 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d85c93f-8ddd-473b-b0a6-5e3e4b2a7551]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:14:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:40 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bee5e95-32b9-475a-829a-88e6482b5538]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:14:40 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb395144-c22f-4c9f-9152-f20ea27bbc65]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:14:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:14:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:14:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:14:40 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:14:40 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aac4a49-0015-4adc-83de-908a8d2b6446]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:14:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:14:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:14:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:14:40 user nova-compute[75014]: DEBUG os_brick.utils [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:14:40 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Updating existing volume attachment record: 6c9ceaef-2b5c-45de-9087-6d333af1f74a {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:14:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:41 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:14:42 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:14:42 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:14:42 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Rebuilding the list of instances to heal {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 04:14:42 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-c23c9e00-b782-4530-bb01-a7a167951c1d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:14:42 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-c23c9e00-b782-4530-bb01-a7a167951c1d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:14:42 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 04:14:42 user nova-compute[75014]: DEBUG nova.objects.instance [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lazy-loading 'info_cache' on Instance uuid c23c9e00-b782-4530-bb01-a7a167951c1d {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:14:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:42 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Updating instance_info_cache with network_info: [{"id": "4f3b192f-a567-463a-b120-1b328e11feaa", "address": "fa:16:3e:70:b6:a1", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3b192f-a5", "ovs_interfaceid": "4f3b192f-a567-463a-b120-1b328e11feaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:14:42 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-c23c9e00-b782-4530-bb01-a7a167951c1d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:14:42 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 04:14:42 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:14:44 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:14:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:46 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:14:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:14:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:14:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:14:46 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:14:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:14:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:14:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e5ed96-313f-41ce-92ac-904b64ce2b3e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e5ed96-313f-41ce-92ac-904b64ce2b3e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e5ed96-313f-41ce-92ac-904b64ce2b3e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e5ed96-313f-41ce-92ac-904b64ce2b3e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351d7017-81d2-42bd-8d9c-eb820657bb85/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351d7017-81d2-42bd-8d9c-eb820657bb85/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351d7017-81d2-42bd-8d9c-eb820657bb85/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351d7017-81d2-42bd-8d9c-eb820657bb85/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:14:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:14:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:14:48 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:14:48 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:14:48 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=7810MB free_disk=24.978511810302734GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:14:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:14:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:14:49 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance c23c9e00-b782-4530-bb01-a7a167951c1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:14:49 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 351d7017-81d2-42bd-8d9c-eb820657bb85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:14:49 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 077303d8-0afd-4c60-ad9a-1bd29bff4d2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:14:49 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 01754a6d-8f7b-46ad-b166-defe74eb9dd0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:14:49 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance ace7e2f7-28c3-41e3-b92b-05e834c3968c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:14:49 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:14:49 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance c0e5ed96-313f-41ce-92ac-904b64ce2b3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:14:49 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:14:49 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:14:49 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:14:49 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:14:49 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:14:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.431s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:14:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:52 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:14:52 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:14:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:53 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:14:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:14:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquiring lock "351d7017-81d2-42bd-8d9c-eb820657bb85" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:15:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "351d7017-81d2-42bd-8d9c-eb820657bb85" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:15:08 user nova-compute[75014]: INFO nova.compute.manager [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Detaching volume b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474
Nov 08 04:15:08 user nova-compute[75014]: INFO nova.virt.block_device [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Attempting to driver detach volume b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 from mountpoint /dev/vdb
Nov 08 04:15:08 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Attempting to detach device vdb from instance 351d7017-81d2-42bd-8d9c-eb820657bb85 from the persistent domain config. {{(pid=75014) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 04:15:08 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:15:08 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:15:08 user nova-compute[75014]:   <source dev="/dev/sdb"/>
Nov 08 04:15:08 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:15:08 user nova-compute[75014]:   <serial>b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474</serial>
Nov 08 04:15:08 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:15:08 user nova-compute[75014]: </disk>
Nov 08 04:15:08 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:15:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquiring lock "351d7017-81d2-42bd-8d9c-eb820657bb85" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:15:08 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Successfully detached device vdb from instance 351d7017-81d2-42bd-8d9c-eb820657bb85 from the persistent domain config.
Nov 08 04:15:08 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 351d7017-81d2-42bd-8d9c-eb820657bb85 from the live domain config. {{(pid=75014) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 04:15:08 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:15:08 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:15:08 user nova-compute[75014]:   <source dev="/dev/sdb"/>
Nov 08 04:15:08 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:15:08 user nova-compute[75014]:   <serial>b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474</serial>
Nov 08 04:15:08 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:15:08 user nova-compute[75014]: </disk>
Nov 08 04:15:08 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:15:08 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 351d7017-81d2-42bd-8d9c-eb820657bb85 {{(pid=75014) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 04:15:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bOPUwtjL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:15:18 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:15:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:15:18 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:15:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:15:18 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:15:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[85197ff5-e786-41e2-aace-7e6b3b75d42d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:15:18 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42e0ef4-6e4b-42e5-8883-b5b80a1a6462]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3] added
Nov 08 04:15:18 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61fd579-b137-4e94-b2a5-f53e8158f573]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1186a2-23c0-4c8b-9694-14586c0b6357]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bOPUwtjL {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bOPUwtjL" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[389a2e2e-6eb3-40fc-b499-76ed2aa97786]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bOPUwtjL'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7258bb-7bfb-4196-9829-705e53eec745]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65f7077-a65f-468a-b919-2a3009b6f668]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:15:18 user nova-compute[75014]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 (non-flash)
Nov 08 04:15:18 user nova-compute[75014]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:15:18 user nova-compute[75014]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)
Nov 08 04:15:18 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:15:18 user nova-compute[75014]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 (non-flash)
Nov 08 04:15:18 user nova-compute[75014]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:15:18 user nova-compute[75014]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)
Nov 08 04:15:18 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7f2a70-d8b6-4b0c-9534-d4d227702c6a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3, portal: 172.16.0.220,3260]
Nov 08 04:15:18 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3, portal: 172.16.0.220,3260] successful.
Nov 08 04:15:18 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4233dba9-1aea-405b-a0a7-4c85d172ee74]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[30979d3a-d473-4205-91c1-eabf281015d1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:15:18 user nova-compute[75014]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 (non-flash)
Nov 08 04:15:18 user nova-compute[75014]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:15:18 user nova-compute[75014]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)
Nov 08 04:15:18 user nova-compute[75014]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 (non-flash)
Nov 08 04:15:18 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:15:18 user nova-compute[75014]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 (non-flash)
Nov 08 04:15:18 user nova-compute[75014]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:15:18 user nova-compute[75014]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)
Nov 08 04:15:18 user nova-compute[75014]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 (non-flash)
Nov 08 04:15:18 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:15:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:19 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:19 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7786591c-72ed-4ea1-8071-d62c1d34b968]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:15:19 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: None {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:15:20 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:15:20 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bOPUwtjL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:15:20 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:15:20 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26439383563663339', 'path': '/dev/sde'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:15:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439383563663339', 'path': '/dev/sde'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:15:20 user nova-compute[75014]: DEBUG nova.objects.instance [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lazy-loading 'flavor' on Instance uuid 01754a6d-8f7b-46ad-b166-defe74eb9dd0 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:15:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 04:15:20 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:15:20 user nova-compute[75014]:   <source dev="/dev/sde"/>
Nov 08 04:15:20 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:15:20 user nova-compute[75014]:   <serial>05dfb807-9eb5-4100-ad23-30706035cdb3</serial>
Nov 08 04:15:20 user nova-compute[75014]: </disk>
Nov 08 04:15:20 user nova-compute[75014]:  {{(pid=75014) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 04:15:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:15:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:15:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] No VIF found with MAC fa:16:3e:23:ba:ba, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:15:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-065e59bb-0b54-452f-b6e8-ccfea2595dc8 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 40.680s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:15:20 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-38448936-6804-4312-ac3d-ea7fa9ff95ae tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Acquiring lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:15:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-38448936-6804-4312-ac3d-ea7fa9ff95ae tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:15:24 user nova-compute[75014]: DEBUG nova.objects.instance [None req-38448936-6804-4312-ac3d-ea7fa9ff95ae tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lazy-loading 'flavor' on Instance uuid 01754a6d-8f7b-46ad-b166-defe74eb9dd0 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:15:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-38448936-6804-4312-ac3d-ea7fa9ff95ae tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:15:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-38448936-6804-4312-ac3d-ea7fa9ff95ae tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Acquiring lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:15:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-38448936-6804-4312-ac3d-ea7fa9ff95ae tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:15:25 user nova-compute[75014]: INFO nova.compute.manager [None req-38448936-6804-4312-ac3d-ea7fa9ff95ae tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Attaching volume a59c8b3a-9ec7-4740-9490-a7830f3ce405 to /dev/vdc
Nov 08 04:15:25 user nova-compute[75014]: DEBUG os_brick.utils [None req-38448936-6804-4312-ac3d-ea7fa9ff95ae tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:15:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e411a4-219c-4099-b062-a063ee7224e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:15:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82c0b4f-4188-4f7e-bee2-0906e9ed9eba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:15:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b1182a-4f1b-47a8-9c28-df628392334f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:15:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[84eea07a-bd8f-48d6-abe2-174fcd29e5a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:15:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-38448936-6804-4312-ac3d-ea7fa9ff95ae tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-38448936-6804-4312-ac3d-ea7fa9ff95ae tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:15:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38448936-6804-4312-ac3d-ea7fa9ff95ae tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:15:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:15:25 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:15:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e186d1-13e9-4ad0-8c6a-fb0853f7b868]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:15:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-38448936-6804-4312-ac3d-ea7fa9ff95ae tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:15:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-38448936-6804-4312-ac3d-ea7fa9ff95ae tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:15:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-38448936-6804-4312-ac3d-ea7fa9ff95ae tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:15:25 user nova-compute[75014]: DEBUG os_brick.utils [None req-38448936-6804-4312-ac3d-ea7fa9ff95ae tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] <== get_connector_properties: return (334ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:15:25 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-38448936-6804-4312-ac3d-ea7fa9ff95ae tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Updating existing volume attachment record: b77f2077-e70f-423a-bc09-5f8e327d6329 {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:15:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:15:28 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 351d7017-81d2-42bd-8d9c-eb820657bb85 is timed out.
Nov 08 04:15:28 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Successfully detached device vdb from instance 351d7017-81d2-42bd-8d9c-eb820657bb85 from the live domain config.
Nov 08 04:15:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKykrPvN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:15:28 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:15:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a969a9-ab4b-4c0a-aaab-6167e97f9a13]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:15:28 user nova-compute[75014]: No targets found.
Nov 08 04:15:28 user nova-compute[75014]: iSNS:
Nov 08 04:15:28 user nova-compute[75014]: No targets found.
Nov 08 04:15:28 user nova-compute[75014]: STATIC:
Nov 08 04:15:28 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474
Nov 08 04:15:28 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:15:28 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:15:28 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:15:28 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:15:28 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:15:28 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3
Nov 08 04:15:28 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:15:28 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:15:28 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437
Nov 08 04:15:28 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:15:28 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:15:28 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429
Nov 08 04:15:28 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:15:28 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:15:28 user nova-compute[75014]: FIRMWARE:
Nov 08 04:15:28 user nova-compute[75014]: No targets found.
Nov 08 04:15:28 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:15:28 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:15:28 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf34cb47-f546-4458-9535-ed62ff93761d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc9cca7-ebb6-4466-b1ad-61ba3aea4eeb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:15:28 user nova-compute[75014]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 (non-flash)
Nov 08 04:15:28 user nova-compute[75014]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:15:28 user nova-compute[75014]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)
Nov 08 04:15:28 user nova-compute[75014]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 (non-flash)
Nov 08 04:15:28 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:15:28 user nova-compute[75014]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 (non-flash)
Nov 08 04:15:28 user nova-compute[75014]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:15:28 user nova-compute[75014]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)
Nov 08 04:15:28 user nova-compute[75014]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 (non-flash)
Nov 08 04:15:28 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f040025c1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474'): ({'sdb'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Removing single pathed devices sdb {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2f3166-5f82-47c5-a8f1-a1d23bf0d2a3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cc1bf1-c861-4e2d-a666-7e52132a5245]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Flushing IO for device /dev/sdb {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d18c1c-cef2-4b32-b9f5-c72a88835c1f]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e2cda1-d562-4175-880d-5c4636f10a7b]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] SCSI volumes sdb have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:15:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.187s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:29 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f698b7-161a-42ad-8aef-4b88f8171b2d]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:15:29 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:15:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:29 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2878ee0f-16e4-494b-8536-733343bea579]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:15:29 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474, portal: 172.16.0.220,3260]
Nov 08 04:15:29 user nova-compute[75014]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474, portal: 172.16.0.220,3260] successful.
Nov 08 04:15:29 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:15:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:29 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e2762d-02a5-4650-9e8c-4400c6184f47]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:15:29 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:15:29 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.513s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:15:29 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] <== disconnect_volume: return (516ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:15:29 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:15:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:15:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:15:29 user nova-compute[75014]: DEBUG nova.compute.manager [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 04:15:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:15:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:15:29 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 04:15:29 user nova-compute[75014]: INFO nova.compute.claims [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Claim successful on node user
Nov 08 04:15:29 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:15:29 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG nova.compute.manager [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG nova.compute.manager [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG nova.network.neutron [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 04:15:30 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 04:15:30 user nova-compute[75014]: DEBUG nova.compute.manager [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG nova.objects.instance [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lazy-loading 'flavor' on Instance uuid 351d7017-81d2-42bd-8d9c-eb820657bb85 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG nova.policy [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8794d413cb745f2b855a808c052c8fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61b5c5a54c743f78e97623c26050864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-662d682f-3c53-4e51-8c60-d4e89f345df9 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "351d7017-81d2-42bd-8d9c-eb820657bb85" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.157s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "351d7017-81d2-42bd-8d9c-eb820657bb85" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.038s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquiring lock "351d7017-81d2-42bd-8d9c-eb820657bb85-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "351d7017-81d2-42bd-8d9c-eb820657bb85-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "351d7017-81d2-42bd-8d9c-eb820657bb85-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:15:30 user nova-compute[75014]: INFO nova.compute.manager [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Terminating instance
Nov 08 04:15:30 user nova-compute[75014]: DEBUG nova.compute.manager [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG nova.compute.manager [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 04:15:30 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Creating image(s)
Nov 08 04:15:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "/opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "/opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.192s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG nova.compute.manager [req-1c4ed8b9-890f-4ba7-99a8-6bbc3841c5fe req-e0511f4e-77d5-4e46-8dc4-a1ae482630cc service nova] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Received event network-vif-unplugged-ec6ba361-fe2c-42e8-aa9a-5539139889de {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1c4ed8b9-890f-4ba7-99a8-6bbc3841c5fe req-e0511f4e-77d5-4e46-8dc4-a1ae482630cc service nova] Acquiring lock "351d7017-81d2-42bd-8d9c-eb820657bb85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1c4ed8b9-890f-4ba7-99a8-6bbc3841c5fe req-e0511f4e-77d5-4e46-8dc4-a1ae482630cc service nova] Lock "351d7017-81d2-42bd-8d9c-eb820657bb85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1c4ed8b9-890f-4ba7-99a8-6bbc3841c5fe req-e0511f4e-77d5-4e46-8dc4-a1ae482630cc service nova] Lock "351d7017-81d2-42bd-8d9c-eb820657bb85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG nova.compute.manager [req-1c4ed8b9-890f-4ba7-99a8-6bbc3841c5fe req-e0511f4e-77d5-4e46-8dc4-a1ae482630cc service nova] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] No waiting events found dispatching network-vif-unplugged-ec6ba361-fe2c-42e8-aa9a-5539139889de {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG nova.compute.manager [req-1c4ed8b9-890f-4ba7-99a8-6bbc3841c5fe req-e0511f4e-77d5-4e46-8dc4-a1ae482630cc service nova] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Received event network-vif-unplugged-ec6ba361-fe2c-42e8-aa9a-5539139889de for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.189s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947/disk 1073741824" returned: 0 in 0.057s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.186s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 04:15:30 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG nova.network.neutron [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Successfully created port: 244be58f-1901-48ed-9d4e-98cb72cc9758 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:31 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Instance destroyed successfully.
Nov 08 04:15:31 user nova-compute[75014]: DEBUG nova.objects.instance [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lazy-loading 'resources' on Instance uuid 351d7017-81d2-42bd-8d9c-eb820657bb85 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1284933924',display_name='tempest-VolumesSnapshotTestJSON-instance-1284933924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1284933924',id=37,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSa5EchfjoJE8Ph1z0slWigcvKkX3eNIAxFjXMEuVQtMFSl1dl3p7mey3BUJfRUibmFFXHPmf7iwyACPpKRM6S7UMXrtupTM2aqn5xuNcJPRY0QuL/KBr5sz+s728SDJg==',key_name='tempest-keypair-509218668',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:11:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e5003c0e79d42248cd1ff8be29fe3b0',ramdisk_id='',reservation_id='r-duyht1s0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-334487690',owner_user_name='tempest-VolumesSnapshotTestJSON-334487690-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:11:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74a3234564994ff7a7c7fc6166e16aef',uuid=351d7017-81d2-42bd-8d9c-eb820657bb85,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec6ba361-fe2c-42e8-aa9a-5539139889de", "address": "fa:16:3e:8b:46:82", "network": {"id": "25bc77a0-1460-485f-a61a-a43843631782", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-430613931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e5003c0e79d42248cd1ff8be29fe3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec6ba361-fe", "ovs_interfaceid": "ec6ba361-fe2c-42e8-aa9a-5539139889de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Converting VIF {"id": "ec6ba361-fe2c-42e8-aa9a-5539139889de", "address": "fa:16:3e:8b:46:82", "network": {"id": "25bc77a0-1460-485f-a61a-a43843631782", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-430613931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e5003c0e79d42248cd1ff8be29fe3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec6ba361-fe", "ovs_interfaceid": "ec6ba361-fe2c-42e8-aa9a-5539139889de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:46:82,bridge_name='br-int',has_traffic_filtering=True,id=ec6ba361-fe2c-42e8-aa9a-5539139889de,network=Network(25bc77a0-1460-485f-a61a-a43843631782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec6ba361-fe') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG os_vif [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:46:82,bridge_name='br-int',has_traffic_filtering=True,id=ec6ba361-fe2c-42e8-aa9a-5539139889de,network=Network(25bc77a0-1460-485f-a61a-a43843631782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec6ba361-fe') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec6ba361-fe, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=41e36362-a8c5-4345-9948-032b9d77d934) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:15:31 user nova-compute[75014]: INFO os_vif [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:46:82,bridge_name='br-int',has_traffic_filtering=True,id=ec6ba361-fe2c-42e8-aa9a-5539139889de,network=Network(25bc77a0-1460-485f-a61a-a43843631782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec6ba361-fe')
Nov 08 04:15:31 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKykrPvN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:15:31 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:15:31 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Cannot resize image /opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Ensure instance console log exists: /opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf3023a-f0d0-4d3f-8172-39251e47cb1e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:15:31 user nova-compute[75014]: No targets found.
Nov 08 04:15:31 user nova-compute[75014]: iSNS:
Nov 08 04:15:31 user nova-compute[75014]: No targets found.
Nov 08 04:15:31 user nova-compute[75014]: STATIC:
Nov 08 04:15:31 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:15:31 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:15:31 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:15:31 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3
Nov 08 04:15:31 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:15:31 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:15:31 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437
Nov 08 04:15:31 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:15:31 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:15:31 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429
Nov 08 04:15:31 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:15:31 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:15:31 user nova-compute[75014]: FIRMWARE:
Nov 08 04:15:31 user nova-compute[75014]: No targets found.
Nov 08 04:15:31 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:15:31 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:15:31 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6a9ef44-7b56-47e2-9e13-2ca6d3bb4474', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[52525970-94b2-474c-9164-e84c616d3e22]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[819cf343-4933-411b-8bfc-0e73ee194a0c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:15:31 user nova-compute[75014]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:15:31 user nova-compute[75014]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)
Nov 08 04:15:31 user nova-compute[75014]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 (non-flash)
Nov 08 04:15:31 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:15:31 user nova-compute[75014]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:15:31 user nova-compute[75014]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)
Nov 08 04:15:31 user nova-compute[75014]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 (non-flash)
Nov 08 04:15:31 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0418372d40>, {}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Disconnecting from: [] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.095s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] <== disconnect_volume: return (100ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:15:31 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Deleting instance files /opt/stack/data/nova/instances/351d7017-81d2-42bd-8d9c-eb820657bb85_del
Nov 08 04:15:31 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Deletion of /opt/stack/data/nova/instances/351d7017-81d2-42bd-8d9c-eb820657bb85_del complete
Nov 08 04:15:31 user nova-compute[75014]: INFO nova.compute.manager [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 08 04:15:31 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:15:31 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.network.neutron [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Successfully updated port: 244be58f-1901-48ed-9d4e-98cb72cc9758 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "refresh_cache-b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquired lock "refresh_cache-b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.network.neutron [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.compute.manager [req-d4f7d7d3-bcf1-4d00-86f0-749c53b0c704 req-13622e75-b7c0-4c65-88ad-66648bd2186e service nova] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Received event network-changed-244be58f-1901-48ed-9d4e-98cb72cc9758 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.compute.manager [req-d4f7d7d3-bcf1-4d00-86f0-749c53b0c704 req-13622e75-b7c0-4c65-88ad-66648bd2186e service nova] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Refreshing instance network info cache due to event network-changed-244be58f-1901-48ed-9d4e-98cb72cc9758. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d4f7d7d3-bcf1-4d00-86f0-749c53b0c704 req-13622e75-b7c0-4c65-88ad-66648bd2186e service nova] Acquiring lock "refresh_cache-b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.network.neutron [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:15:32 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Took 1.20 seconds to deallocate network for instance.
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.network.neutron [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Updating instance_info_cache with network_info: [{"id": "244be58f-1901-48ed-9d4e-98cb72cc9758", "address": "fa:16:3e:83:ac:1c", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244be58f-19", "ovs_interfaceid": "244be58f-1901-48ed-9d4e-98cb72cc9758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Releasing lock "refresh_cache-b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.compute.manager [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Instance network_info: |[{"id": "244be58f-1901-48ed-9d4e-98cb72cc9758", "address": "fa:16:3e:83:ac:1c", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244be58f-19", "ovs_interfaceid": "244be58f-1901-48ed-9d4e-98cb72cc9758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d4f7d7d3-bcf1-4d00-86f0-749c53b0c704 req-13622e75-b7c0-4c65-88ad-66648bd2186e service nova] Acquired lock "refresh_cache-b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.network.neutron [req-d4f7d7d3-bcf1-4d00-86f0-749c53b0c704 req-13622e75-b7c0-4c65-88ad-66648bd2186e service nova] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Refreshing network info cache for port 244be58f-1901-48ed-9d4e-98cb72cc9758 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Start _get_guest_xml network_info=[{"id": "244be58f-1901-48ed-9d4e-98cb72cc9758", "address": "fa:16:3e:83:ac:1c", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244be58f-19", "ovs_interfaceid": "244be58f-1901-48ed-9d4e-98cb72cc9758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:15:32 user nova-compute[75014]: WARNING nova.volume.cinder [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Attachment 3c142622-370d-4d1e-9705-2867e05abbac does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 3c142622-370d-4d1e-9705-2867e05abbac. (HTTP 404) (Request-ID: req-adec39f3-c3f8-4080-b5f6-9e6693a84821)
Nov 08 04:15:32 user nova-compute[75014]: INFO nova.compute.manager [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Took 0.04 seconds to detach 1 volumes for instance.
Nov 08 04:15:32 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:15:32 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:15:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-724066621',display_name='tempest-AttachVolumeTestJSON-server-724066621',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-724066621',id=42,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3wgCtbUpW/VdaoPM57u8cToy9dzJI0CouJ8uSMHon1XfXqWtmF6mk3yfkMqMQP9g7fl7rnY4xWx/VfQ5ffg5laVdkHpxh/uxIh+yPz6gjf+kHbK70d6sT8DY/KHBa9Vg==',key_name='tempest-keypair-1873922796',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b61b5c5a54c743f78e97623c26050864',ramdisk_id='',reservation_id='r-5s0m3grn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1095291946',owner_user_name='tempest-AttachVolumeTestJSON-1095291946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:15:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8794d413cb745f2b855a808c052c8fd',uuid=b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "244be58f-1901-48ed-9d4e-98cb72cc9758", "address": "fa:16:3e:83:ac:1c", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244be58f-19", "ovs_interfaceid": "244be58f-1901-48ed-9d4e-98cb72cc9758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Converting VIF {"id": "244be58f-1901-48ed-9d4e-98cb72cc9758", "address": "fa:16:3e:83:ac:1c", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244be58f-19", "ovs_interfaceid": "244be58f-1901-48ed-9d4e-98cb72cc9758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=244be58f-1901-48ed-9d4e-98cb72cc9758,network=Network(b7df3975-2e50-4d96-8a34-26abf02bea76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244be58f-19') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.objects.instance [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lazy-loading 'pci_devices' on Instance uuid b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.compute.manager [req-0fa56ba0-626d-4cf1-8580-eb84d5b95326 req-82238309-a489-41dc-95d0-e2ffca1be174 service nova] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Received event network-vif-plugged-ec6ba361-fe2c-42e8-aa9a-5539139889de {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0fa56ba0-626d-4cf1-8580-eb84d5b95326 req-82238309-a489-41dc-95d0-e2ffca1be174 service nova] Acquiring lock "351d7017-81d2-42bd-8d9c-eb820657bb85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0fa56ba0-626d-4cf1-8580-eb84d5b95326 req-82238309-a489-41dc-95d0-e2ffca1be174 service nova] Lock "351d7017-81d2-42bd-8d9c-eb820657bb85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0fa56ba0-626d-4cf1-8580-eb84d5b95326 req-82238309-a489-41dc-95d0-e2ffca1be174 service nova] Lock "351d7017-81d2-42bd-8d9c-eb820657bb85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.compute.manager [req-0fa56ba0-626d-4cf1-8580-eb84d5b95326 req-82238309-a489-41dc-95d0-e2ffca1be174 service nova] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] No waiting events found dispatching network-vif-plugged-ec6ba361-fe2c-42e8-aa9a-5539139889de {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:15:32 user nova-compute[75014]: WARNING nova.compute.manager [req-0fa56ba0-626d-4cf1-8580-eb84d5b95326 req-82238309-a489-41dc-95d0-e2ffca1be174 service nova] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Received unexpected event network-vif-plugged-ec6ba361-fe2c-42e8-aa9a-5539139889de for instance with vm_state active and task_state deleting.
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:15:32 user nova-compute[75014]:   <uuid>b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947</uuid>
Nov 08 04:15:32 user nova-compute[75014]:   <name>instance-0000002a</name>
Nov 08 04:15:32 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:15:32 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:15:32 user nova-compute[75014]:   <metadata>
Nov 08 04:15:32 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:15:32 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:15:32 user nova-compute[75014]:       <nova:name>tempest-AttachVolumeTestJSON-server-724066621</nova:name>
Nov 08 04:15:32 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:15:32</nova:creationTime>
Nov 08 04:15:32 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:15:32 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:15:32 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:15:32 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:15:32 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:15:32 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:15:32 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:15:32 user nova-compute[75014]:       <nova:owner>
Nov 08 04:15:32 user nova-compute[75014]:         <nova:user uuid="f8794d413cb745f2b855a808c052c8fd">tempest-AttachVolumeTestJSON-1095291946-project-member</nova:user>
Nov 08 04:15:32 user nova-compute[75014]:         <nova:project uuid="b61b5c5a54c743f78e97623c26050864">tempest-AttachVolumeTestJSON-1095291946</nova:project>
Nov 08 04:15:32 user nova-compute[75014]:       </nova:owner>
Nov 08 04:15:32 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:15:32 user nova-compute[75014]:       <nova:ports>
Nov 08 04:15:32 user nova-compute[75014]:         <nova:port uuid="244be58f-1901-48ed-9d4e-98cb72cc9758">
Nov 08 04:15:32 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 04:15:32 user nova-compute[75014]:         </nova:port>
Nov 08 04:15:32 user nova-compute[75014]:       </nova:ports>
Nov 08 04:15:32 user nova-compute[75014]:     </nova:instance>
Nov 08 04:15:32 user nova-compute[75014]:   </metadata>
Nov 08 04:15:32 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:15:32 user nova-compute[75014]:     <system>
Nov 08 04:15:32 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:15:32 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:15:32 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:15:32 user nova-compute[75014]:       <entry name="serial">b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947</entry>
Nov 08 04:15:32 user nova-compute[75014]:       <entry name="uuid">b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947</entry>
Nov 08 04:15:32 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:15:32 user nova-compute[75014]:     </system>
Nov 08 04:15:32 user nova-compute[75014]:   </sysinfo>
Nov 08 04:15:32 user nova-compute[75014]:   <os>
Nov 08 04:15:32 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:15:32 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:15:32 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:15:32 user nova-compute[75014]:   </os>
Nov 08 04:15:32 user nova-compute[75014]:   <features>
Nov 08 04:15:32 user nova-compute[75014]:     <acpi/>
Nov 08 04:15:32 user nova-compute[75014]:     <apic/>
Nov 08 04:15:32 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:15:32 user nova-compute[75014]:   </features>
Nov 08 04:15:32 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:15:32 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:15:32 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:15:32 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:15:32 user nova-compute[75014]:   </clock>
Nov 08 04:15:32 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:15:32 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:15:32 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:15:32 user nova-compute[75014]:   </cpu>
Nov 08 04:15:32 user nova-compute[75014]:   <devices>
Nov 08 04:15:32 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 04:15:32 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 04:15:32 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947/disk"/>
Nov 08 04:15:32 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:15:32 user nova-compute[75014]:     </disk>
Nov 08 04:15:32 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:15:32 user nova-compute[75014]:       <mac address="fa:16:3e:83:ac:1c"/>
Nov 08 04:15:32 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:15:32 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:15:32 user nova-compute[75014]:       <target dev="tap244be58f-19"/>
Nov 08 04:15:32 user nova-compute[75014]:     </interface>
Nov 08 04:15:32 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:15:32 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947/console.log" append="off"/>
Nov 08 04:15:32 user nova-compute[75014]:     </serial>
Nov 08 04:15:32 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:15:32 user nova-compute[75014]:     <video>
Nov 08 04:15:32 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:15:32 user nova-compute[75014]:     </video>
Nov 08 04:15:32 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:15:32 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:15:32 user nova-compute[75014]:     </rng>
Nov 08 04:15:32 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:15:32 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:15:32 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:15:32 user nova-compute[75014]:     </memballoon>
Nov 08 04:15:32 user nova-compute[75014]:   </devices>
Nov 08 04:15:32 user nova-compute[75014]: </domain>
Nov 08 04:15:32 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:15:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-724066621',display_name='tempest-AttachVolumeTestJSON-server-724066621',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-724066621',id=42,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3wgCtbUpW/VdaoPM57u8cToy9dzJI0CouJ8uSMHon1XfXqWtmF6mk3yfkMqMQP9g7fl7rnY4xWx/VfQ5ffg5laVdkHpxh/uxIh+yPz6gjf+kHbK70d6sT8DY/KHBa9Vg==',key_name='tempest-keypair-1873922796',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b61b5c5a54c743f78e97623c26050864',ramdisk_id='',reservation_id='r-5s0m3grn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1095291946',owner_user_name='tempest-AttachVolumeTestJSON-1095291946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:15:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8794d413cb745f2b855a808c052c8fd',uuid=b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "244be58f-1901-48ed-9d4e-98cb72cc9758", "address": "fa:16:3e:83:ac:1c", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244be58f-19", "ovs_interfaceid": "244be58f-1901-48ed-9d4e-98cb72cc9758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Converting VIF {"id": "244be58f-1901-48ed-9d4e-98cb72cc9758", "address": "fa:16:3e:83:ac:1c", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244be58f-19", "ovs_interfaceid": "244be58f-1901-48ed-9d4e-98cb72cc9758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=244be58f-1901-48ed-9d4e-98cb72cc9758,network=Network(b7df3975-2e50-4d96-8a34-26abf02bea76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244be58f-19') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG os_vif [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=244be58f-1901-48ed-9d4e-98cb72cc9758,network=Network(b7df3975-2e50-4d96-8a34-26abf02bea76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244be58f-19') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '854506e0-9a58-5c58-8697-d88dbba71515', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap244be58f-19, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap244be58f-19, col_values=(('qos', UUID('8f22a4a5-b672-443d-82b5-b3940892db0e')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap244be58f-19, col_values=(('external_ids', {'iface-id': '244be58f-1901-48ed-9d4e-98cb72cc9758', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:ac:1c', 'vm-uuid': 'b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:32 user nova-compute[75014]: INFO os_vif [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=244be58f-1901-48ed-9d4e-98cb72cc9758,network=Network(b7df3975-2e50-4d96-8a34-26abf02bea76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244be58f-19')
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] No VIF found with MAC fa:16:3e:83:ac:1c, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:15:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:15:33 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Deleted allocations for instance 351d7017-81d2-42bd-8d9c-eb820657bb85
Nov 08 04:15:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9614cfea-c809-488d-82ba-9095761c0875 tempest-VolumesSnapshotTestJSON-334487690 tempest-VolumesSnapshotTestJSON-334487690-project-member] Lock "351d7017-81d2-42bd-8d9c-eb820657bb85" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.828s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:15:33 user nova-compute[75014]: DEBUG nova.network.neutron [req-d4f7d7d3-bcf1-4d00-86f0-749c53b0c704 req-13622e75-b7c0-4c65-88ad-66648bd2186e service nova] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Updated VIF entry in instance network info cache for port 244be58f-1901-48ed-9d4e-98cb72cc9758. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:15:33 user nova-compute[75014]: DEBUG nova.network.neutron [req-d4f7d7d3-bcf1-4d00-86f0-749c53b0c704 req-13622e75-b7c0-4c65-88ad-66648bd2186e service nova] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Updating instance_info_cache with network_info: [{"id": "244be58f-1901-48ed-9d4e-98cb72cc9758", "address": "fa:16:3e:83:ac:1c", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244be58f-19", "ovs_interfaceid": "244be58f-1901-48ed-9d4e-98cb72cc9758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:15:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d4f7d7d3-bcf1-4d00-86f0-749c53b0c704 req-13622e75-b7c0-4c65-88ad-66648bd2186e service nova] Releasing lock "refresh_cache-b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:15:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:34 user nova-compute[75014]: DEBUG nova.compute.manager [req-f7d26cc1-30f5-48a5-81fc-1426ea7bb4ab req-7a3f27d6-5935-4dcd-b393-f0a3c8f7f677 service nova] [instance: 351d7017-81d2-42bd-8d9c-eb820657bb85] Received event network-vif-deleted-ec6ba361-fe2c-42e8-aa9a-5539139889de {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:15:34 user nova-compute[75014]: DEBUG nova.compute.manager [req-dcf592c6-c5aa-4d38-8d4a-4922ff6d0dc5 req-cf0b0b7d-b1f1-41ca-8de8-6bbe4b69657c service nova] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Received event network-vif-plugged-244be58f-1901-48ed-9d4e-98cb72cc9758 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:15:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dcf592c6-c5aa-4d38-8d4a-4922ff6d0dc5 req-cf0b0b7d-b1f1-41ca-8de8-6bbe4b69657c service nova] Acquiring lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:15:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dcf592c6-c5aa-4d38-8d4a-4922ff6d0dc5 req-cf0b0b7d-b1f1-41ca-8de8-6bbe4b69657c service nova] Lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:15:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dcf592c6-c5aa-4d38-8d4a-4922ff6d0dc5 req-cf0b0b7d-b1f1-41ca-8de8-6bbe4b69657c service nova] Lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:15:34 user nova-compute[75014]: DEBUG nova.compute.manager [req-dcf592c6-c5aa-4d38-8d4a-4922ff6d0dc5 req-cf0b0b7d-b1f1-41ca-8de8-6bbe4b69657c service nova] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] No waiting events found dispatching network-vif-plugged-244be58f-1901-48ed-9d4e-98cb72cc9758 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:15:34 user nova-compute[75014]: WARNING nova.compute.manager [req-dcf592c6-c5aa-4d38-8d4a-4922ff6d0dc5 req-cf0b0b7d-b1f1-41ca-8de8-6bbe4b69657c service nova] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Received unexpected event network-vif-plugged-244be58f-1901-48ed-9d4e-98cb72cc9758 for instance with vm_state building and task_state spawning.
Nov 08 04:15:34 user nova-compute[75014]: DEBUG nova.compute.manager [req-dcf592c6-c5aa-4d38-8d4a-4922ff6d0dc5 req-cf0b0b7d-b1f1-41ca-8de8-6bbe4b69657c service nova] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Received event network-vif-plugged-244be58f-1901-48ed-9d4e-98cb72cc9758 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:15:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dcf592c6-c5aa-4d38-8d4a-4922ff6d0dc5 req-cf0b0b7d-b1f1-41ca-8de8-6bbe4b69657c service nova] Acquiring lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:15:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dcf592c6-c5aa-4d38-8d4a-4922ff6d0dc5 req-cf0b0b7d-b1f1-41ca-8de8-6bbe4b69657c service nova] Lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:15:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dcf592c6-c5aa-4d38-8d4a-4922ff6d0dc5 req-cf0b0b7d-b1f1-41ca-8de8-6bbe4b69657c service nova] Lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:15:34 user nova-compute[75014]: DEBUG nova.compute.manager [req-dcf592c6-c5aa-4d38-8d4a-4922ff6d0dc5 req-cf0b0b7d-b1f1-41ca-8de8-6bbe4b69657c service nova] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] No waiting events found dispatching network-vif-plugged-244be58f-1901-48ed-9d4e-98cb72cc9758 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:15:34 user nova-compute[75014]: WARNING nova.compute.manager [req-dcf592c6-c5aa-4d38-8d4a-4922ff6d0dc5 req-cf0b0b7d-b1f1-41ca-8de8-6bbe4b69657c service nova] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Received unexpected event network-vif-plugged-244be58f-1901-48ed-9d4e-98cb72cc9758 for instance with vm_state building and task_state spawning.
Nov 08 04:15:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:36 user nova-compute[75014]: DEBUG nova.compute.manager [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:15:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 04:15:36 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Instance spawned successfully.
Nov 08 04:15:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 04:15:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:15:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:15:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:15:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:15:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:15:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:15:36 user nova-compute[75014]: INFO nova.compute.manager [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Took 6.15 seconds to spawn the instance on the hypervisor.
Nov 08 04:15:36 user nova-compute[75014]: DEBUG nova.compute.manager [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:15:36 user nova-compute[75014]: INFO nova.compute.manager [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Took 6.91 seconds to build instance.
Nov 08 04:15:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-401b233e-2406-4842-91c3-06171dc66afa tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.041s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:15:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:38 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:15:39 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:15:42 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:15:42 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:15:42 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-077303d8-0afd-4c60-ad9a-1bd29bff4d2d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:15:42 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-077303d8-0afd-4c60-ad9a-1bd29bff4d2d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:15:42 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 04:15:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:42 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Updating instance_info_cache with network_info: [{"id": "79c0199e-5d4c-4727-a0f5-75bae036c112", "address": "fa:16:3e:57:01:6d", "network": {"id": "a47305e7-0cb6-456a-bcde-ab03a8ea643e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-429065517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c769c7ba95ad41339b55e9baab80af07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79c0199e-5d", "ovs_interfaceid": "79c0199e-5d4c-4727-a0f5-75bae036c112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:15:42 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-077303d8-0afd-4c60-ad9a-1bd29bff4d2d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:15:42 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 04:15:43 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:15:43 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:15:45 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:15:47 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:15:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:15:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:15:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:15:47 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:15:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:15:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:15:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e5ed96-313f-41ce-92ac-904b64ce2b3e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:15:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e5ed96-313f-41ce-92ac-904b64ce2b3e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e5ed96-313f-41ce-92ac-904b64ce2b3e/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e5ed96-313f-41ce-92ac-904b64ce2b3e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:47 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:15:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:48 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:15:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:15:49 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:15:49 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:15:49 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=7878MB free_disk=24.965290069580078GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:15:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:15:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:15:50 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance c23c9e00-b782-4530-bb01-a7a167951c1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:15:50 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 077303d8-0afd-4c60-ad9a-1bd29bff4d2d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:15:50 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 01754a6d-8f7b-46ad-b166-defe74eb9dd0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:15:50 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance ace7e2f7-28c3-41e3-b92b-05e834c3968c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:15:50 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:15:50 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance c0e5ed96-313f-41ce-92ac-904b64ce2b3e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:15:50 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:15:50 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:15:50 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:15:50 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Refreshing inventories for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 04:15:50 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Updating ProviderTree inventory for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 04:15:50 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Updating inventory in ProviderTree for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 04:15:50 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Refreshing aggregate associations for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0, aggregates: None {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 04:15:50 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Refreshing trait associations for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 04:15:50 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:15:50 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:15:50 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:15:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.809s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:15:50 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:15:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:53 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:15:53 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:15:55 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:15:56 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:15:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:15:59 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:15:59 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Cleaning up deleted instances {{(pid=75014) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 04:15:59 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] There are 0 instances to clean {{(pid=75014) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 04:16:02 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:16:02 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=75014) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 04:16:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:08 user nova-compute[75014]: DEBUG nova.compute.manager [req-bfb87463-7b51-4661-b9ca-43b7e34db85f req-8d3eab1b-995c-4b82-b5f6-0690f38cfa61 service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Received event network-changed-0fe677fa-7bc0-4ab0-abe1-4078284cb71a {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:16:08 user nova-compute[75014]: DEBUG nova.compute.manager [req-bfb87463-7b51-4661-b9ca-43b7e34db85f req-8d3eab1b-995c-4b82-b5f6-0690f38cfa61 service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Refreshing instance network info cache due to event network-changed-0fe677fa-7bc0-4ab0-abe1-4078284cb71a. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:16:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-bfb87463-7b51-4661-b9ca-43b7e34db85f req-8d3eab1b-995c-4b82-b5f6-0690f38cfa61 service nova] Acquiring lock "refresh_cache-ace7e2f7-28c3-41e3-b92b-05e834c3968c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:16:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-bfb87463-7b51-4661-b9ca-43b7e34db85f req-8d3eab1b-995c-4b82-b5f6-0690f38cfa61 service nova] Acquired lock "refresh_cache-ace7e2f7-28c3-41e3-b92b-05e834c3968c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:16:08 user nova-compute[75014]: DEBUG nova.network.neutron [req-bfb87463-7b51-4661-b9ca-43b7e34db85f req-8d3eab1b-995c-4b82-b5f6-0690f38cfa61 service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Refreshing network info cache for port 0fe677fa-7bc0-4ab0-abe1-4078284cb71a {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:16:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Acquiring lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:16:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:16:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Acquiring lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:16:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:16:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:16:08 user nova-compute[75014]: INFO nova.compute.manager [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Terminating instance
Nov 08 04:16:08 user nova-compute[75014]: DEBUG nova.compute.manager [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG nova.compute.manager [req-2d596cb9-8df1-4556-ad63-e2a38cdd0cb9 req-d4c1afda-87c0-446b-9172-0df9d832c331 service nova] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Received event network-changed-4f3b192f-a567-463a-b120-1b328e11feaa {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG nova.compute.manager [req-2d596cb9-8df1-4556-ad63-e2a38cdd0cb9 req-d4c1afda-87c0-446b-9172-0df9d832c331 service nova] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Refreshing instance network info cache due to event network-changed-4f3b192f-a567-463a-b120-1b328e11feaa. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2d596cb9-8df1-4556-ad63-e2a38cdd0cb9 req-d4c1afda-87c0-446b-9172-0df9d832c331 service nova] Acquiring lock "refresh_cache-c23c9e00-b782-4530-bb01-a7a167951c1d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2d596cb9-8df1-4556-ad63-e2a38cdd0cb9 req-d4c1afda-87c0-446b-9172-0df9d832c331 service nova] Acquired lock "refresh_cache-c23c9e00-b782-4530-bb01-a7a167951c1d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG nova.network.neutron [req-2d596cb9-8df1-4556-ad63-e2a38cdd0cb9 req-d4c1afda-87c0-446b-9172-0df9d832c331 service nova] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Refreshing network info cache for port 4f3b192f-a567-463a-b120-1b328e11feaa {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:16:09 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Instance destroyed successfully.
Nov 08 04:16:09 user nova-compute[75014]: DEBUG nova.objects.instance [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lazy-loading 'resources' on Instance uuid ace7e2f7-28c3-41e3-b92b-05e834c3968c {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T04:09:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1114062548',display_name='tempest-TestShelveInstance-server-1114062548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1114062548',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDciRwDmkXIWJ59cSwLkrq0g6fRWYu1rgIHdChGoGUVHZISbu0npqT6Q3VTBlFFTYXtLW//rqLSyyNUm93IqVTTPMb/uBRfKBfBqHi/1FWKNAmj/2k9FvggMVKvEN4GfIA==',key_name='tempest-TestShelveInstance-26222747',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:14:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad0174a3477d45e1a6aa8a405b0027b8',ramdisk_id='',reservation_id='r-v4udig5g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-958337227',owner_user_name='tempest-TestShelveInstance-958337227-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:14:22Z,user_data=None,user_id='58b14797a2974cb19e3759f51c391509',uuid=ace7e2f7-28c3-41e3-b92b-05e834c3968c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "address": "fa:16:3e:9c:4b:98", "network": {"id": "11cfca93-63ac-49c6-8cf8-2c7885e21563", "bridge": "br-int", "label": "tempest-TestShelveInstance-1503372709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0174a3477d45e1a6aa8a405b0027b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe677fa-7b", "ovs_interfaceid": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Converting VIF {"id": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "address": "fa:16:3e:9c:4b:98", "network": {"id": "11cfca93-63ac-49c6-8cf8-2c7885e21563", "bridge": "br-int", "label": "tempest-TestShelveInstance-1503372709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0174a3477d45e1a6aa8a405b0027b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe677fa-7b", "ovs_interfaceid": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:4b:98,bridge_name='br-int',has_traffic_filtering=True,id=0fe677fa-7bc0-4ab0-abe1-4078284cb71a,network=Network(11cfca93-63ac-49c6-8cf8-2c7885e21563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe677fa-7b') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG os_vif [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:4b:98,bridge_name='br-int',has_traffic_filtering=True,id=0fe677fa-7bc0-4ab0-abe1-4078284cb71a,network=Network(11cfca93-63ac-49c6-8cf8-2c7885e21563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe677fa-7b') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0fe677fa-7b, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0846bc4-1524-4836-803b-4fe1086bdd25) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:16:09 user nova-compute[75014]: INFO os_vif [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:4b:98,bridge_name='br-int',has_traffic_filtering=True,id=0fe677fa-7bc0-4ab0-abe1-4078284cb71a,network=Network(11cfca93-63ac-49c6-8cf8-2c7885e21563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe677fa-7b')
Nov 08 04:16:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zoZcGiyA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:16:09 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:16:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf11a37-a25f-4e2c-8cb6-dbb1a9f25c20]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:16:09 user nova-compute[75014]: No targets found.
Nov 08 04:16:09 user nova-compute[75014]: iSNS:
Nov 08 04:16:09 user nova-compute[75014]: No targets found.
Nov 08 04:16:09 user nova-compute[75014]: STATIC:
Nov 08 04:16:09 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:16:09 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:16:09 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:16:09 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3
Nov 08 04:16:09 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:16:09 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:16:09 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437
Nov 08 04:16:09 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:16:09 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:16:09 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429
Nov 08 04:16:09 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:16:09 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:16:09 user nova-compute[75014]: FIRMWARE:
Nov 08 04:16:09 user nova-compute[75014]: No targets found.
Nov 08 04:16:09 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:16:09 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:16:09 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31bc3fc-bad9-4a1f-9a79-1c6d1c814e5b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a710f2c-3910-4d82-af07-de1791e1ca8d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:16:09 user nova-compute[75014]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:16:09 user nova-compute[75014]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)
Nov 08 04:16:09 user nova-compute[75014]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 (non-flash)
Nov 08 04:16:09 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:16:09 user nova-compute[75014]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:16:09 user nova-compute[75014]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 (non-flash)
Nov 08 04:16:09 user nova-compute[75014]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 (non-flash)
Nov 08 04:16:09 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f04003c8700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437'): ({'sdd'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Removing single pathed devices sdd {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG nova.network.neutron [req-bfb87463-7b51-4661-b9ca-43b7e34db85f req-8d3eab1b-995c-4b82-b5f6-0690f38cfa61 service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Updated VIF entry in instance network info cache for port 0fe677fa-7bc0-4ab0-abe1-4078284cb71a. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG nova.network.neutron [req-bfb87463-7b51-4661-b9ca-43b7e34db85f req-8d3eab1b-995c-4b82-b5f6-0690f38cfa61 service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Updating instance_info_cache with network_info: [{"id": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "address": "fa:16:3e:9c:4b:98", "network": {"id": "11cfca93-63ac-49c6-8cf8-2c7885e21563", "bridge": "br-int", "label": "tempest-TestShelveInstance-1503372709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0174a3477d45e1a6aa8a405b0027b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe677fa-7b", "ovs_interfaceid": "0fe677fa-7bc0-4ab0-abe1-4078284cb71a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a61753f-ffad-4bff-ba63-0c79540932c4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-bfb87463-7b51-4661-b9ca-43b7e34db85f req-8d3eab1b-995c-4b82-b5f6-0690f38cfa61 service nova] Releasing lock "refresh_cache-ace7e2f7-28c3-41e3-b92b-05e834c3968c" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[965feba2-f6fd-489f-b056-00a6eecde252]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Flushing IO for device /dev/sdd {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3f4cf6-d464-4555-8005-11770edc65b5]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:16:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:10 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea64aa3-fdb9-4553-aeca-f9b684b2feed]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:10 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:16:10 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] SCSI volumes sdd have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:16:10 user nova-compute[75014]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO61d213e4-cb290fde66f445cd', '/dev/disk/by-id/scsi-26362323930666465', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_61d213e4') {{(pid=86544) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 04:16:10 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f93500-0f3b-4751-b52b-471ae78c8195]: (4, None) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:10 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:16:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:10 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc61979-d0c6-48d2-a39a-edbbb9ff1825]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:10 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:16:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:10 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe7d643-dd30-4b16-9378-f511eff22bfb]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:10 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437, portal: 172.16.0.220,3260]
Nov 08 04:16:10 user nova-compute[75014]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437, portal: 172.16.0.220,3260] successful.
Nov 08 04:16:10 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:16:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ec0452-90f2-48e1-b99a-b6a460342437 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:10 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d091f4e-602f-48cd-a51c-49be2d856c20]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:10 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:16:10 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:16:10 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] <== disconnect_volume: return (395ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:16:10 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:16:10 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Deleting instance files /opt/stack/data/nova/instances/ace7e2f7-28c3-41e3-b92b-05e834c3968c_del
Nov 08 04:16:10 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Deletion of /opt/stack/data/nova/instances/ace7e2f7-28c3-41e3-b92b-05e834c3968c_del complete
Nov 08 04:16:10 user nova-compute[75014]: DEBUG nova.network.neutron [req-2d596cb9-8df1-4556-ad63-e2a38cdd0cb9 req-d4c1afda-87c0-446b-9172-0df9d832c331 service nova] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Updated VIF entry in instance network info cache for port 4f3b192f-a567-463a-b120-1b328e11feaa. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:16:10 user nova-compute[75014]: DEBUG nova.network.neutron [req-2d596cb9-8df1-4556-ad63-e2a38cdd0cb9 req-d4c1afda-87c0-446b-9172-0df9d832c331 service nova] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Updating instance_info_cache with network_info: [{"id": "4f3b192f-a567-463a-b120-1b328e11feaa", "address": "fa:16:3e:70:b6:a1", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3b192f-a5", "ovs_interfaceid": "4f3b192f-a567-463a-b120-1b328e11feaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:16:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2d596cb9-8df1-4556-ad63-e2a38cdd0cb9 req-d4c1afda-87c0-446b-9172-0df9d832c331 service nova] Releasing lock "refresh_cache-c23c9e00-b782-4530-bb01-a7a167951c1d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:16:10 user nova-compute[75014]: INFO nova.compute.manager [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Took 1.36 seconds to destroy the instance on the hypervisor.
Nov 08 04:16:10 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:16:10 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:16:10 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:16:10 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:16:10 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Took 0.53 seconds to deallocate network for instance.
Nov 08 04:16:11 user nova-compute[75014]: DEBUG nova.compute.manager [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Stashing vm_state: active {{(pid=75014) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 08 04:16:11 user nova-compute[75014]: DEBUG nova.compute.manager [req-44bc3121-d480-485d-9067-5757af7e9320 req-e0a1ca4b-c91a-468e-b6fd-eefd15433c86 service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Received event network-changed-80b71c76-357d-449c-8c5c-a1b28b1e6756 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:16:11 user nova-compute[75014]: DEBUG nova.compute.manager [req-44bc3121-d480-485d-9067-5757af7e9320 req-e0a1ca4b-c91a-468e-b6fd-eefd15433c86 service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Refreshing instance network info cache due to event network-changed-80b71c76-357d-449c-8c5c-a1b28b1e6756. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:16:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-44bc3121-d480-485d-9067-5757af7e9320 req-e0a1ca4b-c91a-468e-b6fd-eefd15433c86 service nova] Acquiring lock "refresh_cache-9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:16:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-44bc3121-d480-485d-9067-5757af7e9320 req-e0a1ca4b-c91a-468e-b6fd-eefd15433c86 service nova] Acquired lock "refresh_cache-9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:16:11 user nova-compute[75014]: DEBUG nova.network.neutron [req-44bc3121-d480-485d-9067-5757af7e9320 req-e0a1ca4b-c91a-468e-b6fd-eefd15433c86 service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Refreshing network info cache for port 80b71c76-357d-449c-8c5c-a1b28b1e6756 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:16:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:16:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:16:11 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 04:16:11 user nova-compute[75014]: INFO nova.compute.claims [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Claim successful on node user
Nov 08 04:16:11 user nova-compute[75014]: INFO nova.compute.resource_tracker [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Updating resource usage from migration ce68e787-c0f2-4dda-b99d-6645a231f3ae
Nov 08 04:16:11 user nova-compute[75014]: INFO nova.compute.manager [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Took 1.05 seconds to detach 1 volumes for instance.
Nov 08 04:16:11 user nova-compute[75014]: DEBUG nova.compute.manager [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Deleting volume: e0ec0452-90f2-48e1-b99a-b6a460342437 {{(pid=75014) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 04:16:11 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:16:12 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:16:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:16:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.463s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:16:12 user nova-compute[75014]: INFO nova.compute.manager [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Migrating
Nov 08 04:16:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:16:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:16:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.034s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:16:12 user nova-compute[75014]: INFO nova.compute.rpcapi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 08 04:16:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:16:12 user nova-compute[75014]: DEBUG nova.network.neutron [req-44bc3121-d480-485d-9067-5757af7e9320 req-e0a1ca4b-c91a-468e-b6fd-eefd15433c86 service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Updated VIF entry in instance network info cache for port 80b71c76-357d-449c-8c5c-a1b28b1e6756. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:16:12 user nova-compute[75014]: DEBUG nova.network.neutron [req-44bc3121-d480-485d-9067-5757af7e9320 req-e0a1ca4b-c91a-468e-b6fd-eefd15433c86 service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Updating instance_info_cache with network_info: [{"id": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "address": "fa:16:3e:61:82:36", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b71c76-35", "ovs_interfaceid": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:16:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "refresh_cache-9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:16:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-44bc3121-d480-485d-9067-5757af7e9320 req-e0a1ca4b-c91a-468e-b6fd-eefd15433c86 service nova] Releasing lock "refresh_cache-9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:16:12 user nova-compute[75014]: DEBUG nova.compute.manager [req-44bc3121-d480-485d-9067-5757af7e9320 req-e0a1ca4b-c91a-468e-b6fd-eefd15433c86 service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Received event network-vif-unplugged-0fe677fa-7bc0-4ab0-abe1-4078284cb71a {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:16:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-44bc3121-d480-485d-9067-5757af7e9320 req-e0a1ca4b-c91a-468e-b6fd-eefd15433c86 service nova] Acquiring lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:16:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-44bc3121-d480-485d-9067-5757af7e9320 req-e0a1ca4b-c91a-468e-b6fd-eefd15433c86 service nova] Lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:16:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-44bc3121-d480-485d-9067-5757af7e9320 req-e0a1ca4b-c91a-468e-b6fd-eefd15433c86 service nova] Lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:16:12 user nova-compute[75014]: DEBUG nova.compute.manager [req-44bc3121-d480-485d-9067-5757af7e9320 req-e0a1ca4b-c91a-468e-b6fd-eefd15433c86 service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] No waiting events found dispatching network-vif-unplugged-0fe677fa-7bc0-4ab0-abe1-4078284cb71a {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:16:12 user nova-compute[75014]: DEBUG nova.compute.manager [req-44bc3121-d480-485d-9067-5757af7e9320 req-e0a1ca4b-c91a-468e-b6fd-eefd15433c86 service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Received event network-vif-unplugged-0fe677fa-7bc0-4ab0-abe1-4078284cb71a for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:16:12 user nova-compute[75014]: DEBUG nova.compute.manager [req-44bc3121-d480-485d-9067-5757af7e9320 req-e0a1ca4b-c91a-468e-b6fd-eefd15433c86 service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Received event network-vif-plugged-0fe677fa-7bc0-4ab0-abe1-4078284cb71a {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:16:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-44bc3121-d480-485d-9067-5757af7e9320 req-e0a1ca4b-c91a-468e-b6fd-eefd15433c86 service nova] Acquiring lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:16:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-44bc3121-d480-485d-9067-5757af7e9320 req-e0a1ca4b-c91a-468e-b6fd-eefd15433c86 service nova] Lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:16:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-44bc3121-d480-485d-9067-5757af7e9320 req-e0a1ca4b-c91a-468e-b6fd-eefd15433c86 service nova] Lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:16:12 user nova-compute[75014]: DEBUG nova.compute.manager [req-44bc3121-d480-485d-9067-5757af7e9320 req-e0a1ca4b-c91a-468e-b6fd-eefd15433c86 service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] No waiting events found dispatching network-vif-plugged-0fe677fa-7bc0-4ab0-abe1-4078284cb71a {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:16:12 user nova-compute[75014]: WARNING nova.compute.manager [req-44bc3121-d480-485d-9067-5757af7e9320 req-e0a1ca4b-c91a-468e-b6fd-eefd15433c86 service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Received unexpected event network-vif-plugged-0fe677fa-7bc0-4ab0-abe1-4078284cb71a for instance with vm_state active and task_state deleting.
Nov 08 04:16:12 user nova-compute[75014]: DEBUG nova.compute.manager [req-44bc3121-d480-485d-9067-5757af7e9320 req-e0a1ca4b-c91a-468e-b6fd-eefd15433c86 service nova] [instance: ace7e2f7-28c3-41e3-b92b-05e834c3968c] Received event network-vif-deleted-0fe677fa-7bc0-4ab0-abe1-4078284cb71a {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:16:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquired lock "refresh_cache-9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:16:12 user nova-compute[75014]: DEBUG nova.network.neutron [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:16:12 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:16:12 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:16:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:16:12 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Deleted allocations for instance ace7e2f7-28c3-41e3-b92b-05e834c3968c
Nov 08 04:16:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5478eed5-3f0e-4993-a1a3-e2e48f9bb848 tempest-TestShelveInstance-958337227 tempest-TestShelveInstance-958337227-project-member] Lock "ace7e2f7-28c3-41e3-b92b-05e834c3968c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.638s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:16:12 user nova-compute[75014]: DEBUG nova.network.neutron [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Updating instance_info_cache with network_info: [{"id": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "address": "fa:16:3e:61:82:36", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b71c76-35", "ovs_interfaceid": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:16:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Releasing lock "refresh_cache-9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:16:12 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Starting migrate_disk_and_power_off {{(pid=75014) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 08 04:16:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:13 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Instance destroyed successfully.
Nov 08 04:16:13 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:13:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-508013248',display_name='tempest-ServerActionsTestOtherA-server-508013248',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-508013248',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrmtIbZxgIG+Mj0FCPzPyxgkvpjo1RlPcXcxfMKotFzO42Fyp9FxpoU2iamZDPiUFM+ibJrBLSV5KEQ2GBDLuvdHnBp4eyBffs9QFbrBPe1RSRIG54GYFQAZ3CvgZJG1Q==',key_name='tempest-keypair-516992333',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:14:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7b9ecaed30ba4ad1a9d5eaca02633604',ramdisk_id='',reservation_id='r-6xy5m0zg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-537496863',owner_user_name='tempest-ServerActionsTestOtherA-537496863-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:16:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8398fcf62a014e7f943bff6fcc3f72f3',uuid=9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "address": "fa:16:3e:61:82:36", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-331965167-network", "vif_mac": "fa:16:3e:61:82:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b71c76-35", "ovs_interfaceid": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Converting VIF {"id": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "address": "fa:16:3e:61:82:36", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-331965167-network", "vif_mac": "fa:16:3e:61:82:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b71c76-35", "ovs_interfaceid": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:82:36,bridge_name='br-int',has_traffic_filtering=True,id=80b71c76-357d-449c-8c5c-a1b28b1e6756,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b71c76-35') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG os_vif [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:82:36,bridge_name='br-int',has_traffic_filtering=True,id=80b71c76-357d-449c-8c5c-a1b28b1e6756,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b71c76-35') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80b71c76-35, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=305ee777-26e2-4db6-8ec9-d3bdceedf8ee) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG nova.compute.manager [req-07c54337-1093-4fdf-bd99-372a93a2c3e3 req-2e92d866-b672-47da-bca5-1820698f63a0 service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Received event network-vif-unplugged-80b71c76-357d-449c-8c5c-a1b28b1e6756 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-07c54337-1093-4fdf-bd99-372a93a2c3e3 req-2e92d866-b672-47da-bca5-1820698f63a0 service nova] Acquiring lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-07c54337-1093-4fdf-bd99-372a93a2c3e3 req-2e92d866-b672-47da-bca5-1820698f63a0 service nova] Lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-07c54337-1093-4fdf-bd99-372a93a2c3e3 req-2e92d866-b672-47da-bca5-1820698f63a0 service nova] Lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG nova.compute.manager [req-07c54337-1093-4fdf-bd99-372a93a2c3e3 req-2e92d866-b672-47da-bca5-1820698f63a0 service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] No waiting events found dispatching network-vif-unplugged-80b71c76-357d-449c-8c5c-a1b28b1e6756 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:16:13 user nova-compute[75014]: WARNING nova.compute.manager [req-07c54337-1093-4fdf-bd99-372a93a2c3e3 req-2e92d866-b672-47da-bca5-1820698f63a0 service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Received unexpected event network-vif-unplugged-80b71c76-357d-449c-8c5c-a1b28b1e6756 for instance with vm_state active and task_state resize_migrating.
Nov 08 04:16:13 user nova-compute[75014]: DEBUG nova.compute.manager [req-07c54337-1093-4fdf-bd99-372a93a2c3e3 req-2e92d866-b672-47da-bca5-1820698f63a0 service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Received event network-vif-plugged-80b71c76-357d-449c-8c5c-a1b28b1e6756 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-07c54337-1093-4fdf-bd99-372a93a2c3e3 req-2e92d866-b672-47da-bca5-1820698f63a0 service nova] Acquiring lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-07c54337-1093-4fdf-bd99-372a93a2c3e3 req-2e92d866-b672-47da-bca5-1820698f63a0 service nova] Lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-07c54337-1093-4fdf-bd99-372a93a2c3e3 req-2e92d866-b672-47da-bca5-1820698f63a0 service nova] Lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG nova.compute.manager [req-07c54337-1093-4fdf-bd99-372a93a2c3e3 req-2e92d866-b672-47da-bca5-1820698f63a0 service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] No waiting events found dispatching network-vif-plugged-80b71c76-357d-449c-8c5c-a1b28b1e6756 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:16:13 user nova-compute[75014]: WARNING nova.compute.manager [req-07c54337-1093-4fdf-bd99-372a93a2c3e3 req-2e92d866-b672-47da-bca5-1820698f63a0 service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Received unexpected event network-vif-plugged-80b71c76-357d-449c-8c5c-a1b28b1e6756 for instance with vm_state active and task_state resize_migrating.
Nov 08 04:16:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:16:13 user nova-compute[75014]: INFO os_vif [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:82:36,bridge_name='br-int',has_traffic_filtering=True,id=80b71c76-357d-449c-8c5c-a1b28b1e6756,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b71c76-35')
Nov 08 04:16:13 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LTbZRhoy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:16:13 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:16:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[21088427-56ba-4171-913f-1f49e77f20a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:16:13 user nova-compute[75014]: No targets found.
Nov 08 04:16:13 user nova-compute[75014]: iSNS:
Nov 08 04:16:13 user nova-compute[75014]: No targets found.
Nov 08 04:16:13 user nova-compute[75014]: STATIC:
Nov 08 04:16:13 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:16:13 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:16:13 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:16:13 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3
Nov 08 04:16:13 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:16:13 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:16:13 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429
Nov 08 04:16:13 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:16:13 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:16:13 user nova-compute[75014]: FIRMWARE:
Nov 08 04:16:13 user nova-compute[75014]: No targets found.
Nov 08 04:16:13 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:16:13 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:16:13 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6afc57-4b0c-4942-bda1-f3e6a597ac10]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[87609cd3-1bde-49da-a880-a8675917cbda]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:16:13 user nova-compute[75014]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:16:13 user nova-compute[75014]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 (non-flash)
Nov 08 04:16:13 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:16:13 user nova-compute[75014]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:16:13 user nova-compute[75014]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 (non-flash)
Nov 08 04:16:13 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f04181a9630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429'): ({'sdc'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Removing single pathed devices sdc {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.092s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fceacfb-7cfb-46b8-8685-a3dc28b2d2c7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed57475-9939-47cb-a9a7-ee68a2930300]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Flushing IO for device /dev/sdc {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8621ff-ec9a-40ac-9011-e4b3f913f868]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.147s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5c68a7-5a19-4317-8d69-afd770b28c35]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] SCSI volumes sdc have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe4be726-b239cb125a359143', '/dev/disk/by-id/scsi-26232333963623132', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e4be726') {{(pid=86544) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d7f921-0e6d-41f6-b0f8-2242d3d7b69d]: (4, None) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7334146-145b-4fbf-af1b-a66b1767edad]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6520ee-f742-4d9e-86c9-648c0858a356]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429, portal: 172.16.0.220,3260]
Nov 08 04:16:14 user nova-compute[75014]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429, portal: 172.16.0.220,3260] successful.
Nov 08 04:16:14 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cc7030-3ab5-4942-9472-cae786ca2436]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.651s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] <== disconnect_volume: return (652ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6b67fbc7-046d-4a9c-8c60-6c36ba181172 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Acquiring lock "c0e5ed96-313f-41ce-92ac-904b64ce2b3e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6b67fbc7-046d-4a9c-8c60-6c36ba181172 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lock "c0e5ed96-313f-41ce-92ac-904b64ce2b3e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6b67fbc7-046d-4a9c-8c60-6c36ba181172 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Acquiring lock "c0e5ed96-313f-41ce-92ac-904b64ce2b3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6b67fbc7-046d-4a9c-8c60-6c36ba181172 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lock "c0e5ed96-313f-41ce-92ac-904b64ce2b3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6b67fbc7-046d-4a9c-8c60-6c36ba181172 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lock "c0e5ed96-313f-41ce-92ac-904b64ce2b3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:16:14 user nova-compute[75014]: INFO nova.compute.manager [None req-6b67fbc7-046d-4a9c-8c60-6c36ba181172 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Terminating instance
Nov 08 04:16:14 user nova-compute[75014]: DEBUG nova.compute.manager [None req-6b67fbc7-046d-4a9c-8c60-6c36ba181172 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG nova.compute.manager [req-ccf88172-2348-40fd-9b50-c20d17064249 req-2776ca52-aab1-4c89-bdbd-a0b6cfc7ef54 service nova] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Received event network-vif-unplugged-cca91a10-8d17-4dcc-978d-259d5adcb160 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ccf88172-2348-40fd-9b50-c20d17064249 req-2776ca52-aab1-4c89-bdbd-a0b6cfc7ef54 service nova] Acquiring lock "c0e5ed96-313f-41ce-92ac-904b64ce2b3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ccf88172-2348-40fd-9b50-c20d17064249 req-2776ca52-aab1-4c89-bdbd-a0b6cfc7ef54 service nova] Lock "c0e5ed96-313f-41ce-92ac-904b64ce2b3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ccf88172-2348-40fd-9b50-c20d17064249 req-2776ca52-aab1-4c89-bdbd-a0b6cfc7ef54 service nova] Lock "c0e5ed96-313f-41ce-92ac-904b64ce2b3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG nova.compute.manager [req-ccf88172-2348-40fd-9b50-c20d17064249 req-2776ca52-aab1-4c89-bdbd-a0b6cfc7ef54 service nova] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] No waiting events found dispatching network-vif-unplugged-cca91a10-8d17-4dcc-978d-259d5adcb160 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:16:14 user nova-compute[75014]: DEBUG nova.compute.manager [req-ccf88172-2348-40fd-9b50-c20d17064249 req-2776ca52-aab1-4c89-bdbd-a0b6cfc7ef54 service nova] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Received event network-vif-unplugged-cca91a10-8d17-4dcc-978d-259d5adcb160 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:16:15 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Instance destroyed successfully.
Nov 08 04:16:15 user nova-compute[75014]: DEBUG nova.objects.instance [None req-6b67fbc7-046d-4a9c-8c60-6c36ba181172 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lazy-loading 'resources' on Instance uuid c0e5ed96-313f-41ce-92ac-904b64ce2b3e {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:16:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-6b67fbc7-046d-4a9c-8c60-6c36ba181172 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:14:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1605100981',display_name='tempest-ServersNegativeTestJSON-server-1605100981',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1605100981',id=41,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:14:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c769c7ba95ad41339b55e9baab80af07',ramdisk_id='',reservation_id='r-tltwjwzl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1651832936',owner_user_name='tempest-ServersNegativeTestJSON-1651832936-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:14:32Z,user_data=None,user_id='41f64f5dd3754997a7a4d2fc193748a2',uuid=c0e5ed96-313f-41ce-92ac-904b64ce2b3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cca91a10-8d17-4dcc-978d-259d5adcb160", "address": "fa:16:3e:27:67:e5", "network": {"id": "a47305e7-0cb6-456a-bcde-ab03a8ea643e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-429065517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c769c7ba95ad41339b55e9baab80af07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca91a10-8d", "ovs_interfaceid": "cca91a10-8d17-4dcc-978d-259d5adcb160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:16:15 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-6b67fbc7-046d-4a9c-8c60-6c36ba181172 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Converting VIF {"id": "cca91a10-8d17-4dcc-978d-259d5adcb160", "address": "fa:16:3e:27:67:e5", "network": {"id": "a47305e7-0cb6-456a-bcde-ab03a8ea643e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-429065517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c769c7ba95ad41339b55e9baab80af07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca91a10-8d", "ovs_interfaceid": "cca91a10-8d17-4dcc-978d-259d5adcb160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:16:15 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-6b67fbc7-046d-4a9c-8c60-6c36ba181172 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:67:e5,bridge_name='br-int',has_traffic_filtering=True,id=cca91a10-8d17-4dcc-978d-259d5adcb160,network=Network(a47305e7-0cb6-456a-bcde-ab03a8ea643e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcca91a10-8d') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:16:15 user nova-compute[75014]: DEBUG os_vif [None req-6b67fbc7-046d-4a9c-8c60-6c36ba181172 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:67:e5,bridge_name='br-int',has_traffic_filtering=True,id=cca91a10-8d17-4dcc-978d-259d5adcb160,network=Network(a47305e7-0cb6-456a-bcde-ab03a8ea643e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcca91a10-8d') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:16:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcca91a10-8d, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:16:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:16:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e55ec6d7-2e7e-4235-a9ee-ac38af492c86) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:16:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:16:15 user nova-compute[75014]: INFO os_vif [None req-6b67fbc7-046d-4a9c-8c60-6c36ba181172 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:67:e5,bridge_name='br-int',has_traffic_filtering=True,id=cca91a10-8d17-4dcc-978d-259d5adcb160,network=Network(a47305e7-0cb6-456a-bcde-ab03a8ea643e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcca91a10-8d')
Nov 08 04:16:15 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-6b67fbc7-046d-4a9c-8c60-6c36ba181172 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Deleting instance files /opt/stack/data/nova/instances/c0e5ed96-313f-41ce-92ac-904b64ce2b3e_del
Nov 08 04:16:15 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-6b67fbc7-046d-4a9c-8c60-6c36ba181172 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Deletion of /opt/stack/data/nova/instances/c0e5ed96-313f-41ce-92ac-904b64ce2b3e_del complete
Nov 08 04:16:15 user nova-compute[75014]: INFO nova.compute.manager [None req-6b67fbc7-046d-4a9c-8c60-6c36ba181172 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 08 04:16:15 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-6b67fbc7-046d-4a9c-8c60-6c36ba181172 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:16:15 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:16:15 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:16:15 user nova-compute[75014]: DEBUG nova.network.neutron [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Port 80b71c76-357d-449c-8c5c-a1b28b1e6756 binding to destination host user is already ACTIVE {{(pid=75014) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 08 04:16:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:16:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:16:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:16:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "refresh_cache-9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:16:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquired lock "refresh_cache-9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:16:16 user nova-compute[75014]: DEBUG nova.network.neutron [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:16:16 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:16:16 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Took 0.96 seconds to deallocate network for instance.
Nov 08 04:16:16 user nova-compute[75014]: DEBUG nova.compute.manager [req-15d58d7a-25fe-45d1-909c-0aff8e57c8a1 req-22edbfe5-47a2-4814-baf0-7460dcb5456d service nova] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Received event network-vif-deleted-cca91a10-8d17-4dcc-978d-259d5adcb160 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:16:16 user nova-compute[75014]: INFO nova.compute.manager [req-15d58d7a-25fe-45d1-909c-0aff8e57c8a1 req-22edbfe5-47a2-4814-baf0-7460dcb5456d service nova] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Neutron deleted interface cca91a10-8d17-4dcc-978d-259d5adcb160; detaching it from the instance and deleting it from the info cache
Nov 08 04:16:16 user nova-compute[75014]: DEBUG nova.network.neutron [req-15d58d7a-25fe-45d1-909c-0aff8e57c8a1 req-22edbfe5-47a2-4814-baf0-7460dcb5456d service nova] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:16:16 user nova-compute[75014]: DEBUG nova.compute.manager [req-15d58d7a-25fe-45d1-909c-0aff8e57c8a1 req-22edbfe5-47a2-4814-baf0-7460dcb5456d service nova] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Detach interface failed, port_id=cca91a10-8d17-4dcc-978d-259d5adcb160, reason: Instance c0e5ed96-313f-41ce-92ac-904b64ce2b3e could not be found. {{(pid=75014) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 04:16:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6b67fbc7-046d-4a9c-8c60-6c36ba181172 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:16:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6b67fbc7-046d-4a9c-8c60-6c36ba181172 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:16:16 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-6b67fbc7-046d-4a9c-8c60-6c36ba181172 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:16:16 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-6b67fbc7-046d-4a9c-8c60-6c36ba181172 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:16:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6b67fbc7-046d-4a9c-8c60-6c36ba181172 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:16:16 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-6b67fbc7-046d-4a9c-8c60-6c36ba181172 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Deleted allocations for instance c0e5ed96-313f-41ce-92ac-904b64ce2b3e
Nov 08 04:16:16 user nova-compute[75014]: DEBUG nova.network.neutron [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Updating instance_info_cache with network_info: [{"id": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "address": "fa:16:3e:61:82:36", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b71c76-35", "ovs_interfaceid": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:16:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Releasing lock "refresh_cache-9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:16:17 user nova-compute[75014]: DEBUG nova.compute.manager [req-ea137df5-c422-43e0-a2e6-e375b8b27e81 req-054cdf96-387a-4bcf-a993-d6b1836bf3c3 service nova] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Received event network-vif-plugged-cca91a10-8d17-4dcc-978d-259d5adcb160 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:16:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ea137df5-c422-43e0-a2e6-e375b8b27e81 req-054cdf96-387a-4bcf-a993-d6b1836bf3c3 service nova] Acquiring lock "c0e5ed96-313f-41ce-92ac-904b64ce2b3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:16:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ea137df5-c422-43e0-a2e6-e375b8b27e81 req-054cdf96-387a-4bcf-a993-d6b1836bf3c3 service nova] Lock "c0e5ed96-313f-41ce-92ac-904b64ce2b3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:16:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ea137df5-c422-43e0-a2e6-e375b8b27e81 req-054cdf96-387a-4bcf-a993-d6b1836bf3c3 service nova] Lock "c0e5ed96-313f-41ce-92ac-904b64ce2b3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:16:17 user nova-compute[75014]: DEBUG nova.compute.manager [req-ea137df5-c422-43e0-a2e6-e375b8b27e81 req-054cdf96-387a-4bcf-a993-d6b1836bf3c3 service nova] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] No waiting events found dispatching network-vif-plugged-cca91a10-8d17-4dcc-978d-259d5adcb160 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:16:17 user nova-compute[75014]: WARNING nova.compute.manager [req-ea137df5-c422-43e0-a2e6-e375b8b27e81 req-054cdf96-387a-4bcf-a993-d6b1836bf3c3 service nova] [instance: c0e5ed96-313f-41ce-92ac-904b64ce2b3e] Received unexpected event network-vif-plugged-cca91a10-8d17-4dcc-978d-259d5adcb160 for instance with vm_state deleted and task_state None.
Nov 08 04:16:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-6b67fbc7-046d-4a9c-8c60-6c36ba181172 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lock "c0e5ed96-313f-41ce-92ac-904b64ce2b3e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.603s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:16:17 user nova-compute[75014]: DEBUG os_brick.utils [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:16:17 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:16:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:17 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2a45e1-3045-4799-b92b-69465dc4dfa0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:17 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7807da6b-a2d7-4484-b4c6-2e8940ec7679]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:17 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[710dc15b-8ec9-41a7-b5ec-422870116c00]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:17 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2886649-7d5c-446f-8826-e35bdf572257]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:16:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:16:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:16:17 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:16:17 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[de64b5ea-e5db-40ec-baef-f78d0312231c]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:16:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:16:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:16:17 user nova-compute[75014]: DEBUG os_brick.utils [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.volume.cinder [None req-38448936-6804-4312-ac3d-ea7fa9ff95ae tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Update attachment failed for attachment b77f2077-e70f-423a-bc09-5f8e327d6329. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f25b99f1-dd62-4e4b-9e2d-7efb77917abf) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f25b99f1-dd62-4e4b-9e2d-7efb77917abf)
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [None req-38448936-6804-4312-ac3d-ea7fa9ff95ae tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Failed to attach a59c8b3a-9ec7-4740-9490-a7830f3ce405 at /dev/vdc: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f25b99f1-dd62-4e4b-9e2d-7efb77917abf)
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Traceback (most recent call last):
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]     ret_val = method(obj, context, *args, **kwargs)
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]     self._do_attach(context, instance, volume, volume_api,
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]     self._volume_attach(context, volume, connector, instance,
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]     connection_info = volume_api.attachment_update(
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]     res = method(self, ctx, *args, **kwargs)
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]     with excutils.save_and_reraise_exception():
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]     self.force_reraise()
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]     raise self.value
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]     return method.func(obj, *args, **kwargs)
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]     resp = self._update('/attachments/%s' % id, body)
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]     return self.request(url, method, **kwargs)
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0]     raise exceptions.from_response(resp, body)
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f25b99f1-dd62-4e4b-9e2d-7efb77917abf)
Nov 08 04:16:17 user nova-compute[75014]: ERROR nova.compute.manager [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] 
Nov 08 04:16:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-38448936-6804-4312-ac3d-ea7fa9ff95ae tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 52.751s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server [None req-38448936-6804-4312-ac3d-ea7fa9ff95ae tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f25b99f1-dd62-4e4b-9e2d-7efb77917abf)
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f25b99f1-dd62-4e4b-9e2d-7efb77917abf)
Nov 08 04:16:18 user nova-compute[75014]: ERROR oslo_messaging.rpc.server 
Nov 08 04:16:20 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:16:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:16:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:16:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:16:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:40 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:16:41 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:16:43 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:16:44 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:16:44 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:16:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-01754a6d-8f7b-46ad-b166-defe74eb9dd0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:16:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-01754a6d-8f7b-46ad-b166-defe74eb9dd0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:16:44 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 04:16:44 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Updating instance_info_cache with network_info: [{"id": "a4210bed-2f6f-4c2b-ad92-fce0779168f9", "address": "fa:16:3e:23:ba:ba", "network": {"id": "a5c06b2d-3ef9-4f4e-9537-b065082d1a10", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-102893709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a7e7ba2cb0b4038927288ab2157a8eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4210bed-2f", "ovs_interfaceid": "a4210bed-2f6f-4c2b-ad92-fce0779168f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:16:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-01754a6d-8f7b-46ad-b166-defe74eb9dd0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:16:44 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 04:16:44 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:16:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:16:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:16:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:16:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:16:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:45 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Starting finish_migration {{(pid=75014) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Instance directory exists: not creating {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 04:16:46 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Creating image(s)
Nov 08 04:16:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Did not create local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Ensure instance console log exists: /opt/stack/data/nova/instances/9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Start _get_guest_xml network_info=[{"id": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "address": "fa:16:3e:61:82:36", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-331965167-network", "vif_mac": "fa:16:3e:61:82:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b71c76-35", "ovs_interfaceid": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LTbZRhoy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7', 'attached_at': '2023-11-08T04:16:46.000000', 'detached_at': '', 'volume_id': '31cf2118-895b-4150-a0c1-bbb83999f429', 'serial': '31cf2118-895b-4150-a0c1-bbb83999f429'}, 'device_type': 'disk', 'attachment_id': '5fbc22f3-a2b2-4278-9215-8d4ec2f246d9', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:16:46 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:16:46 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:16:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LTbZRhoy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:16:46 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:16:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:16:46 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:16:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:16:46 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c727e969-7d81-4985-a703-970d3f9de291]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:16:46 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b232ee-6bc1-4dc7-9df9-d8421807cc9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429] added
Nov 08 04:16:46 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[00767325-7198-4553-a35c-075becb35572]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a940f40-3187-40fc-9bb7-e35af35b9bee]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LTbZRhoy {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LTbZRhoy" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3870dca4-ffd7-4447-8b3b-e63cd3c9d066]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LTbZRhoy'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdafd4e-4364-419a-81c8-7de15a5d1d18]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a538ec44-4fc0-42e9-ac07-3513a99250e9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:16:46 user nova-compute[75014]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 (non-flash)
Nov 08 04:16:46 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:16:46 user nova-compute[75014]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 (non-flash)
Nov 08 04:16:46 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[849254fe-f1c3-4c5d-8d87-4ca20477b13b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429, portal: 172.16.0.220,3260]
Nov 08 04:16:46 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429, portal: 172.16.0.220,3260] successful.
Nov 08 04:16:46 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10797a2-7d73-4596-b696-26bc5344a8c5]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ccd2f8-6627-4667-b6d8-e441fa08e8ae]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:16:46 user nova-compute[75014]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 (non-flash)
Nov 08 04:16:46 user nova-compute[75014]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:16:46 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:16:46 user nova-compute[75014]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 (non-flash)
Nov 08 04:16:46 user nova-compute[75014]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:16:46 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bcaee7-3315-4912-9de8-5a9c1c7de5a7]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:16:46 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: None {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:16:47 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:16:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LTbZRhoy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:16:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:16:47 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26232333963623132', 'path': '/dev/sdb'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:16:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232333963623132', 'path': '/dev/sdb'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:16:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:13:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-508013248',display_name='tempest-ServerActionsTestOtherA-server-508013248',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-508013248',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrmtIbZxgIG+Mj0FCPzPyxgkvpjo1RlPcXcxfMKotFzO42Fyp9FxpoU2iamZDPiUFM+ibJrBLSV5KEQ2GBDLuvdHnBp4eyBffs9QFbrBPe1RSRIG54GYFQAZ3CvgZJG1Q==',key_name='tempest-keypair-516992333',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:14:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7b9ecaed30ba4ad1a9d5eaca02633604',ramdisk_id='',reservation_id='r-6xy5m0zg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-537496863',owner_user_name='tempest-ServerActionsTestOtherA-537496863-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8398fcf62a014e7f943bff6fcc3f72f3',uuid=9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "address": "fa:16:3e:61:82:36", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-331965167-network", "vif_mac": "fa:16:3e:61:82:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b71c76-35", "ovs_interfaceid": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:16:47 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Converting VIF {"id": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "address": "fa:16:3e:61:82:36", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-331965167-network", "vif_mac": "fa:16:3e:61:82:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b71c76-35", "ovs_interfaceid": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:16:47 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:82:36,bridge_name='br-int',has_traffic_filtering=True,id=80b71c76-357d-449c-8c5c-a1b28b1e6756,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b71c76-35') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:16:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:16:47 user nova-compute[75014]:   <uuid>9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7</uuid>
Nov 08 04:16:47 user nova-compute[75014]:   <name>instance-00000028</name>
Nov 08 04:16:47 user nova-compute[75014]:   <memory>2097152</memory>
Nov 08 04:16:47 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:16:47 user nova-compute[75014]:   <metadata>
Nov 08 04:16:47 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:16:47 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:16:47 user nova-compute[75014]:       <nova:name>tempest-ServerActionsTestOtherA-server-508013248</nova:name>
Nov 08 04:16:47 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:16:46</nova:creationTime>
Nov 08 04:16:47 user nova-compute[75014]:       <nova:flavor name="m1.small">
Nov 08 04:16:47 user nova-compute[75014]:         <nova:memory>2048</nova:memory>
Nov 08 04:16:47 user nova-compute[75014]:         <nova:disk>20</nova:disk>
Nov 08 04:16:47 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:16:47 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:16:47 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:16:47 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:16:47 user nova-compute[75014]:       <nova:owner>
Nov 08 04:16:47 user nova-compute[75014]:         <nova:user uuid="8398fcf62a014e7f943bff6fcc3f72f3">tempest-ServerActionsTestOtherA-537496863-project-member</nova:user>
Nov 08 04:16:47 user nova-compute[75014]:         <nova:project uuid="7b9ecaed30ba4ad1a9d5eaca02633604">tempest-ServerActionsTestOtherA-537496863</nova:project>
Nov 08 04:16:47 user nova-compute[75014]:       </nova:owner>
Nov 08 04:16:47 user nova-compute[75014]:       <nova:ports>
Nov 08 04:16:47 user nova-compute[75014]:         <nova:port uuid="80b71c76-357d-449c-8c5c-a1b28b1e6756">
Nov 08 04:16:47 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 04:16:47 user nova-compute[75014]:         </nova:port>
Nov 08 04:16:47 user nova-compute[75014]:       </nova:ports>
Nov 08 04:16:47 user nova-compute[75014]:     </nova:instance>
Nov 08 04:16:47 user nova-compute[75014]:   </metadata>
Nov 08 04:16:47 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:16:47 user nova-compute[75014]:     <system>
Nov 08 04:16:47 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:16:47 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:16:47 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:16:47 user nova-compute[75014]:       <entry name="serial">9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7</entry>
Nov 08 04:16:47 user nova-compute[75014]:       <entry name="uuid">9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7</entry>
Nov 08 04:16:47 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:16:47 user nova-compute[75014]:     </system>
Nov 08 04:16:47 user nova-compute[75014]:   </sysinfo>
Nov 08 04:16:47 user nova-compute[75014]:   <os>
Nov 08 04:16:47 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:16:47 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:16:47 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:16:47 user nova-compute[75014]:   </os>
Nov 08 04:16:47 user nova-compute[75014]:   <features>
Nov 08 04:16:47 user nova-compute[75014]:     <acpi/>
Nov 08 04:16:47 user nova-compute[75014]:     <apic/>
Nov 08 04:16:47 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:16:47 user nova-compute[75014]:   </features>
Nov 08 04:16:47 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:16:47 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:16:47 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:16:47 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:16:47 user nova-compute[75014]:   </clock>
Nov 08 04:16:47 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:16:47 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:16:47 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:16:47 user nova-compute[75014]:   </cpu>
Nov 08 04:16:47 user nova-compute[75014]:   <devices>
Nov 08 04:16:47 user nova-compute[75014]:     <disk type="block" device="disk">
Nov 08 04:16:47 user nova-compute[75014]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:16:47 user nova-compute[75014]:       <source dev="/dev/sdb"/>
Nov 08 04:16:47 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:16:47 user nova-compute[75014]:       <serial>31cf2118-895b-4150-a0c1-bbb83999f429</serial>
Nov 08 04:16:47 user nova-compute[75014]:     </disk>
Nov 08 04:16:47 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:16:47 user nova-compute[75014]:       <mac address="fa:16:3e:61:82:36"/>
Nov 08 04:16:47 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:16:47 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:16:47 user nova-compute[75014]:       <target dev="tap80b71c76-35"/>
Nov 08 04:16:47 user nova-compute[75014]:     </interface>
Nov 08 04:16:47 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:16:47 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7/console.log" append="off"/>
Nov 08 04:16:47 user nova-compute[75014]:     </serial>
Nov 08 04:16:47 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:16:47 user nova-compute[75014]:     <video>
Nov 08 04:16:47 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:16:47 user nova-compute[75014]:     </video>
Nov 08 04:16:47 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:16:47 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:16:47 user nova-compute[75014]:     </rng>
Nov 08 04:16:47 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:16:47 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:16:47 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:16:47 user nova-compute[75014]:     </memballoon>
Nov 08 04:16:47 user nova-compute[75014]:   </devices>
Nov 08 04:16:47 user nova-compute[75014]: </domain>
Nov 08 04:16:47 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:16:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:13:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-508013248',display_name='tempest-ServerActionsTestOtherA-server-508013248',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-508013248',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrmtIbZxgIG+Mj0FCPzPyxgkvpjo1RlPcXcxfMKotFzO42Fyp9FxpoU2iamZDPiUFM+ibJrBLSV5KEQ2GBDLuvdHnBp4eyBffs9QFbrBPe1RSRIG54GYFQAZ3CvgZJG1Q==',key_name='tempest-keypair-516992333',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:14:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7b9ecaed30ba4ad1a9d5eaca02633604',ramdisk_id='',reservation_id='r-6xy5m0zg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-537496863',owner_user_name='tempest-ServerActionsTestOtherA-537496863-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8398fcf62a014e7f943bff6fcc3f72f3',uuid=9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "address": "fa:16:3e:61:82:36", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-331965167-network", "vif_mac": "fa:16:3e:61:82:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b71c76-35", "ovs_interfaceid": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:16:47 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Converting VIF {"id": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "address": "fa:16:3e:61:82:36", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-331965167-network", "vif_mac": "fa:16:3e:61:82:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b71c76-35", "ovs_interfaceid": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:16:47 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:82:36,bridge_name='br-int',has_traffic_filtering=True,id=80b71c76-357d-449c-8c5c-a1b28b1e6756,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b71c76-35') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:16:47 user nova-compute[75014]: DEBUG os_vif [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:82:36,bridge_name='br-int',has_traffic_filtering=True,id=80b71c76-357d-449c-8c5c-a1b28b1e6756,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b71c76-35') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:16:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:16:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:16:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '78aa2d7c-ac12-5d52-b1cc-d3f53734b445', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:16:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80b71c76-35, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:16:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80b71c76-35, col_values=(('qos', UUID('cec85613-3432-4b69-ae2b-f82a856b232f')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:16:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80b71c76-35, col_values=(('external_ids', {'iface-id': '80b71c76-357d-449c-8c5c-a1b28b1e6756', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:82:36', 'vm-uuid': '9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:16:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:16:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:47 user nova-compute[75014]: INFO os_vif [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:82:36,bridge_name='br-int',has_traffic_filtering=True,id=80b71c76-357d-449c-8c5c-a1b28b1e6756,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b71c76-35')
Nov 08 04:16:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:16:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] No VIF found with MAC fa:16:3e:61:82:36, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:16:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:49 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:16:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:16:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:16:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:16:49 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:16:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:49 user nova-compute[75014]: DEBUG nova.compute.manager [req-5158215c-a94f-4df7-81c5-83a387c5db0c req-b7613e0a-72dc-40da-be7c-9aad5b3b582a service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Received event network-vif-plugged-80b71c76-357d-449c-8c5c-a1b28b1e6756 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:16:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5158215c-a94f-4df7-81c5-83a387c5db0c req-b7613e0a-72dc-40da-be7c-9aad5b3b582a service nova] Acquiring lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:16:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5158215c-a94f-4df7-81c5-83a387c5db0c req-b7613e0a-72dc-40da-be7c-9aad5b3b582a service nova] Lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:16:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5158215c-a94f-4df7-81c5-83a387c5db0c req-b7613e0a-72dc-40da-be7c-9aad5b3b582a service nova] Lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:16:49 user nova-compute[75014]: DEBUG nova.compute.manager [req-5158215c-a94f-4df7-81c5-83a387c5db0c req-b7613e0a-72dc-40da-be7c-9aad5b3b582a service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] No waiting events found dispatching network-vif-plugged-80b71c76-357d-449c-8c5c-a1b28b1e6756 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:16:49 user nova-compute[75014]: WARNING nova.compute.manager [req-5158215c-a94f-4df7-81c5-83a387c5db0c req-b7613e0a-72dc-40da-be7c-9aad5b3b582a service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Received unexpected event network-vif-plugged-80b71c76-357d-449c-8c5c-a1b28b1e6756 for instance with vm_state active and task_state resize_finish.
Nov 08 04:16:49 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:16:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:50 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:16:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:50 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:16:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:16:51 user nova-compute[75014]: DEBUG nova.compute.manager [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:16:51 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Instance running successfully.
Nov 08 04:16:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Failed to set time: agent not configured {{(pid=75014) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 08 04:16:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-002b3e86-afce-4a04-b4f3-84c7f59bfc7b tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] finish_migration finished successfully. {{(pid=75014) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 08 04:16:51 user nova-compute[75014]: DEBUG nova.compute.manager [req-631a23eb-9bf1-426b-8888-787bb0873713 req-195b72be-1fa5-4316-8d58-a51a0b7bb802 service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Received event network-vif-plugged-80b71c76-357d-449c-8c5c-a1b28b1e6756 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:16:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-631a23eb-9bf1-426b-8888-787bb0873713 req-195b72be-1fa5-4316-8d58-a51a0b7bb802 service nova] Acquiring lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:16:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-631a23eb-9bf1-426b-8888-787bb0873713 req-195b72be-1fa5-4316-8d58-a51a0b7bb802 service nova] Lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:16:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-631a23eb-9bf1-426b-8888-787bb0873713 req-195b72be-1fa5-4316-8d58-a51a0b7bb802 service nova] Lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:16:51 user nova-compute[75014]: DEBUG nova.compute.manager [req-631a23eb-9bf1-426b-8888-787bb0873713 req-195b72be-1fa5-4316-8d58-a51a0b7bb802 service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] No waiting events found dispatching network-vif-plugged-80b71c76-357d-449c-8c5c-a1b28b1e6756 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:16:51 user nova-compute[75014]: WARNING nova.compute.manager [req-631a23eb-9bf1-426b-8888-787bb0873713 req-195b72be-1fa5-4316-8d58-a51a0b7bb802 service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Received unexpected event network-vif-plugged-80b71c76-357d-449c-8c5c-a1b28b1e6756 for instance with vm_state active and task_state resize_finish.
Nov 08 04:16:52 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:16:52 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:16:52 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=8324MB free_disk=24.945159912109375GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:16:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:16:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:16:52 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Applying migration context for instance 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7 as it has an incoming, in-progress migration ce68e787-c0f2-4dda-b99d-6645a231f3ae. Migration status is finished {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 04:16:52 user nova-compute[75014]: INFO nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Updating resource usage from migration ce68e787-c0f2-4dda-b99d-6645a231f3ae
Nov 08 04:16:52 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance c23c9e00-b782-4530-bb01-a7a167951c1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:16:52 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 077303d8-0afd-4c60-ad9a-1bd29bff4d2d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:16:52 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 01754a6d-8f7b-46ad-b166-defe74eb9dd0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:16:52 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:16:52 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Migration ce68e787-c0f2-4dda-b99d-6645a231f3ae is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 08 04:16:52 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:16:52 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:16:52 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:16:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:52 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:16:52 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:16:52 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:16:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.627s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:16:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:53 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:16:53 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:16:55 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:16:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:16:59 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_power_states {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:16:59 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid c23c9e00-b782-4530-bb01-a7a167951c1d {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 04:16:59 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid 077303d8-0afd-4c60-ad9a-1bd29bff4d2d {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 04:16:59 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid 01754a6d-8f7b-46ad-b166-defe74eb9dd0 {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 04:16:59 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7 {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 04:16:59 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947 {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 04:16:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "c23c9e00-b782-4530-bb01-a7a167951c1d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:16:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "c23c9e00-b782-4530-bb01-a7a167951c1d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:16:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:16:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:16:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:16:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:16:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:16:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:16:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:16:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:16:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:16:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:16:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "c23c9e00-b782-4530-bb01-a7a167951c1d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:16:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:16:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:17:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:17:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:17:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:17:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:17:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:20 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:21 user nova-compute[75014]: DEBUG nova.compute.manager [req-6d061775-8c5f-4586-81b8-f0e330d0531c req-874f4e2a-2b01-4266-a286-d8ba659d05c0 service nova] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Received event network-changed-244be58f-1901-48ed-9d4e-98cb72cc9758 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:17:21 user nova-compute[75014]: DEBUG nova.compute.manager [req-6d061775-8c5f-4586-81b8-f0e330d0531c req-874f4e2a-2b01-4266-a286-d8ba659d05c0 service nova] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Refreshing instance network info cache due to event network-changed-244be58f-1901-48ed-9d4e-98cb72cc9758. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:17:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-6d061775-8c5f-4586-81b8-f0e330d0531c req-874f4e2a-2b01-4266-a286-d8ba659d05c0 service nova] Acquiring lock "refresh_cache-b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:17:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-6d061775-8c5f-4586-81b8-f0e330d0531c req-874f4e2a-2b01-4266-a286-d8ba659d05c0 service nova] Acquired lock "refresh_cache-b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:17:21 user nova-compute[75014]: DEBUG nova.network.neutron [req-6d061775-8c5f-4586-81b8-f0e330d0531c req-874f4e2a-2b01-4266-a286-d8ba659d05c0 service nova] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Refreshing network info cache for port 244be58f-1901-48ed-9d4e-98cb72cc9758 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:17:21 user nova-compute[75014]: DEBUG nova.network.neutron [req-6d061775-8c5f-4586-81b8-f0e330d0531c req-874f4e2a-2b01-4266-a286-d8ba659d05c0 service nova] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Updated VIF entry in instance network info cache for port 244be58f-1901-48ed-9d4e-98cb72cc9758. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:17:21 user nova-compute[75014]: DEBUG nova.network.neutron [req-6d061775-8c5f-4586-81b8-f0e330d0531c req-874f4e2a-2b01-4266-a286-d8ba659d05c0 service nova] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Updating instance_info_cache with network_info: [{"id": "244be58f-1901-48ed-9d4e-98cb72cc9758", "address": "fa:16:3e:83:ac:1c", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244be58f-19", "ovs_interfaceid": "244be58f-1901-48ed-9d4e-98cb72cc9758", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:17:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-6d061775-8c5f-4586-81b8-f0e330d0531c req-874f4e2a-2b01-4266-a286-d8ba659d05c0 service nova] Releasing lock "refresh_cache-b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:17:21 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquiring lock "9edd3f37-b2c5-48ba-96ec-8f8f39975875" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:17:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "9edd3f37-b2c5-48ba-96ec-8f8f39975875" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:17:25 user nova-compute[75014]: DEBUG nova.compute.manager [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 04:17:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:17:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:17:26 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 04:17:26 user nova-compute[75014]: INFO nova.compute.claims [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Claim successful on node user
Nov 08 04:17:26 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:17:26 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:17:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:17:26 user nova-compute[75014]: DEBUG nova.compute.manager [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 04:17:26 user nova-compute[75014]: DEBUG nova.compute.manager [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 04:17:26 user nova-compute[75014]: DEBUG nova.network.neutron [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 04:17:26 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 04:17:26 user nova-compute[75014]: DEBUG nova.compute.manager [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 04:17:26 user nova-compute[75014]: DEBUG nova.policy [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c1e37c55e4674f339ead74243d89e9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bff47d48dd4d64bdfa4c4e60d04d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 04:17:27 user nova-compute[75014]: DEBUG nova.compute.manager [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 04:17:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 04:17:27 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Creating image(s)
Nov 08 04:17:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquiring lock "/opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:17:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "/opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:17:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "/opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:17:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:17:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.199s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:17:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:17:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:17:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:17:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.191s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:17:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:17:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk 1073741824" returned: 0 in 0.066s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:17:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:17:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:17:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.199s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:17:27 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 04:17:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:17:27 user nova-compute[75014]: DEBUG nova.network.neutron [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Successfully created port: 90d4a51e-8558-4326-b2c4-b29e584ba8e4 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 04:17:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:17:27 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Cannot resize image /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 04:17:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 04:17:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Ensure instance console log exists: /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:17:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:17:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:17:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:17:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.objects.instance [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lazy-loading 'flavor' on Instance uuid b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:17:28 user nova-compute[75014]: INFO nova.compute.manager [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Attaching volume a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf to /dev/vdb
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.network.neutron [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Successfully updated port: 90d4a51e-8558-4326-b2c4-b29e584ba8e4 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquiring lock "refresh_cache-9edd3f37-b2c5-48ba-96ec-8f8f39975875" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquired lock "refresh_cache-9edd3f37-b2c5-48ba-96ec-8f8f39975875" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.network.neutron [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG os_brick.utils [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.compute.manager [req-77ac5c32-e506-4a9e-9ef2-b4756079d5eb req-fb5bf6b6-2cb6-4a10-98bb-189f70586a3d service nova] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Received event network-changed-90d4a51e-8558-4326-b2c4-b29e584ba8e4 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.compute.manager [req-77ac5c32-e506-4a9e-9ef2-b4756079d5eb req-fb5bf6b6-2cb6-4a10-98bb-189f70586a3d service nova] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Refreshing instance network info cache due to event network-changed-90d4a51e-8558-4326-b2c4-b29e584ba8e4. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-77ac5c32-e506-4a9e-9ef2-b4756079d5eb req-fb5bf6b6-2cb6-4a10-98bb-189f70586a3d service nova] Acquiring lock "refresh_cache-9edd3f37-b2c5-48ba-96ec-8f8f39975875" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e95e8f8-a322-4717-9629-af77dd7a3930]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e7fa83-582e-4b3d-a147-0ad4b9fb188a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d4ca88-8bb1-4ac8-b02d-3696a50a8b0d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcd800f-32aa-483b-84f6-a05d72b21132]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.network.neutron [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:17:28 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:17:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bda7a05-bd74-44c4-9e7b-f137bcd30470]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG os_brick.utils [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Updating existing volume attachment record: 5c846caf-fe51-46ca-84b9-cc0d44101fae {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.network.neutron [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Updating instance_info_cache with network_info: [{"id": "90d4a51e-8558-4326-b2c4-b29e584ba8e4", "address": "fa:16:3e:b8:c7:f9", "network": {"id": "4d522d89-a309-4855-b48c-eb20e3a7cdea", "bridge": "br-int", "label": "tempest-TestStampPattern-1021360457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bff47d48dd4d64bdfa4c4e60d04d60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90d4a51e-85", "ovs_interfaceid": "90d4a51e-8558-4326-b2c4-b29e584ba8e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Releasing lock "refresh_cache-9edd3f37-b2c5-48ba-96ec-8f8f39975875" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.compute.manager [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Instance network_info: |[{"id": "90d4a51e-8558-4326-b2c4-b29e584ba8e4", "address": "fa:16:3e:b8:c7:f9", "network": {"id": "4d522d89-a309-4855-b48c-eb20e3a7cdea", "bridge": "br-int", "label": "tempest-TestStampPattern-1021360457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bff47d48dd4d64bdfa4c4e60d04d60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90d4a51e-85", "ovs_interfaceid": "90d4a51e-8558-4326-b2c4-b29e584ba8e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-77ac5c32-e506-4a9e-9ef2-b4756079d5eb req-fb5bf6b6-2cb6-4a10-98bb-189f70586a3d service nova] Acquired lock "refresh_cache-9edd3f37-b2c5-48ba-96ec-8f8f39975875" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.network.neutron [req-77ac5c32-e506-4a9e-9ef2-b4756079d5eb req-fb5bf6b6-2cb6-4a10-98bb-189f70586a3d service nova] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Refreshing network info cache for port 90d4a51e-8558-4326-b2c4-b29e584ba8e4 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Start _get_guest_xml network_info=[{"id": "90d4a51e-8558-4326-b2c4-b29e584ba8e4", "address": "fa:16:3e:b8:c7:f9", "network": {"id": "4d522d89-a309-4855-b48c-eb20e3a7cdea", "bridge": "br-int", "label": "tempest-TestStampPattern-1021360457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bff47d48dd4d64bdfa4c4e60d04d60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90d4a51e-85", "ovs_interfaceid": "90d4a51e-8558-4326-b2c4-b29e584ba8e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:17:28 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:17:28 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:17:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1968017281',display_name='tempest-TestStampPattern-server-1968017281',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1968017281',id=43,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjAWwzwaU6mM0uAVsf8M4MDogDeVam7U1Q9qZmbmnyN2kPP3EA+mz3AuKWhN3KvaKw+FEfwvQyWF60LDgsm9usmH03QvjairlAc6n6xpMsjt7JR9DxroHR+P7DjVWteTQ==',key_name='tempest-TestStampPattern-1058561610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11bff47d48dd4d64bdfa4c4e60d04d60',ramdisk_id='',reservation_id='r-119k9dgf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1607533786',owner_user_name='tempest-TestStampPattern-1607533786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:17:27Z,user_data=None,user_id='c1e37c55e4674f339ead74243d89e9ba',uuid=9edd3f37-b2c5-48ba-96ec-8f8f39975875,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90d4a51e-8558-4326-b2c4-b29e584ba8e4", "address": "fa:16:3e:b8:c7:f9", "network": {"id": "4d522d89-a309-4855-b48c-eb20e3a7cdea", "bridge": "br-int", "label": "tempest-TestStampPattern-1021360457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bff47d48dd4d64bdfa4c4e60d04d60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90d4a51e-85", "ovs_interfaceid": "90d4a51e-8558-4326-b2c4-b29e584ba8e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Converting VIF {"id": "90d4a51e-8558-4326-b2c4-b29e584ba8e4", "address": "fa:16:3e:b8:c7:f9", "network": {"id": "4d522d89-a309-4855-b48c-eb20e3a7cdea", "bridge": "br-int", "label": "tempest-TestStampPattern-1021360457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bff47d48dd4d64bdfa4c4e60d04d60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90d4a51e-85", "ovs_interfaceid": "90d4a51e-8558-4326-b2c4-b29e584ba8e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:c7:f9,bridge_name='br-int',has_traffic_filtering=True,id=90d4a51e-8558-4326-b2c4-b29e584ba8e4,network=Network(4d522d89-a309-4855-b48c-eb20e3a7cdea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90d4a51e-85') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.objects.instance [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lazy-loading 'pci_devices' on Instance uuid 9edd3f37-b2c5-48ba-96ec-8f8f39975875 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:17:28 user nova-compute[75014]:   <uuid>9edd3f37-b2c5-48ba-96ec-8f8f39975875</uuid>
Nov 08 04:17:28 user nova-compute[75014]:   <name>instance-0000002b</name>
Nov 08 04:17:28 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:17:28 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:17:28 user nova-compute[75014]:   <metadata>
Nov 08 04:17:28 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:17:28 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:17:28 user nova-compute[75014]:       <nova:name>tempest-TestStampPattern-server-1968017281</nova:name>
Nov 08 04:17:28 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:17:28</nova:creationTime>
Nov 08 04:17:28 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:17:28 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:17:28 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:17:28 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:17:28 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:17:28 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:17:28 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:17:28 user nova-compute[75014]:       <nova:owner>
Nov 08 04:17:28 user nova-compute[75014]:         <nova:user uuid="c1e37c55e4674f339ead74243d89e9ba">tempest-TestStampPattern-1607533786-project-member</nova:user>
Nov 08 04:17:28 user nova-compute[75014]:         <nova:project uuid="11bff47d48dd4d64bdfa4c4e60d04d60">tempest-TestStampPattern-1607533786</nova:project>
Nov 08 04:17:28 user nova-compute[75014]:       </nova:owner>
Nov 08 04:17:28 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:17:28 user nova-compute[75014]:       <nova:ports>
Nov 08 04:17:28 user nova-compute[75014]:         <nova:port uuid="90d4a51e-8558-4326-b2c4-b29e584ba8e4">
Nov 08 04:17:28 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 04:17:28 user nova-compute[75014]:         </nova:port>
Nov 08 04:17:28 user nova-compute[75014]:       </nova:ports>
Nov 08 04:17:28 user nova-compute[75014]:     </nova:instance>
Nov 08 04:17:28 user nova-compute[75014]:   </metadata>
Nov 08 04:17:28 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:17:28 user nova-compute[75014]:     <system>
Nov 08 04:17:28 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:17:28 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:17:28 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:17:28 user nova-compute[75014]:       <entry name="serial">9edd3f37-b2c5-48ba-96ec-8f8f39975875</entry>
Nov 08 04:17:28 user nova-compute[75014]:       <entry name="uuid">9edd3f37-b2c5-48ba-96ec-8f8f39975875</entry>
Nov 08 04:17:28 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:17:28 user nova-compute[75014]:     </system>
Nov 08 04:17:28 user nova-compute[75014]:   </sysinfo>
Nov 08 04:17:28 user nova-compute[75014]:   <os>
Nov 08 04:17:28 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:17:28 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:17:28 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:17:28 user nova-compute[75014]:   </os>
Nov 08 04:17:28 user nova-compute[75014]:   <features>
Nov 08 04:17:28 user nova-compute[75014]:     <acpi/>
Nov 08 04:17:28 user nova-compute[75014]:     <apic/>
Nov 08 04:17:28 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:17:28 user nova-compute[75014]:   </features>
Nov 08 04:17:28 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:17:28 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:17:28 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:17:28 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:17:28 user nova-compute[75014]:   </clock>
Nov 08 04:17:28 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:17:28 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:17:28 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:17:28 user nova-compute[75014]:   </cpu>
Nov 08 04:17:28 user nova-compute[75014]:   <devices>
Nov 08 04:17:28 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 04:17:28 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 04:17:28 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk"/>
Nov 08 04:17:28 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:17:28 user nova-compute[75014]:     </disk>
Nov 08 04:17:28 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:17:28 user nova-compute[75014]:       <mac address="fa:16:3e:b8:c7:f9"/>
Nov 08 04:17:28 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:17:28 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:17:28 user nova-compute[75014]:       <target dev="tap90d4a51e-85"/>
Nov 08 04:17:28 user nova-compute[75014]:     </interface>
Nov 08 04:17:28 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:17:28 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/console.log" append="off"/>
Nov 08 04:17:28 user nova-compute[75014]:     </serial>
Nov 08 04:17:28 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:17:28 user nova-compute[75014]:     <video>
Nov 08 04:17:28 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:17:28 user nova-compute[75014]:     </video>
Nov 08 04:17:28 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:17:28 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:17:28 user nova-compute[75014]:     </rng>
Nov 08 04:17:28 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:17:28 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:17:28 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:17:28 user nova-compute[75014]:     </memballoon>
Nov 08 04:17:28 user nova-compute[75014]:   </devices>
Nov 08 04:17:28 user nova-compute[75014]: </domain>
Nov 08 04:17:28 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:17:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1968017281',display_name='tempest-TestStampPattern-server-1968017281',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1968017281',id=43,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjAWwzwaU6mM0uAVsf8M4MDogDeVam7U1Q9qZmbmnyN2kPP3EA+mz3AuKWhN3KvaKw+FEfwvQyWF60LDgsm9usmH03QvjairlAc6n6xpMsjt7JR9DxroHR+P7DjVWteTQ==',key_name='tempest-TestStampPattern-1058561610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11bff47d48dd4d64bdfa4c4e60d04d60',ramdisk_id='',reservation_id='r-119k9dgf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1607533786',owner_user_name='tempest-TestStampPattern-1607533786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:17:27Z,user_data=None,user_id='c1e37c55e4674f339ead74243d89e9ba',uuid=9edd3f37-b2c5-48ba-96ec-8f8f39975875,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90d4a51e-8558-4326-b2c4-b29e584ba8e4", "address": "fa:16:3e:b8:c7:f9", "network": {"id": "4d522d89-a309-4855-b48c-eb20e3a7cdea", "bridge": "br-int", "label": "tempest-TestStampPattern-1021360457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bff47d48dd4d64bdfa4c4e60d04d60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90d4a51e-85", "ovs_interfaceid": "90d4a51e-8558-4326-b2c4-b29e584ba8e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Converting VIF {"id": "90d4a51e-8558-4326-b2c4-b29e584ba8e4", "address": "fa:16:3e:b8:c7:f9", "network": {"id": "4d522d89-a309-4855-b48c-eb20e3a7cdea", "bridge": "br-int", "label": "tempest-TestStampPattern-1021360457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bff47d48dd4d64bdfa4c4e60d04d60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90d4a51e-85", "ovs_interfaceid": "90d4a51e-8558-4326-b2c4-b29e584ba8e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:c7:f9,bridge_name='br-int',has_traffic_filtering=True,id=90d4a51e-8558-4326-b2c4-b29e584ba8e4,network=Network(4d522d89-a309-4855-b48c-eb20e3a7cdea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90d4a51e-85') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG os_vif [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:c7:f9,bridge_name='br-int',has_traffic_filtering=True,id=90d4a51e-8558-4326-b2c4-b29e584ba8e4,network=Network(4d522d89-a309-4855-b48c-eb20e3a7cdea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90d4a51e-85') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9c08841e-ef73-575b-b438-49fc524b6ded', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90d4a51e-85, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap90d4a51e-85, col_values=(('qos', UUID('0d5870e6-c21c-46ad-a11c-24783642e731')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap90d4a51e-85, col_values=(('external_ids', {'iface-id': '90d4a51e-8558-4326-b2c4-b29e584ba8e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:c7:f9', 'vm-uuid': '9edd3f37-b2c5-48ba-96ec-8f8f39975875'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:17:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:28 user nova-compute[75014]: INFO os_vif [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:c7:f9,bridge_name='br-int',has_traffic_filtering=True,id=90d4a51e-8558-4326-b2c4-b29e584ba8e4,network=Network(4d522d89-a309-4855-b48c-eb20e3a7cdea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90d4a51e-85')
Nov 08 04:17:29 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:17:29 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] No VIF found with MAC fa:16:3e:b8:c7:f9, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:17:29 user nova-compute[75014]: DEBUG nova.network.neutron [req-77ac5c32-e506-4a9e-9ef2-b4756079d5eb req-fb5bf6b6-2cb6-4a10-98bb-189f70586a3d service nova] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Updated VIF entry in instance network info cache for port 90d4a51e-8558-4326-b2c4-b29e584ba8e4. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:17:29 user nova-compute[75014]: DEBUG nova.network.neutron [req-77ac5c32-e506-4a9e-9ef2-b4756079d5eb req-fb5bf6b6-2cb6-4a10-98bb-189f70586a3d service nova] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Updating instance_info_cache with network_info: [{"id": "90d4a51e-8558-4326-b2c4-b29e584ba8e4", "address": "fa:16:3e:b8:c7:f9", "network": {"id": "4d522d89-a309-4855-b48c-eb20e3a7cdea", "bridge": "br-int", "label": "tempest-TestStampPattern-1021360457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bff47d48dd4d64bdfa4c4e60d04d60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90d4a51e-85", "ovs_interfaceid": "90d4a51e-8558-4326-b2c4-b29e584ba8e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:17:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-77ac5c32-e506-4a9e-9ef2-b4756079d5eb req-fb5bf6b6-2cb6-4a10-98bb-189f70586a3d service nova] Releasing lock "refresh_cache-9edd3f37-b2c5-48ba-96ec-8f8f39975875" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:17:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:30 user nova-compute[75014]: DEBUG nova.compute.manager [req-2b55df03-2f6c-44bd-9c2d-cfb6f656f4d5 req-94bd79b9-9ae7-485e-93b7-fbd2f261c70c service nova] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Received event network-vif-plugged-90d4a51e-8558-4326-b2c4-b29e584ba8e4 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:17:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2b55df03-2f6c-44bd-9c2d-cfb6f656f4d5 req-94bd79b9-9ae7-485e-93b7-fbd2f261c70c service nova] Acquiring lock "9edd3f37-b2c5-48ba-96ec-8f8f39975875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:17:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2b55df03-2f6c-44bd-9c2d-cfb6f656f4d5 req-94bd79b9-9ae7-485e-93b7-fbd2f261c70c service nova] Lock "9edd3f37-b2c5-48ba-96ec-8f8f39975875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:17:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2b55df03-2f6c-44bd-9c2d-cfb6f656f4d5 req-94bd79b9-9ae7-485e-93b7-fbd2f261c70c service nova] Lock "9edd3f37-b2c5-48ba-96ec-8f8f39975875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:17:30 user nova-compute[75014]: DEBUG nova.compute.manager [req-2b55df03-2f6c-44bd-9c2d-cfb6f656f4d5 req-94bd79b9-9ae7-485e-93b7-fbd2f261c70c service nova] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] No waiting events found dispatching network-vif-plugged-90d4a51e-8558-4326-b2c4-b29e584ba8e4 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:17:30 user nova-compute[75014]: WARNING nova.compute.manager [req-2b55df03-2f6c-44bd-9c2d-cfb6f656f4d5 req-94bd79b9-9ae7-485e-93b7-fbd2f261c70c service nova] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Received unexpected event network-vif-plugged-90d4a51e-8558-4326-b2c4-b29e584ba8e4 for instance with vm_state building and task_state spawning.
Nov 08 04:17:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:32 user nova-compute[75014]: DEBUG nova.compute.manager [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:17:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 04:17:32 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Instance spawned successfully.
Nov 08 04:17:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 04:17:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:17:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:17:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:17:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:17:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:17:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:17:32 user nova-compute[75014]: DEBUG nova.compute.manager [req-e7237eca-c8cb-45b3-8e32-05c2af812677 req-ef1dc4a2-3536-4102-b877-eaa0f2de1a91 service nova] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Received event network-vif-plugged-90d4a51e-8558-4326-b2c4-b29e584ba8e4 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:17:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e7237eca-c8cb-45b3-8e32-05c2af812677 req-ef1dc4a2-3536-4102-b877-eaa0f2de1a91 service nova] Acquiring lock "9edd3f37-b2c5-48ba-96ec-8f8f39975875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:17:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e7237eca-c8cb-45b3-8e32-05c2af812677 req-ef1dc4a2-3536-4102-b877-eaa0f2de1a91 service nova] Lock "9edd3f37-b2c5-48ba-96ec-8f8f39975875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:17:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e7237eca-c8cb-45b3-8e32-05c2af812677 req-ef1dc4a2-3536-4102-b877-eaa0f2de1a91 service nova] Lock "9edd3f37-b2c5-48ba-96ec-8f8f39975875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:17:32 user nova-compute[75014]: DEBUG nova.compute.manager [req-e7237eca-c8cb-45b3-8e32-05c2af812677 req-ef1dc4a2-3536-4102-b877-eaa0f2de1a91 service nova] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] No waiting events found dispatching network-vif-plugged-90d4a51e-8558-4326-b2c4-b29e584ba8e4 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:17:32 user nova-compute[75014]: WARNING nova.compute.manager [req-e7237eca-c8cb-45b3-8e32-05c2af812677 req-ef1dc4a2-3536-4102-b877-eaa0f2de1a91 service nova] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Received unexpected event network-vif-plugged-90d4a51e-8558-4326-b2c4-b29e584ba8e4 for instance with vm_state building and task_state spawning.
Nov 08 04:17:32 user nova-compute[75014]: INFO nova.compute.manager [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Took 5.79 seconds to spawn the instance on the hypervisor.
Nov 08 04:17:32 user nova-compute[75014]: DEBUG nova.compute.manager [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:17:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:33 user nova-compute[75014]: INFO nova.compute.manager [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Took 7.24 seconds to build instance.
Nov 08 04:17:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-ccd66a73-f696-4568-a487-81bf0d822ede tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "9edd3f37-b2c5-48ba-96ec-8f8f39975875" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.392s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:17:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:42 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:17:42 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:17:43 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:17:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:17:45 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:17:45 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:17:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:17:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:17:45 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 04:17:45 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Updating instance_info_cache with network_info: [{"id": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "address": "fa:16:3e:61:82:36", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b71c76-35", "ovs_interfaceid": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:17:45 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:17:45 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 04:17:46 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:17:47 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:17:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:51 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:17:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:17:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.008s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:17:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:17:51 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:17:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:17:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:17:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:17:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:17:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:17:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:17:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:17:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:17:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:17:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:17:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:17:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:17:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:17:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:17:52 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:17:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:17:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:17:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:17:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:17:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:17:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:17:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:17:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:54 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:17:54 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:17:54 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=8042MB free_disk=24.90450668334961GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:17:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:17:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:17:54 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Applying migration context for instance 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7 as it has an incoming, in-progress migration ce68e787-c0f2-4dda-b99d-6645a231f3ae. Migration status is finished {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 04:17:54 user nova-compute[75014]: INFO nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Updating resource usage from migration ce68e787-c0f2-4dda-b99d-6645a231f3ae
Nov 08 04:17:54 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance c23c9e00-b782-4530-bb01-a7a167951c1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:17:54 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 077303d8-0afd-4c60-ad9a-1bd29bff4d2d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:17:54 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 01754a6d-8f7b-46ad-b166-defe74eb9dd0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:17:54 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:17:54 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Migration ce68e787-c0f2-4dda-b99d-6645a231f3ae is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 08 04:17:54 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:17:54 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9edd3f37-b2c5-48ba-96ec-8f8f39975875 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:17:54 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:17:54 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:17:54 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:17:54 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:17:54 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:17:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.424s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:17:55 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:17:55 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:17:56 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:17:57 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:17:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:17:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:18:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2c9541b3-2672-4837-87c5-d8364ecb102e tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:18:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2c9541b3-2672-4837-87c5-d8364ecb102e tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:18:01 user nova-compute[75014]: DEBUG nova.compute.manager [None req-2c9541b3-2672-4837-87c5-d8364ecb102e tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Going to confirm migration 1 {{(pid=75014) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 08 04:18:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2c9541b3-2672-4837-87c5-d8364ecb102e tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "refresh_cache-9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:18:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2c9541b3-2672-4837-87c5-d8364ecb102e tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquired lock "refresh_cache-9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:18:01 user nova-compute[75014]: DEBUG nova.network.neutron [None req-2c9541b3-2672-4837-87c5-d8364ecb102e tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:18:01 user nova-compute[75014]: DEBUG nova.objects.instance [None req-2c9541b3-2672-4837-87c5-d8364ecb102e tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lazy-loading 'info_cache' on Instance uuid 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:18:02 user nova-compute[75014]: DEBUG nova.network.neutron [None req-2c9541b3-2672-4837-87c5-d8364ecb102e tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Updating instance_info_cache with network_info: [{"id": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "address": "fa:16:3e:61:82:36", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b71c76-35", "ovs_interfaceid": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:18:02 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2c9541b3-2672-4837-87c5-d8364ecb102e tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Releasing lock "refresh_cache-9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:18:02 user nova-compute[75014]: DEBUG nova.objects.instance [None req-2c9541b3-2672-4837-87c5-d8364ecb102e tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lazy-loading 'migration_context' on Instance uuid 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:18:02 user nova-compute[75014]: DEBUG nova.objects.base [None req-2c9541b3-2672-4837-87c5-d8364ecb102e tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Object Instance<9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7> lazy-loaded attributes: info_cache,migration_context {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:18:02 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2c9541b3-2672-4837-87c5-d8364ecb102e tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:18:02 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2c9541b3-2672-4837-87c5-d8364ecb102e tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:18:02 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-2c9541b3-2672-4837-87c5-d8364ecb102e tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:18:02 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-2c9541b3-2672-4837-87c5-d8364ecb102e tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:18:02 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2c9541b3-2672-4837-87c5-d8364ecb102e tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.293s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:18:02 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-2c9541b3-2672-4837-87c5-d8364ecb102e tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Deleted allocation for migration ce68e787-c0f2-4dda-b99d-6645a231f3ae
Nov 08 04:18:02 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2c9541b3-2672-4837-87c5-d8364ecb102e tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.704s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:18:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:18:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:18:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:18:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:18:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:18:24 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:18:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:18:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uIQyYMEv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:18:26 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:18:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:18:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:18:26 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:18:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:18:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:18:26 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:18:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9090b24f-ab90-4df3-8159-a9fe0ca9ee42]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:18:27 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad575557-ffd1-4cdd-9889-4b29af45fe8d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf] added
Nov 08 04:18:27 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1faf942-213a-4b21-97d9-3b072bd2ee36]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6495e2f-2bca-4d9b-b229-df95706a3439]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uIQyYMEv {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uIQyYMEv" returned: 0 in 0.029s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a396bb8-6502-4faf-a6a3-b5f4835ddfcf]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uIQyYMEv'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa68e385-4720-4ea1-9936-1494f7aa70e0]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5190fc1-471e-4d66-9e3e-733132982976]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:18:27 user nova-compute[75014]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 (non-flash)
Nov 08 04:18:27 user nova-compute[75014]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:18:27 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:18:27 user nova-compute[75014]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 (non-flash)
Nov 08 04:18:27 user nova-compute[75014]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:18:27 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec31d951-5004-43ee-bf90-7f0fe67a4385]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf, portal: 172.16.0.220,3260]
Nov 08 04:18:27 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf, portal: 172.16.0.220,3260] successful.
Nov 08 04:18:27 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9d01ab-4abe-4548-80a0-eec5fbf01b70]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[df79897c-d174-4a6a-ba94-1dbcba7e3352]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:18:27 user nova-compute[75014]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 (non-flash)
Nov 08 04:18:27 user nova-compute[75014]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:18:27 user nova-compute[75014]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf (non-flash)
Nov 08 04:18:27 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:18:27 user nova-compute[75014]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 (non-flash)
Nov 08 04:18:27 user nova-compute[75014]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:18:27 user nova-compute[75014]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf (non-flash)
Nov 08 04:18:27 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[963c4884-937f-43a0-b830-fb5adfb7fce0]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:18:27 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: None {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:18:28 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:18:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uIQyYMEv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:18:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:18:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '26464343839653934', 'path': '/dev/sdc'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:18:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464343839653934', 'path': '/dev/sdc'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:18:28 user nova-compute[75014]: DEBUG nova.objects.instance [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lazy-loading 'flavor' on Instance uuid b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:18:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 04:18:28 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:18:28 user nova-compute[75014]:   <source dev="/dev/sdc"/>
Nov 08 04:18:28 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:18:28 user nova-compute[75014]:   <serial>a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf</serial>
Nov 08 04:18:28 user nova-compute[75014]: </disk>
Nov 08 04:18:28 user nova-compute[75014]:  {{(pid=75014) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 04:18:29 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:18:29 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:18:29 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] No VIF found with MAC fa:16:3e:83:ac:1c, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:18:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:18:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:18:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:18:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:18:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:18:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:18:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-bcd816ab-d482-4593-99ff-af044a95baaf tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 60.896s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:18:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:18:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:18:42 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Acquiring lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:18:42 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:18:42 user nova-compute[75014]: INFO nova.compute.manager [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Detaching volume 05dfb807-9eb5-4100-ad23-30706035cdb3
Nov 08 04:18:42 user nova-compute[75014]: INFO nova.virt.block_device [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Attempting to driver detach volume 05dfb807-9eb5-4100-ad23-30706035cdb3 from mountpoint /dev/vdb
Nov 08 04:18:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Attempting to detach device vdb from instance 01754a6d-8f7b-46ad-b166-defe74eb9dd0 from the persistent domain config. {{(pid=75014) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 04:18:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:18:42 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:18:42 user nova-compute[75014]:   <source dev="/dev/sde"/>
Nov 08 04:18:42 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:18:42 user nova-compute[75014]:   <serial>05dfb807-9eb5-4100-ad23-30706035cdb3</serial>
Nov 08 04:18:42 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:18:42 user nova-compute[75014]: </disk>
Nov 08 04:18:42 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:18:42 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Successfully detached device vdb from instance 01754a6d-8f7b-46ad-b166-defe74eb9dd0 from the persistent domain config.
Nov 08 04:18:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 01754a6d-8f7b-46ad-b166-defe74eb9dd0 from the live domain config. {{(pid=75014) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 04:18:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:18:42 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:18:42 user nova-compute[75014]:   <source dev="/dev/sde"/>
Nov 08 04:18:42 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:18:42 user nova-compute[75014]:   <serial>05dfb807-9eb5-4100-ad23-30706035cdb3</serial>
Nov 08 04:18:42 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:18:42 user nova-compute[75014]: </disk>
Nov 08 04:18:42 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:18:42 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:18:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 01754a6d-8f7b-46ad-b166-defe74eb9dd0 {{(pid=75014) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 04:18:43 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:18:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:18:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:18:43 user nova-compute[75014]: DEBUG nova.objects.instance [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lazy-loading 'flavor' on Instance uuid b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:18:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:18:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:18:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:18:44 user nova-compute[75014]: INFO nova.compute.manager [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Attaching volume a10a1711-c813-4086-8f0f-3eff91f6713c to /dev/vdc
Nov 08 04:18:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:18:44 user nova-compute[75014]: DEBUG os_brick.utils [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:18:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:18:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:18:44 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f01a4b-7459-4659-882a-e1c868107b52]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:18:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:18:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:18:44 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43b792d-95ed-4cab-b672-a878cebe82f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:18:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:18:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:18:44 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13cf580-bdf7-422b-8646-ef62018ade3a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:18:44 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74afc82-7f2f-4bbb-8923-8b01b12e7fcf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:18:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:18:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:18:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:18:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:18:44 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:18:44 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:18:44 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0ca3de-7454-4ba4-9140-7de65d32e2ae]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:18:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:18:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:18:44 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:18:44 user nova-compute[75014]: DEBUG os_brick.utils [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:18:44 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Updating existing volume attachment record: d5a41fb6-d6b8-4751-bfbd-0c3d5ffac827 {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:18:45 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:18:46 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:18:46 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:18:46 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Didn't find any instances for network info cache update. {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 04:18:48 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:18:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:18:49 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:18:52 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:18:52 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:18:53 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:18:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:18:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:18:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:18:53 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:18:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:18:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:18:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:18:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:18:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:18:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:18:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:18:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:18:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:18:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:18:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:18:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:18:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:18:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:18:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:18:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:18:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:18:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:18:55 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:18:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:18:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:18:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:18:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:18:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:18:55 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:18:55 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:18:55 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=8158MB free_disk=24.891895294189453GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:18:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:18:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:18:56 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance c23c9e00-b782-4530-bb01-a7a167951c1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:18:56 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 077303d8-0afd-4c60-ad9a-1bd29bff4d2d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:18:56 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 01754a6d-8f7b-46ad-b166-defe74eb9dd0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:18:56 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:18:56 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:18:56 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9edd3f37-b2c5-48ba-96ec-8f8f39975875 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:18:56 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:18:56 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:18:56 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:18:56 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:18:56 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:18:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.479s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:18:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:19:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:19:01 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:19:02 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 01754a6d-8f7b-46ad-b166-defe74eb9dd0 is timed out.
Nov 08 04:19:02 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Successfully detached device vdb from instance 01754a6d-8f7b-46ad-b166-defe74eb9dd0 from the live domain config.
Nov 08 04:19:02 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bOPUwtjL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:19:02 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:19:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3a931f-fb47-4239-bf17-f2c4165c1402]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:19:02 user nova-compute[75014]: No targets found.
Nov 08 04:19:02 user nova-compute[75014]: iSNS:
Nov 08 04:19:02 user nova-compute[75014]: No targets found.
Nov 08 04:19:02 user nova-compute[75014]: STATIC:
Nov 08 04:19:02 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:19:02 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:19:02 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:19:02 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf
Nov 08 04:19:02 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:19:02 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:19:02 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3
Nov 08 04:19:02 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:19:02 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:19:02 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429
Nov 08 04:19:02 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:19:02 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:19:02 user nova-compute[75014]: FIRMWARE:
Nov 08 04:19:02 user nova-compute[75014]: No targets found.
Nov 08 04:19:02 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:19:02 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:19:02 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[69527071-e211-4f76-b29d-4f59747a5e60]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be17b2b-15c5-446b-8702-da1cd68269bb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:19:02 user nova-compute[75014]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 (non-flash)
Nov 08 04:19:02 user nova-compute[75014]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:19:02 user nova-compute[75014]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf (non-flash)
Nov 08 04:19:02 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:19:02 user nova-compute[75014]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 (non-flash)
Nov 08 04:19:02 user nova-compute[75014]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:19:02 user nova-compute[75014]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf (non-flash)
Nov 08 04:19:02 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0400784ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3'): ({'sde'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Removing single pathed devices sde {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50d3278-07e3-4528-965c-556af051f739]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4230928-2657-4f6a-8618-107c0383cfaa]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Flushing IO for device /dev/sde {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b613bec-e531-4368-96b7-bd565e68a292]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a3034b-0d41-4c25-9c7c-1de3fe1a1924]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] SCSI volumes sde have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6aac1d7-398e-46bb-a496-f06c0a4c8a9d]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:19:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:03 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:03 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2f2a3c-c85a-4f11-aa0b-895f5d74cbdb]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:03 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3, portal: 172.16.0.220,3260]
Nov 08 04:19:03 user nova-compute[75014]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3, portal: 172.16.0.220,3260] successful.
Nov 08 04:19:03 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:19:03 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:03 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05dfb807-9eb5-4100-ad23-30706035cdb3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:03 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[525719c8-812d-44f4-83da-fa2343091c42]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:03 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:19:03 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:19:03 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] <== disconnect_volume: return (329ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:19:03 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:19:03 user nova-compute[75014]: DEBUG nova.objects.instance [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lazy-loading 'flavor' on Instance uuid 01754a6d-8f7b-46ad-b166-defe74eb9dd0 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:19:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d1273b1e-5bd3-4988-81d4-a7075055ad67 tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.891s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:19:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:19:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:19:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:19:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:19:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:19:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:19:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:19:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:19:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:19:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YUygrAPX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:19:17 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:19:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:19:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:19:17 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:19:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:19:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:19:17 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:19:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:17 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0bf022-e20b-458a-8993-d66da475b036]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:19:17 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:19:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e06057-c59a-45b4-affb-53540935e683]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c] added
Nov 08 04:19:18 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d5a068-47ab-47b8-b55a-00f36d02f287]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG nova.compute.manager [req-4e341d44-fb08-4cf1-bca0-7be87efddc17 req-da1aab8e-ec83-4a3f-8420-83182b7c09ce service nova] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Received event network-changed-90d4a51e-8558-4326-b2c4-b29e584ba8e4 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG nova.compute.manager [req-4e341d44-fb08-4cf1-bca0-7be87efddc17 req-da1aab8e-ec83-4a3f-8420-83182b7c09ce service nova] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Refreshing instance network info cache due to event network-changed-90d4a51e-8558-4326-b2c4-b29e584ba8e4. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4e341d44-fb08-4cf1-bca0-7be87efddc17 req-da1aab8e-ec83-4a3f-8420-83182b7c09ce service nova] Acquiring lock "refresh_cache-9edd3f37-b2c5-48ba-96ec-8f8f39975875" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4e341d44-fb08-4cf1-bca0-7be87efddc17 req-da1aab8e-ec83-4a3f-8420-83182b7c09ce service nova] Acquired lock "refresh_cache-9edd3f37-b2c5-48ba-96ec-8f8f39975875" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG nova.network.neutron [req-4e341d44-fb08-4cf1-bca0-7be87efddc17 req-da1aab8e-ec83-4a3f-8420-83182b7c09ce service nova] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Refreshing network info cache for port 90d4a51e-8558-4326-b2c4-b29e584ba8e4 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8392786a-55fa-48c1-8126-16621218bcb9]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YUygrAPX {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YUygrAPX" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa92fe1-531c-49f7-9986-940488475411]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YUygrAPX'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[10852316-ca83-48b9-8c03-28542f13e4ea]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae51d72-b9a3-4c3f-bcb5-516f1ab76154]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:19:18 user nova-compute[75014]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:19:18 user nova-compute[75014]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf (non-flash)
Nov 08 04:19:18 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:19:18 user nova-compute[75014]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:19:18 user nova-compute[75014]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf (non-flash)
Nov 08 04:19:18 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8aa5819-56d6-42d0-b3b1-b4a569b3c50a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c, portal: 172.16.0.220,3260]
Nov 08 04:19:18 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c, portal: 172.16.0.220,3260] successful.
Nov 08 04:19:18 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa460771-17ff-4eac-a2ff-ab008035d450]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71c3974-b7bc-4e3c-a72e-8b471146123e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:19:18 user nova-compute[75014]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:19:18 user nova-compute[75014]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf (non-flash)
Nov 08 04:19:18 user nova-compute[75014]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c (non-flash)
Nov 08 04:19:18 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:19:18 user nova-compute[75014]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:19:18 user nova-compute[75014]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf (non-flash)
Nov 08 04:19:18 user nova-compute[75014]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c (non-flash)
Nov 08 04:19:18 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e20df76-b851-4f41-ba2e-977fed2755f2]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YUygrAPX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG nova.network.neutron [req-4e341d44-fb08-4cf1-bca0-7be87efddc17 req-da1aab8e-ec83-4a3f-8420-83182b7c09ce service nova] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Updated VIF entry in instance network info cache for port 90d4a51e-8558-4326-b2c4-b29e584ba8e4. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG nova.network.neutron [req-4e341d44-fb08-4cf1-bca0-7be87efddc17 req-da1aab8e-ec83-4a3f-8420-83182b7c09ce service nova] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Updating instance_info_cache with network_info: [{"id": "90d4a51e-8558-4326-b2c4-b29e584ba8e4", "address": "fa:16:3e:b8:c7:f9", "network": {"id": "4d522d89-a309-4855-b48c-eb20e3a7cdea", "bridge": "br-int", "label": "tempest-TestStampPattern-1021360457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bff47d48dd4d64bdfa4c4e60d04d60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90d4a51e-85", "ovs_interfaceid": "90d4a51e-8558-4326-b2c4-b29e584ba8e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4e341d44-fb08-4cf1-bca0-7be87efddc17 req-da1aab8e-ec83-4a3f-8420-83182b7c09ce service nova] Releasing lock "refresh_cache-9edd3f37-b2c5-48ba-96ec-8f8f39975875" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquiring lock "9edd3f37-b2c5-48ba-96ec-8f8f39975875" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "9edd3f37-b2c5-48ba-96ec-8f8f39975875" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG nova.objects.instance [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lazy-loading 'flavor' on Instance uuid 9edd3f37-b2c5-48ba-96ec-8f8f39975875 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "9edd3f37-b2c5-48ba-96ec-8f8f39975875" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquiring lock "9edd3f37-b2c5-48ba-96ec-8f8f39975875" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "9edd3f37-b2c5-48ba-96ec-8f8f39975875" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:19:18 user nova-compute[75014]: INFO nova.compute.manager [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Attaching volume ac339de5-8b4f-4ed7-b833-87e6e149fbda to /dev/vdb
Nov 08 04:19:18 user nova-compute[75014]: DEBUG os_brick.utils [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0873af70-139b-4edf-9fd6-16fed4520701]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfaea20-bf26-4f4d-a3c0-15a40883ca8f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0447cba-65b2-46d0-8c5f-bab7303c4bed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[431bd266-f1dd-49e9-afeb-4fe002a3b842]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:19:18 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:19:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[428dad72-9af0-4b49-8e97-f71bcce47fa7]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG os_brick.utils [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:19:18 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Updating existing volume attachment record: 0e94b332-c889-4dec-b625-df66e47db8ae {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:19:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:19:19 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:19:19 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26538653431633031', 'path': '/dev/sdd'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:19:19 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538653431633031', 'path': '/dev/sdd'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:19:19 user nova-compute[75014]: DEBUG nova.objects.instance [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lazy-loading 'flavor' on Instance uuid b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:19:19 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 04:19:19 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:19:19 user nova-compute[75014]:   <source dev="/dev/sdd"/>
Nov 08 04:19:19 user nova-compute[75014]:   <target dev="vdc" bus="virtio"/>
Nov 08 04:19:19 user nova-compute[75014]:   <serial>a10a1711-c813-4086-8f0f-3eff91f6713c</serial>
Nov 08 04:19:19 user nova-compute[75014]: </disk>
Nov 08 04:19:19 user nova-compute[75014]:  {{(pid=75014) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 04:19:19 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:19:19 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:19:19 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:19:19 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] No VIF found with MAC fa:16:3e:83:ac:1c, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:19:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2e9c20ab-61c3-4557-b221-6722fea770cc tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 35.808s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:19:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:19:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:19:20 user nova-compute[75014]: INFO nova.compute.manager [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Detaching volume a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf
Nov 08 04:19:21 user nova-compute[75014]: INFO nova.virt.block_device [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Attempting to driver detach volume a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf from mountpoint /dev/vdb
Nov 08 04:19:21 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Attempting to detach device vdb from instance b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947 from the persistent domain config. {{(pid=75014) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 04:19:21 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:19:21 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:19:21 user nova-compute[75014]:   <source dev="/dev/sdc"/>
Nov 08 04:19:21 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:19:21 user nova-compute[75014]:   <serial>a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf</serial>
Nov 08 04:19:21 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:19:21 user nova-compute[75014]: </disk>
Nov 08 04:19:21 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:19:21 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Successfully detached device vdb from instance b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947 from the persistent domain config.
Nov 08 04:19:21 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947 from the live domain config. {{(pid=75014) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 04:19:21 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:19:21 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:19:21 user nova-compute[75014]:   <source dev="/dev/sdc"/>
Nov 08 04:19:21 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:19:21 user nova-compute[75014]:   <serial>a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf</serial>
Nov 08 04:19:21 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:19:21 user nova-compute[75014]: </disk>
Nov 08 04:19:21 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:19:21 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947 {{(pid=75014) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 04:19:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:19:24 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:19:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:19:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:19:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-11210f7a-519a-48eb-8d23-1f84e355f4fd tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Acquiring lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:19:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-11210f7a-519a-48eb-8d23-1f84e355f4fd tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:19:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-11210f7a-519a-48eb-8d23-1f84e355f4fd tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Acquiring lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:19:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-11210f7a-519a-48eb-8d23-1f84e355f4fd tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:19:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-11210f7a-519a-48eb-8d23-1f84e355f4fd tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:19:32 user nova-compute[75014]: INFO nova.compute.manager [None req-11210f7a-519a-48eb-8d23-1f84e355f4fd tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Terminating instance
Nov 08 04:19:32 user nova-compute[75014]: DEBUG nova.compute.manager [None req-11210f7a-519a-48eb-8d23-1f84e355f4fd tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:19:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:19:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:19:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:19:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:19:32 user nova-compute[75014]: DEBUG nova.compute.manager [req-92661a85-501d-408e-9a09-45b1de099a28 req-f08e9de9-9666-4d65-afed-89f3cca11e4e service nova] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Received event network-vif-unplugged-a4210bed-2f6f-4c2b-ad92-fce0779168f9 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:19:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-92661a85-501d-408e-9a09-45b1de099a28 req-f08e9de9-9666-4d65-afed-89f3cca11e4e service nova] Acquiring lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:19:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-92661a85-501d-408e-9a09-45b1de099a28 req-f08e9de9-9666-4d65-afed-89f3cca11e4e service nova] Lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:19:32 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-92661a85-501d-408e-9a09-45b1de099a28 req-f08e9de9-9666-4d65-afed-89f3cca11e4e service nova] Lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:19:32 user nova-compute[75014]: DEBUG nova.compute.manager [req-92661a85-501d-408e-9a09-45b1de099a28 req-f08e9de9-9666-4d65-afed-89f3cca11e4e service nova] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] No waiting events found dispatching network-vif-unplugged-a4210bed-2f6f-4c2b-ad92-fce0779168f9 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:19:32 user nova-compute[75014]: DEBUG nova.compute.manager [req-92661a85-501d-408e-9a09-45b1de099a28 req-f08e9de9-9666-4d65-afed-89f3cca11e4e service nova] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Received event network-vif-unplugged-a4210bed-2f6f-4c2b-ad92-fce0779168f9 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:19:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:19:33 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Instance destroyed successfully.
Nov 08 04:19:33 user nova-compute[75014]: DEBUG nova.objects.instance [None req-11210f7a-519a-48eb-8d23-1f84e355f4fd tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lazy-loading 'resources' on Instance uuid 01754a6d-8f7b-46ad-b166-defe74eb9dd0 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:19:33 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-11210f7a-519a-48eb-8d23-1f84e355f4fd tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:12:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1881370906',display_name='tempest-TestServerVolumeAttachmentScenario-server-1881370906',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1881370906',id=39,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3M1sDRB0GIEtgmJ4Lbnj4DpfKwKPusqsP9tla7u4fzj1rQk1tbSp5VGsqayI1/zi4p0WIYWfUvoCtlBaP03tIoYXAgDeD4kBxhw5YOfJm6XVYVPr6pvRLB1LuQTnkFQw==',key_name='tempest-keypair-548927297',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:12:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a7e7ba2cb0b4038927288ab2157a8eb',ramdisk_id='',reservation_id='r-1svzq22d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2003968374',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2003968374-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fe1a418bca44d0ca8c5a2a9ba7777c9',uuid=01754a6d-8f7b-46ad-b166-defe74eb9dd0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4210bed-2f6f-4c2b-ad92-fce0779168f9", "address": "fa:16:3e:23:ba:ba", "network": {"id": "a5c06b2d-3ef9-4f4e-9537-b065082d1a10", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-102893709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a7e7ba2cb0b4038927288ab2157a8eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4210bed-2f", "ovs_interfaceid": "a4210bed-2f6f-4c2b-ad92-fce0779168f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:19:33 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-11210f7a-519a-48eb-8d23-1f84e355f4fd tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Converting VIF {"id": "a4210bed-2f6f-4c2b-ad92-fce0779168f9", "address": "fa:16:3e:23:ba:ba", "network": {"id": "a5c06b2d-3ef9-4f4e-9537-b065082d1a10", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-102893709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a7e7ba2cb0b4038927288ab2157a8eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4210bed-2f", "ovs_interfaceid": "a4210bed-2f6f-4c2b-ad92-fce0779168f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:19:33 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-11210f7a-519a-48eb-8d23-1f84e355f4fd tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:ba:ba,bridge_name='br-int',has_traffic_filtering=True,id=a4210bed-2f6f-4c2b-ad92-fce0779168f9,network=Network(a5c06b2d-3ef9-4f4e-9537-b065082d1a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4210bed-2f') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:19:33 user nova-compute[75014]: DEBUG os_vif [None req-11210f7a-519a-48eb-8d23-1f84e355f4fd tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:ba:ba,bridge_name='br-int',has_traffic_filtering=True,id=a4210bed-2f6f-4c2b-ad92-fce0779168f9,network=Network(a5c06b2d-3ef9-4f4e-9537-b065082d1a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4210bed-2f') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:19:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:19:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4210bed-2f, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:19:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:19:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:19:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:19:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=341c7d3d-365a-4472-a99d-9245e210cae6) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:19:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:19:33 user nova-compute[75014]: INFO os_vif [None req-11210f7a-519a-48eb-8d23-1f84e355f4fd tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:ba:ba,bridge_name='br-int',has_traffic_filtering=True,id=a4210bed-2f6f-4c2b-ad92-fce0779168f9,network=Network(a5c06b2d-3ef9-4f4e-9537-b065082d1a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4210bed-2f')
Nov 08 04:19:33 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-11210f7a-519a-48eb-8d23-1f84e355f4fd tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Deleting instance files /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0_del
Nov 08 04:19:33 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-11210f7a-519a-48eb-8d23-1f84e355f4fd tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Deletion of /opt/stack/data/nova/instances/01754a6d-8f7b-46ad-b166-defe74eb9dd0_del complete
Nov 08 04:19:33 user nova-compute[75014]: INFO nova.compute.manager [None req-11210f7a-519a-48eb-8d23-1f84e355f4fd tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 08 04:19:33 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-11210f7a-519a-48eb-8d23-1f84e355f4fd tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:19:33 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:19:33 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:19:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:19:34 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:19:34 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Took 0.67 seconds to deallocate network for instance.
Nov 08 04:19:34 user nova-compute[75014]: DEBUG nova.compute.manager [req-1cc9363d-79e2-483a-b3c3-501ded7e3103 req-b32191e3-5e0f-4a6f-bc87-8890ffa5c4a7 service nova] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Received event network-vif-deleted-a4210bed-2f6f-4c2b-ad92-fce0779168f9 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:19:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-11210f7a-519a-48eb-8d23-1f84e355f4fd tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:19:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-11210f7a-519a-48eb-8d23-1f84e355f4fd tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:19:34 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-11210f7a-519a-48eb-8d23-1f84e355f4fd tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:19:34 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-11210f7a-519a-48eb-8d23-1f84e355f4fd tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:19:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-11210f7a-519a-48eb-8d23-1f84e355f4fd tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.271s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:19:34 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-11210f7a-519a-48eb-8d23-1f84e355f4fd tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Deleted allocations for instance 01754a6d-8f7b-46ad-b166-defe74eb9dd0
Nov 08 04:19:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-11210f7a-519a-48eb-8d23-1f84e355f4fd tempest-TestServerVolumeAttachmentScenario-2003968374 tempest-TestServerVolumeAttachmentScenario-2003968374-project-member] Lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.972s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:19:34 user nova-compute[75014]: DEBUG nova.compute.manager [req-16d00955-8706-4fd1-8685-a5f4ea133997 req-42e423dd-9894-4e0d-afa6-3227f835aca7 service nova] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Received event network-vif-plugged-a4210bed-2f6f-4c2b-ad92-fce0779168f9 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:19:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-16d00955-8706-4fd1-8685-a5f4ea133997 req-42e423dd-9894-4e0d-afa6-3227f835aca7 service nova] Acquiring lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:19:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-16d00955-8706-4fd1-8685-a5f4ea133997 req-42e423dd-9894-4e0d-afa6-3227f835aca7 service nova] Lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:19:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-16d00955-8706-4fd1-8685-a5f4ea133997 req-42e423dd-9894-4e0d-afa6-3227f835aca7 service nova] Lock "01754a6d-8f7b-46ad-b166-defe74eb9dd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:19:34 user nova-compute[75014]: DEBUG nova.compute.manager [req-16d00955-8706-4fd1-8685-a5f4ea133997 req-42e423dd-9894-4e0d-afa6-3227f835aca7 service nova] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] No waiting events found dispatching network-vif-plugged-a4210bed-2f6f-4c2b-ad92-fce0779168f9 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:19:34 user nova-compute[75014]: WARNING nova.compute.manager [req-16d00955-8706-4fd1-8685-a5f4ea133997 req-42e423dd-9894-4e0d-afa6-3227f835aca7 service nova] [instance: 01754a6d-8f7b-46ad-b166-defe74eb9dd0] Received unexpected event network-vif-plugged-a4210bed-2f6f-4c2b-ad92-fce0779168f9 for instance with vm_state deleted and task_state None.
Nov 08 04:19:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:19:41 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947 is timed out.
Nov 08 04:19:41 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Successfully detached device vdb from instance b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947 from the live domain config.
Nov 08 04:19:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uIQyYMEv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:19:41 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:19:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6eaa7d4-e941-4615-968c-2afeb2fd5aa1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:19:41 user nova-compute[75014]: No targets found.
Nov 08 04:19:41 user nova-compute[75014]: iSNS:
Nov 08 04:19:41 user nova-compute[75014]: No targets found.
Nov 08 04:19:41 user nova-compute[75014]: STATIC:
Nov 08 04:19:41 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c
Nov 08 04:19:41 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:19:41 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:19:41 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:19:41 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:19:41 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:19:41 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf
Nov 08 04:19:41 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:19:41 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:19:41 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429
Nov 08 04:19:41 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:19:41 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:19:41 user nova-compute[75014]: FIRMWARE:
Nov 08 04:19:41 user nova-compute[75014]: No targets found.
Nov 08 04:19:41 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:19:41 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:19:41 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[408141f6-6376-4bbe-b3b0-9d2b67f33d86]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[78382b19-aab3-4178-8563-b9dd730d301f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:19:41 user nova-compute[75014]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:19:41 user nova-compute[75014]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf (non-flash)
Nov 08 04:19:41 user nova-compute[75014]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c (non-flash)
Nov 08 04:19:41 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:19:41 user nova-compute[75014]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:19:41 user nova-compute[75014]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf (non-flash)
Nov 08 04:19:41 user nova-compute[75014]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c (non-flash)
Nov 08 04:19:41 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0420150700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf'): ({'sdc'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Removing single pathed devices sdc {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9a9224-9c62-4fb0-a943-dacaeb2e7bbf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[13825dbb-3a16-4e9c-a6e5-598b232fb8cb]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Flushing IO for device /dev/sdc {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7829c1-89f9-4716-8ff7-f9352fa99811]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[83765273-39ae-4a3e-89fd-dc7aca9c1739]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] SCSI volumes sdc have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6a9b98-d33b-413f-a2ad-91d00833d08e]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[97dea843-29a2-4533-9da7-a9dd5b923dd4]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf, portal: 172.16.0.220,3260]
Nov 08 04:19:41 user nova-compute[75014]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf, portal: 172.16.0.220,3260] successful.
Nov 08 04:19:41 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c9c40f-8b7e-47f2-b653-1b352cb7c3cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea6b815-b587-4b0d-af04-6febe9553d7d]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] <== disconnect_volume: return (319ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:19:41 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMPbdqRt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:19:42 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:19:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:19:42 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:19:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:19:42 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a96ed8-352c-4fc3-914c-0e7bccaa420a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:19:42 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[734504d5-ee3f-4c0a-84e9-b2e1fd93e4ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda] added
Nov 08 04:19:42 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22a903c-435b-4b20-b599-7be28621a0b0]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7bb9eb-5f2b-4abb-947a-5cd1420a41f2]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zMPbdqRt {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zMPbdqRt" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e13a7e-c83b-4515-a43d-46004576c74d]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zMPbdqRt'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe06701-41fc-43d6-8afd-a0ee616a934c]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba790ce-f620-4c41-ab1d-d32704ea73e9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:19:42 user nova-compute[75014]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:19:42 user nova-compute[75014]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c (non-flash)
Nov 08 04:19:42 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:19:42 user nova-compute[75014]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:19:42 user nova-compute[75014]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c (non-flash)
Nov 08 04:19:42 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82ab054-6380-4bd7-8da2-3664df31b589]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda, portal: 172.16.0.220,3260]
Nov 08 04:19:42 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda, portal: 172.16.0.220,3260] successful.
Nov 08 04:19:42 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e503c870-31be-4391-8839-96510860675d]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c95d8d1-17fe-4f33-9bd4-583d56761011]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:19:42 user nova-compute[75014]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:19:42 user nova-compute[75014]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c (non-flash)
Nov 08 04:19:42 user nova-compute[75014]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda (non-flash)
Nov 08 04:19:42 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:19:42 user nova-compute[75014]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:19:42 user nova-compute[75014]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c (non-flash)
Nov 08 04:19:42 user nova-compute[75014]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda (non-flash)
Nov 08 04:19:42 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec363a7-427d-4f6e-949a-68ab1d652ea8]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:19:42 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMPbdqRt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:19:43 user nova-compute[75014]: DEBUG nova.objects.instance [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lazy-loading 'flavor' on Instance uuid b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:19:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4b9630d1-d304-4783-9898-27120a952b5e tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.108s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:19:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:19:43 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:19:43 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:19:43 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:19:43 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26162396134366633', 'path': '/dev/sdc'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:19:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162396134366633', 'path': '/dev/sdc'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:19:43 user nova-compute[75014]: DEBUG nova.objects.instance [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lazy-loading 'flavor' on Instance uuid 9edd3f37-b2c5-48ba-96ec-8f8f39975875 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:19:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 04:19:43 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:19:43 user nova-compute[75014]:   <source dev="/dev/sdc"/>
Nov 08 04:19:43 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:19:43 user nova-compute[75014]:   <serial>ac339de5-8b4f-4ed7-b833-87e6e149fbda</serial>
Nov 08 04:19:43 user nova-compute[75014]: </disk>
Nov 08 04:19:43 user nova-compute[75014]:  {{(pid=75014) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 04:19:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:19:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:19:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] No VIF found with MAC fa:16:3e:b8:c7:f9, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:19:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:19:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:19:43 user nova-compute[75014]: INFO nova.compute.manager [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Detaching volume a10a1711-c813-4086-8f0f-3eff91f6713c
Nov 08 04:19:44 user nova-compute[75014]: INFO nova.virt.block_device [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Attempting to driver detach volume a10a1711-c813-4086-8f0f-3eff91f6713c from mountpoint /dev/vdc
Nov 08 04:19:44 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-0da168d4-39b1-4a11-96af-e21ea5363874 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "9edd3f37-b2c5-48ba-96ec-8f8f39975875" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.233s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:19:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Attempting to detach device vdc from instance b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947 from the persistent domain config. {{(pid=75014) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 04:19:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:19:44 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:19:44 user nova-compute[75014]:   <source dev="/dev/sdd"/>
Nov 08 04:19:44 user nova-compute[75014]:   <target dev="vdc" bus="virtio"/>
Nov 08 04:19:44 user nova-compute[75014]:   <serial>a10a1711-c813-4086-8f0f-3eff91f6713c</serial>
Nov 08 04:19:44 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 04:19:44 user nova-compute[75014]: </disk>
Nov 08 04:19:44 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:19:44 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Successfully detached device vdc from instance b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947 from the persistent domain config.
Nov 08 04:19:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947 from the live domain config. {{(pid=75014) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 04:19:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:19:44 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:19:44 user nova-compute[75014]:   <source dev="/dev/sdd"/>
Nov 08 04:19:44 user nova-compute[75014]:   <target dev="vdc" bus="virtio"/>
Nov 08 04:19:44 user nova-compute[75014]:   <serial>a10a1711-c813-4086-8f0f-3eff91f6713c</serial>
Nov 08 04:19:44 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 04:19:44 user nova-compute[75014]: </disk>
Nov 08 04:19:44 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:19:44 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947 {{(pid=75014) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 04:19:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquiring lock "9edd3f37-b2c5-48ba-96ec-8f8f39975875" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:19:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "9edd3f37-b2c5-48ba-96ec-8f8f39975875" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:19:46 user nova-compute[75014]: INFO nova.compute.manager [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Detaching volume ac339de5-8b4f-4ed7-b833-87e6e149fbda
Nov 08 04:19:46 user nova-compute[75014]: INFO nova.virt.block_device [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Attempting to driver detach volume ac339de5-8b4f-4ed7-b833-87e6e149fbda from mountpoint /dev/vdb
Nov 08 04:19:46 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:19:46 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:19:46 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Rebuilding the list of instances to heal {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 04:19:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Attempting to detach device vdb from instance 9edd3f37-b2c5-48ba-96ec-8f8f39975875 from the persistent domain config. {{(pid=75014) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 04:19:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:19:46 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:19:46 user nova-compute[75014]:   <source dev="/dev/sdc"/>
Nov 08 04:19:46 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:19:46 user nova-compute[75014]:   <serial>ac339de5-8b4f-4ed7-b833-87e6e149fbda</serial>
Nov 08 04:19:46 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:19:46 user nova-compute[75014]: </disk>
Nov 08 04:19:46 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:19:46 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Successfully detached device vdb from instance 9edd3f37-b2c5-48ba-96ec-8f8f39975875 from the persistent domain config.
Nov 08 04:19:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9edd3f37-b2c5-48ba-96ec-8f8f39975875 from the live domain config. {{(pid=75014) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 04:19:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:19:46 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:19:46 user nova-compute[75014]:   <source dev="/dev/sdc"/>
Nov 08 04:19:46 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:19:46 user nova-compute[75014]:   <serial>ac339de5-8b4f-4ed7-b833-87e6e149fbda</serial>
Nov 08 04:19:46 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:19:46 user nova-compute[75014]: </disk>
Nov 08 04:19:46 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:19:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-c23c9e00-b782-4530-bb01-a7a167951c1d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:19:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-c23c9e00-b782-4530-bb01-a7a167951c1d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:19:46 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 04:19:46 user nova-compute[75014]: DEBUG nova.objects.instance [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lazy-loading 'info_cache' on Instance uuid c23c9e00-b782-4530-bb01-a7a167951c1d {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:19:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9edd3f37-b2c5-48ba-96ec-8f8f39975875 {{(pid=75014) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 04:19:46 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Updating instance_info_cache with network_info: [{"id": "4f3b192f-a567-463a-b120-1b328e11feaa", "address": "fa:16:3e:70:b6:a1", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3b192f-a5", "ovs_interfaceid": "4f3b192f-a567-463a-b120-1b328e11feaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:19:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-c23c9e00-b782-4530-bb01-a7a167951c1d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:19:46 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 04:19:46 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:19:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:19:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:19:50 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:19:50 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:19:52 user nova-compute[75014]: INFO nova.compute.manager [None req-bb0ff389-fc5a-41b5-af74-db1c23a4d28c tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Get console output
Nov 08 04:19:52 user nova-compute[75014]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 08 04:19:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:19:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:19:54 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:19:54 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:19:54 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:19:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:19:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:19:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:19:54 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:19:54 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:19:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:19:56 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:19:56 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:19:56 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:19:56 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=8404MB free_disk=24.91625213623047GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:19:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:19:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:19:56 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance c23c9e00-b782-4530-bb01-a7a167951c1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:19:56 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 077303d8-0afd-4c60-ad9a-1bd29bff4d2d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:19:56 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:19:56 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:19:56 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9edd3f37-b2c5-48ba-96ec-8f8f39975875 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:19:56 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:19:56 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:19:56 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:19:56 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:19:56 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:19:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.318s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:19:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:20:01 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:20:01 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:20:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:20:04 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947 is timed out.
Nov 08 04:20:04 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Successfully detached device vdc from instance b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947 from the live domain config.
Nov 08 04:20:04 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YUygrAPX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:20:04 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:20:04 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aedd055-ac06-454a-9a81-de1f86eb58e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:20:04 user nova-compute[75014]: No targets found.
Nov 08 04:20:04 user nova-compute[75014]: iSNS:
Nov 08 04:20:04 user nova-compute[75014]: No targets found.
Nov 08 04:20:04 user nova-compute[75014]: STATIC:
Nov 08 04:20:04 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda
Nov 08 04:20:04 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:20:04 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:20:04 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c
Nov 08 04:20:04 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:20:04 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:20:04 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:20:04 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:20:04 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:20:04 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429
Nov 08 04:20:04 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:20:04 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:20:04 user nova-compute[75014]: FIRMWARE:
Nov 08 04:20:04 user nova-compute[75014]: No targets found.
Nov 08 04:20:04 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:20:04 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:20:04 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[605bf499-52cd-4831-9b82-d3a15c2f38f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b82daa2-d1e1-4857-9d5e-81a3a39b07bb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:20:04 user nova-compute[75014]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:20:04 user nova-compute[75014]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c (non-flash)
Nov 08 04:20:04 user nova-compute[75014]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda (non-flash)
Nov 08 04:20:04 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:20:04 user nova-compute[75014]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:20:04 user nova-compute[75014]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c (non-flash)
Nov 08 04:20:04 user nova-compute[75014]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda (non-flash)
Nov 08 04:20:04 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0418362560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c'): ({'sdd'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Removing single pathed devices sdd {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb332bd-2726-435d-9fcd-fdeb57db5512]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabae77a-613e-4424-99f5-29494356f101]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Flushing IO for device /dev/sdd {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e31a83-585a-4975-a868-3eb7f27bbb0f]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f0b8cf-47f5-43db-b2fd-7a8c62b469db]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] SCSI volumes sdd have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[28692b04-ea78-4f63-b6d2-6d0ee820f6c7]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[acecb14d-7eb4-4c87-af56-45f5de27de6e]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c, portal: 172.16.0.220,3260]
Nov 08 04:20:04 user nova-compute[75014]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c, portal: 172.16.0.220,3260] successful.
Nov 08 04:20:04 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10a1711-c813-4086-8f0f-3eff91f6713c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d5473c-2fcc-4694-a655-5d16d5842234]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] <== disconnect_volume: return (293ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:20:04 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:20:05 user nova-compute[75014]: DEBUG nova.objects.instance [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lazy-loading 'flavor' on Instance uuid b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:20:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e5342541-83c0-4d7c-8ced-b9fe09d3cb62 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.766s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:20:06 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9edd3f37-b2c5-48ba-96ec-8f8f39975875 is timed out.
Nov 08 04:20:06 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Successfully detached device vdb from instance 9edd3f37-b2c5-48ba-96ec-8f8f39975875 from the live domain config.
Nov 08 04:20:06 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMPbdqRt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:20:06 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:20:06 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[015f2828-409e-4ddb-b86d-4c7411756d36]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:20:06 user nova-compute[75014]: No targets found.
Nov 08 04:20:06 user nova-compute[75014]: iSNS:
Nov 08 04:20:06 user nova-compute[75014]: No targets found.
Nov 08 04:20:06 user nova-compute[75014]: STATIC:
Nov 08 04:20:06 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda
Nov 08 04:20:06 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:20:06 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:20:06 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:20:06 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:20:06 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:20:06 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429
Nov 08 04:20:06 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:20:06 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:20:06 user nova-compute[75014]: FIRMWARE:
Nov 08 04:20:06 user nova-compute[75014]: No targets found.
Nov 08 04:20:06 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:20:06 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:20:06 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c967db5-88e3-4d62-a076-6d72171c96ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6712b7c-4c7d-4e1f-8b77-eb02cf3d4f45]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:20:06 user nova-compute[75014]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:20:06 user nova-compute[75014]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda (non-flash)
Nov 08 04:20:06 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:20:06 user nova-compute[75014]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:20:06 user nova-compute[75014]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda (non-flash)
Nov 08 04:20:06 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f04003ca5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda'): ({'sdc'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Removing single pathed devices sdc {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f0e1b9-f8fc-4855-a0d6-3e89481c426f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4967c5-8259-43d9-9ec6-c787f7714736]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Flushing IO for device /dev/sdc {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[50602253-fff5-44a6-8234-0c75666264ad]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa1de16-1ef2-496c-a53a-c7c5c9beddd8]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] SCSI volumes sdc have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:20:06 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fc9fcd-f4dd-40f3-914d-082b09523cc5]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-af9e40f2-46c9-404d-80d1-0e920c183b80 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-af9e40f2-46c9-404d-80d1-0e920c183b80 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-af9e40f2-46c9-404d-80d1-0e920c183b80 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-af9e40f2-46c9-404d-80d1-0e920c183b80 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-af9e40f2-46c9-404d-80d1-0e920c183b80 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:07 user nova-compute[75014]: INFO nova.compute.manager [None req-af9e40f2-46c9-404d-80d1-0e920c183b80 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Terminating instance
Nov 08 04:20:07 user nova-compute[75014]: DEBUG nova.compute.manager [None req-af9e40f2-46c9-404d-80d1-0e920c183b80 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c864bfa-e5ec-4361-b25d-161b58364caf]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda, portal: 172.16.0.220,3260]
Nov 08 04:20:07 user nova-compute[75014]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda, portal: 172.16.0.220,3260] successful.
Nov 08 04:20:07 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac339de5-8b4f-4ed7-b833-87e6e149fbda -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd75e968-47ae-4b5a-a877-99408ecc1ace]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] <== disconnect_volume: return (298ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG nova.compute.manager [req-5a33c71d-4f73-4e28-86ed-aef2013efe3a req-3b292335-0670-45d4-87b6-7788aa023a04 service nova] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Received event network-vif-unplugged-244be58f-1901-48ed-9d4e-98cb72cc9758 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5a33c71d-4f73-4e28-86ed-aef2013efe3a req-3b292335-0670-45d4-87b6-7788aa023a04 service nova] Acquiring lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5a33c71d-4f73-4e28-86ed-aef2013efe3a req-3b292335-0670-45d4-87b6-7788aa023a04 service nova] Lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5a33c71d-4f73-4e28-86ed-aef2013efe3a req-3b292335-0670-45d4-87b6-7788aa023a04 service nova] Lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG nova.compute.manager [req-5a33c71d-4f73-4e28-86ed-aef2013efe3a req-3b292335-0670-45d4-87b6-7788aa023a04 service nova] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] No waiting events found dispatching network-vif-unplugged-244be58f-1901-48ed-9d4e-98cb72cc9758 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG nova.compute.manager [req-5a33c71d-4f73-4e28-86ed-aef2013efe3a req-3b292335-0670-45d4-87b6-7788aa023a04 service nova] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Received event network-vif-unplugged-244be58f-1901-48ed-9d4e-98cb72cc9758 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:07 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Instance destroyed successfully.
Nov 08 04:20:07 user nova-compute[75014]: DEBUG nova.objects.instance [None req-af9e40f2-46c9-404d-80d1-0e920c183b80 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lazy-loading 'resources' on Instance uuid b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-af9e40f2-46c9-404d-80d1-0e920c183b80 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:15:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-724066621',display_name='tempest-AttachVolumeTestJSON-server-724066621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-724066621',id=42,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3wgCtbUpW/VdaoPM57u8cToy9dzJI0CouJ8uSMHon1XfXqWtmF6mk3yfkMqMQP9g7fl7rnY4xWx/VfQ5ffg5laVdkHpxh/uxIh+yPz6gjf+kHbK70d6sT8DY/KHBa9Vg==',key_name='tempest-keypair-1873922796',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:15:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b61b5c5a54c743f78e97623c26050864',ramdisk_id='',reservation_id='r-5s0m3grn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1095291946',owner_user_name='tempest-AttachVolumeTestJSON-1095291946-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:15:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8794d413cb745f2b855a808c052c8fd',uuid=b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "244be58f-1901-48ed-9d4e-98cb72cc9758", "address": "fa:16:3e:83:ac:1c", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244be58f-19", "ovs_interfaceid": "244be58f-1901-48ed-9d4e-98cb72cc9758", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-af9e40f2-46c9-404d-80d1-0e920c183b80 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Converting VIF {"id": "244be58f-1901-48ed-9d4e-98cb72cc9758", "address": "fa:16:3e:83:ac:1c", "network": {"id": "b7df3975-2e50-4d96-8a34-26abf02bea76", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1344715400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b5c5a54c743f78e97623c26050864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244be58f-19", "ovs_interfaceid": "244be58f-1901-48ed-9d4e-98cb72cc9758", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-af9e40f2-46c9-404d-80d1-0e920c183b80 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=244be58f-1901-48ed-9d4e-98cb72cc9758,network=Network(b7df3975-2e50-4d96-8a34-26abf02bea76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244be58f-19') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG os_vif [None req-af9e40f2-46c9-404d-80d1-0e920c183b80 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=244be58f-1901-48ed-9d4e-98cb72cc9758,network=Network(b7df3975-2e50-4d96-8a34-26abf02bea76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244be58f-19') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap244be58f-19, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8f22a4a5-b672-443d-82b5-b3940892db0e) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:08 user nova-compute[75014]: INFO os_vif [None req-af9e40f2-46c9-404d-80d1-0e920c183b80 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=244be58f-1901-48ed-9d4e-98cb72cc9758,network=Network(b7df3975-2e50-4d96-8a34-26abf02bea76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244be58f-19')
Nov 08 04:20:08 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-af9e40f2-46c9-404d-80d1-0e920c183b80 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Deleting instance files /opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947_del
Nov 08 04:20:08 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-af9e40f2-46c9-404d-80d1-0e920c183b80 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Deletion of /opt/stack/data/nova/instances/b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947_del complete
Nov 08 04:20:08 user nova-compute[75014]: DEBUG nova.objects.instance [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lazy-loading 'flavor' on Instance uuid 9edd3f37-b2c5-48ba-96ec-8f8f39975875 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:20:08 user nova-compute[75014]: INFO nova.compute.manager [None req-af9e40f2-46c9-404d-80d1-0e920c183b80 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 08 04:20:08 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-af9e40f2-46c9-404d-80d1-0e920c183b80 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:20:08 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:20:08 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:20:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-3c12cfdc-6500-48a1-af03-72a1516cde14 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "9edd3f37-b2c5-48ba-96ec-8f8f39975875" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.958s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:20:08 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:20:08 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Took 0.69 seconds to deallocate network for instance.
Nov 08 04:20:08 user nova-compute[75014]: DEBUG nova.compute.manager [req-49eefaec-b47d-42a1-8613-3bc49fe06bf1 req-9636236a-fd27-4abc-b488-cdf1fb9cc248 service nova] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Received event network-vif-deleted-244be58f-1901-48ed-9d4e-98cb72cc9758 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:20:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-af9e40f2-46c9-404d-80d1-0e920c183b80 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:20:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-af9e40f2-46c9-404d-80d1-0e920c183b80 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:20:09 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-af9e40f2-46c9-404d-80d1-0e920c183b80 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:20:09 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-af9e40f2-46c9-404d-80d1-0e920c183b80 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:20:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-af9e40f2-46c9-404d-80d1-0e920c183b80 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.197s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:20:09 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-af9e40f2-46c9-404d-80d1-0e920c183b80 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Deleted allocations for instance b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947
Nov 08 04:20:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-af9e40f2-46c9-404d-80d1-0e920c183b80 tempest-AttachVolumeTestJSON-1095291946 tempest-AttachVolumeTestJSON-1095291946-project-member] Lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.224s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:20:09 user nova-compute[75014]: DEBUG nova.compute.manager [req-467c0259-ebc6-4133-8629-aacbd1c170a3 req-f1496a87-67f6-426f-a5a6-7017a5e16812 service nova] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Received event network-vif-plugged-244be58f-1901-48ed-9d4e-98cb72cc9758 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:20:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-467c0259-ebc6-4133-8629-aacbd1c170a3 req-f1496a87-67f6-426f-a5a6-7017a5e16812 service nova] Acquiring lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:20:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-467c0259-ebc6-4133-8629-aacbd1c170a3 req-f1496a87-67f6-426f-a5a6-7017a5e16812 service nova] Lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:20:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-467c0259-ebc6-4133-8629-aacbd1c170a3 req-f1496a87-67f6-426f-a5a6-7017a5e16812 service nova] Lock "b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:20:09 user nova-compute[75014]: DEBUG nova.compute.manager [req-467c0259-ebc6-4133-8629-aacbd1c170a3 req-f1496a87-67f6-426f-a5a6-7017a5e16812 service nova] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] No waiting events found dispatching network-vif-plugged-244be58f-1901-48ed-9d4e-98cb72cc9758 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:20:09 user nova-compute[75014]: WARNING nova.compute.manager [req-467c0259-ebc6-4133-8629-aacbd1c170a3 req-f1496a87-67f6-426f-a5a6-7017a5e16812 service nova] [instance: b5d44350-fbf8-4fd3-8dc1-6c4fdb81b947] Received unexpected event network-vif-plugged-244be58f-1901-48ed-9d4e-98cb72cc9758 for instance with vm_state deleted and task_state None.
Nov 08 04:20:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:20:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:20:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:20:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:20:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:20:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:20:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:20:43 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:20:45 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:20:46 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:20:46 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:20:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-077303d8-0afd-4c60-ad9a-1bd29bff4d2d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:20:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-077303d8-0afd-4c60-ad9a-1bd29bff4d2d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:20:46 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 04:20:46 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Updating instance_info_cache with network_info: [{"id": "79c0199e-5d4c-4727-a0f5-75bae036c112", "address": "fa:16:3e:57:01:6d", "network": {"id": "a47305e7-0cb6-456a-bcde-ab03a8ea643e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-429065517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c769c7ba95ad41339b55e9baab80af07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79c0199e-5d", "ovs_interfaceid": "79c0199e-5d4c-4727-a0f5-75bae036c112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:20:46 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-077303d8-0afd-4c60-ad9a-1bd29bff4d2d" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:20:46 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 04:20:46 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:20:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:20:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:50 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:20:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:52 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:20:53 user nova-compute[75014]: INFO nova.compute.manager [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Terminating instance
Nov 08 04:20:53 user nova-compute[75014]: DEBUG nova.compute.manager [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG nova.compute.manager [req-f7110959-25ed-4b72-967c-49ffb0c4f5cd req-8ec27e85-38fb-4631-935f-3b2b910521f8 service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Received event network-vif-unplugged-80b71c76-357d-449c-8c5c-a1b28b1e6756 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f7110959-25ed-4b72-967c-49ffb0c4f5cd req-8ec27e85-38fb-4631-935f-3b2b910521f8 service nova] Acquiring lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f7110959-25ed-4b72-967c-49ffb0c4f5cd req-8ec27e85-38fb-4631-935f-3b2b910521f8 service nova] Lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f7110959-25ed-4b72-967c-49ffb0c4f5cd req-8ec27e85-38fb-4631-935f-3b2b910521f8 service nova] Lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG nova.compute.manager [req-f7110959-25ed-4b72-967c-49ffb0c4f5cd req-8ec27e85-38fb-4631-935f-3b2b910521f8 service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] No waiting events found dispatching network-vif-unplugged-80b71c76-357d-449c-8c5c-a1b28b1e6756 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG nova.compute.manager [req-f7110959-25ed-4b72-967c-49ffb0c4f5cd req-8ec27e85-38fb-4631-935f-3b2b910521f8 service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Received event network-vif-unplugged-80b71c76-357d-449c-8c5c-a1b28b1e6756 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:53 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Instance destroyed successfully.
Nov 08 04:20:53 user nova-compute[75014]: DEBUG nova.objects.instance [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lazy-loading 'resources' on Instance uuid 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:13:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-508013248',display_name='tempest-ServerActionsTestOtherA-server-508013248',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-508013248',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrmtIbZxgIG+Mj0FCPzPyxgkvpjo1RlPcXcxfMKotFzO42Fyp9FxpoU2iamZDPiUFM+ibJrBLSV5KEQ2GBDLuvdHnBp4eyBffs9QFbrBPe1RSRIG54GYFQAZ3CvgZJG1Q==',key_name='tempest-keypair-516992333',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:16:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b9ecaed30ba4ad1a9d5eaca02633604',ramdisk_id='',reservation_id='r-6xy5m0zg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-537496863',owner_user_name='tempest-ServerActionsTestOtherA-537496863-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:18:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8398fcf62a014e7f943bff6fcc3f72f3',uuid=9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "address": "fa:16:3e:61:82:36", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b71c76-35", "ovs_interfaceid": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Converting VIF {"id": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "address": "fa:16:3e:61:82:36", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b71c76-35", "ovs_interfaceid": "80b71c76-357d-449c-8c5c-a1b28b1e6756", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:82:36,bridge_name='br-int',has_traffic_filtering=True,id=80b71c76-357d-449c-8c5c-a1b28b1e6756,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b71c76-35') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG os_vif [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:82:36,bridge_name='br-int',has_traffic_filtering=True,id=80b71c76-357d-449c-8c5c-a1b28b1e6756,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b71c76-35') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80b71c76-35, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cec85613-3432-4b69-ae2b-f82a856b232f) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:53 user nova-compute[75014]: INFO os_vif [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:82:36,bridge_name='br-int',has_traffic_filtering=True,id=80b71c76-357d-449c-8c5c-a1b28b1e6756,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b71c76-35')
Nov 08 04:20:53 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LTbZRhoy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:20:53 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:20:53 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6801d9-ea7a-4fd0-bf9e-cbf7e09602ce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:20:53 user nova-compute[75014]: No targets found.
Nov 08 04:20:53 user nova-compute[75014]: iSNS:
Nov 08 04:20:53 user nova-compute[75014]: No targets found.
Nov 08 04:20:53 user nova-compute[75014]: STATIC:
Nov 08 04:20:53 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:20:53 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:20:53 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:20:53 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429
Nov 08 04:20:53 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:20:53 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:20:53 user nova-compute[75014]: FIRMWARE:
Nov 08 04:20:53 user nova-compute[75014]: No targets found.
Nov 08 04:20:53 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:20:53 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:20:53 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f35ba9c-53d6-4a95-9c9b-4aeba515c81b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:20:53 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1660805-c513-4da8-82fc-040f0c58344b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:20:54 user nova-compute[75014]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:20:54 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:20:54 user nova-compute[75014]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 (non-flash)
Nov 08 04:20:54 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0418129750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429'): ({'sdb'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Removing single pathed devices sdb {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf71112-bddd-40d0-8473-bf4a143d4c5c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[da12e46e-d19d-4940-b885-300aeead7580]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Flushing IO for device /dev/sdb {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[221e2939-93dd-4732-8428-6eaecc8e52e8]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dc3dfd-aead-48ef-bfa6-cfb545890083]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] SCSI volumes sdb have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe4be726-b239cb125a359143', '/dev/disk/by-id/scsi-26232333963623132', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e4be726') {{(pid=86544) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbaf8185-a146-49c1-a252-c528265bf69b]: (4, None) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2fa92b-e52f-4cf1-a007-09db2529990d]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[441c6693-cf10-43d4-9c22-8e5e9a88b1f6]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429, portal: 172.16.0.220,3260]
Nov 08 04:20:54 user nova-compute[75014]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429, portal: 172.16.0.220,3260] successful.
Nov 08 04:20:54 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cf2118-895b-4150-a0c1-bbb83999f429 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e8fe79-6f79-46a5-a0b2-979a67e6ea0d]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] <== disconnect_volume: return (320ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:20:54 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Deleting instance files /opt/stack/data/nova/instances/9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7_del
Nov 08 04:20:54 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Deletion of /opt/stack/data/nova/instances/9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7_del complete
Nov 08 04:20:54 user nova-compute[75014]: INFO nova.compute.manager [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 08 04:20:54 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:20:54 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:20:55 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:20:55 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:20:55 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:20:55 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Took 1.02 seconds to deallocate network for instance.
Nov 08 04:20:55 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:20:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:20:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:20:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:20:55 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:20:55 user nova-compute[75014]: DEBUG nova.compute.manager [req-c53482ff-9d80-4f7c-a3be-ec743938bd60 req-38c30163-85c9-4a54-a712-ebd09d13259c service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Received event network-vif-plugged-80b71c76-357d-449c-8c5c-a1b28b1e6756 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:20:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c53482ff-9d80-4f7c-a3be-ec743938bd60 req-38c30163-85c9-4a54-a712-ebd09d13259c service nova] Acquiring lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:20:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c53482ff-9d80-4f7c-a3be-ec743938bd60 req-38c30163-85c9-4a54-a712-ebd09d13259c service nova] Lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:20:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c53482ff-9d80-4f7c-a3be-ec743938bd60 req-38c30163-85c9-4a54-a712-ebd09d13259c service nova] Lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:20:55 user nova-compute[75014]: DEBUG nova.compute.manager [req-c53482ff-9d80-4f7c-a3be-ec743938bd60 req-38c30163-85c9-4a54-a712-ebd09d13259c service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] No waiting events found dispatching network-vif-plugged-80b71c76-357d-449c-8c5c-a1b28b1e6756 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:20:55 user nova-compute[75014]: WARNING nova.compute.manager [req-c53482ff-9d80-4f7c-a3be-ec743938bd60 req-38c30163-85c9-4a54-a712-ebd09d13259c service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Received unexpected event network-vif-plugged-80b71c76-357d-449c-8c5c-a1b28b1e6756 for instance with vm_state active and task_state deleting.
Nov 08 04:20:55 user nova-compute[75014]: DEBUG nova.compute.manager [req-c53482ff-9d80-4f7c-a3be-ec743938bd60 req-38c30163-85c9-4a54-a712-ebd09d13259c service nova] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Received event network-vif-deleted-80b71c76-357d-449c-8c5c-a1b28b1e6756 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:20:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:55 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:56 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:56 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:56 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:56 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:56 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:56 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:56 user nova-compute[75014]: INFO nova.compute.manager [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Took 1.14 seconds to detach 1 volumes for instance.
Nov 08 04:20:56 user nova-compute[75014]: DEBUG nova.compute.manager [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7] Deleting volume: 31cf2118-895b-4150-a0c1-bbb83999f429 {{(pid=75014) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 04:20:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:20:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:20:56 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:57 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Refreshing inventories for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 04:20:57 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:20:57 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:20:57 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=8655MB free_disk=24.93271255493164GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:20:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:20:57 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Updating ProviderTree inventory for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 04:20:57 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Updating inventory in ProviderTree for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 04:20:57 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Refreshing aggregate associations for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0, aggregates: None {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 04:20:57 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Refreshing trait associations for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 04:20:57 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:20:57 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:20:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.696s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:20:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.291s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:20:57 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Deleted allocations for instance 9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7
Nov 08 04:20:57 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance c23c9e00-b782-4530-bb01-a7a167951c1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:20:57 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 077303d8-0afd-4c60-ad9a-1bd29bff4d2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:20:57 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9edd3f37-b2c5-48ba-96ec-8f8f39975875 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:20:57 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:20:57 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:20:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e5d81a90-d4f8-4e84-b8b6-ed4d1b818291 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "9a7ec7d3-fd3f-4d35-a40e-6bb9697243b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.332s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:20:57 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:20:57 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:20:57 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:20:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.304s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:20:57 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:20:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:20:58 user nova-compute[75014]: DEBUG nova.compute.manager [None req-532cd5b7-aec2-411e-b139-ef04b22ad284 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:20:59 user nova-compute[75014]: INFO nova.compute.manager [None req-532cd5b7-aec2-411e-b139-ef04b22ad284 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] instance snapshotting
Nov 08 04:20:59 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-532cd5b7-aec2-411e-b139-ef04b22ad284 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Beginning live snapshot process
Nov 08 04:20:59 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-532cd5b7-aec2-411e-b139-ef04b22ad284 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json -f qcow2 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:59 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-532cd5b7-aec2-411e-b139-ef04b22ad284 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json -f qcow2" returned: 0 in 0.200s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:59 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-532cd5b7-aec2-411e-b139-ef04b22ad284 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json -f qcow2 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:20:59 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-532cd5b7-aec2-411e-b139-ef04b22ad284 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:20:59 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-532cd5b7-aec2-411e-b139-ef04b22ad284 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:21:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-532cd5b7-aec2-411e-b139-ef04b22ad284 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.172s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:21:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-532cd5b7-aec2-411e-b139-ef04b22ad284 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpw57of4_q/f28bbc2955f14cb2b38cfb04c050c567.delta 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:21:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-532cd5b7-aec2-411e-b139-ef04b22ad284 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpw57of4_q/f28bbc2955f14cb2b38cfb04c050c567.delta 1073741824" returned: 0 in 0.060s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:21:00 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-532cd5b7-aec2-411e-b139-ef04b22ad284 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 04:21:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:00 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-532cd5b7-aec2-411e-b139-ef04b22ad284 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75014) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 04:21:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-532cd5b7-aec2-411e-b139-ef04b22ad284 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75014) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 04:21:01 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-532cd5b7-aec2-411e-b139-ef04b22ad284 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 04:21:01 user nova-compute[75014]: DEBUG nova.privsep.utils [None req-532cd5b7-aec2-411e-b139-ef04b22ad284 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75014) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 04:21:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-532cd5b7-aec2-411e-b139-ef04b22ad284 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpw57of4_q/f28bbc2955f14cb2b38cfb04c050c567.delta /opt/stack/data/nova/instances/snapshots/tmpw57of4_q/f28bbc2955f14cb2b38cfb04c050c567 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:21:01 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:21:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:02 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:21:02 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Cleaning up deleted instances {{(pid=75014) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 04:21:02 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] There are 0 instances to clean {{(pid=75014) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 04:21:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-532cd5b7-aec2-411e-b139-ef04b22ad284 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpw57of4_q/f28bbc2955f14cb2b38cfb04c050c567.delta /opt/stack/data/nova/instances/snapshots/tmpw57of4_q/f28bbc2955f14cb2b38cfb04c050c567" returned: 0 in 0.865s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:21:02 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-532cd5b7-aec2-411e-b139-ef04b22ad284 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Snapshot extracted, beginning image upload
Nov 08 04:21:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:05 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-532cd5b7-aec2-411e-b139-ef04b22ad284 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Snapshot image upload complete
Nov 08 04:21:05 user nova-compute[75014]: INFO nova.compute.manager [None req-532cd5b7-aec2-411e-b139-ef04b22ad284 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Took 5.83 seconds to snapshot the instance on the hypervisor.
Nov 08 04:21:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquiring lock "12939443-ad97-4001-ab83-b6cd1aeec70a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:21:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "12939443-ad97-4001-ab83-b6cd1aeec70a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:21:07 user nova-compute[75014]: DEBUG nova.compute.manager [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 04:21:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:21:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:21:07 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 04:21:07 user nova-compute[75014]: INFO nova.compute.claims [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Claim successful on node user
Nov 08 04:21:07 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:21:07 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:21:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.277s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:21:07 user nova-compute[75014]: DEBUG nova.compute.manager [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 04:21:07 user nova-compute[75014]: DEBUG nova.compute.manager [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 04:21:07 user nova-compute[75014]: DEBUG nova.network.neutron [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 04:21:07 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 04:21:07 user nova-compute[75014]: DEBUG nova.compute.manager [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 04:21:07 user nova-compute[75014]: DEBUG nova.policy [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c1e37c55e4674f339ead74243d89e9ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bff47d48dd4d64bdfa4c4e60d04d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 04:21:07 user nova-compute[75014]: DEBUG nova.compute.manager [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 04:21:07 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 04:21:07 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Creating image(s)
Nov 08 04:21:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquiring lock "/opt/stack/data/nova/instances/12939443-ad97-4001-ab83-b6cd1aeec70a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:21:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "/opt/stack/data/nova/instances/12939443-ad97-4001-ab83-b6cd1aeec70a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:21:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "/opt/stack/data/nova/instances/12939443-ad97-4001-ab83-b6cd1aeec70a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:21:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquiring lock "a185c3be58fb103a109630e45f836467e9bc603a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:21:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "a185c3be58fb103a109630e45f836467e9bc603a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:21:08 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a185c3be58fb103a109630e45f836467e9bc603a.part --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:21:08 user nova-compute[75014]: DEBUG nova.network.neutron [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Successfully created port: 9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 04:21:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:08 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a185c3be58fb103a109630e45f836467e9bc603a.part --force-share --output=json" returned: 0 in 0.206s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:21:08 user nova-compute[75014]: DEBUG nova.virt.images [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] e8319025-c2d3-4b9c-bc07-48cab4c77112 was qcow2, converting to raw {{(pid=75014) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 04:21:08 user nova-compute[75014]: DEBUG nova.privsep.utils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75014) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 04:21:08 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a185c3be58fb103a109630e45f836467e9bc603a.part /opt/stack/data/nova/instances/_base/a185c3be58fb103a109630e45f836467e9bc603a.converted {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:21:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a185c3be58fb103a109630e45f836467e9bc603a.part /opt/stack/data/nova/instances/_base/a185c3be58fb103a109630e45f836467e9bc603a.converted" returned: 0 in 0.238s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:21:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a185c3be58fb103a109630e45f836467e9bc603a.converted --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:21:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a185c3be58fb103a109630e45f836467e9bc603a.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:21:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "a185c3be58fb103a109630e45f836467e9bc603a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.537s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:21:09 user nova-compute[75014]: DEBUG nova.network.neutron [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Successfully updated port: 9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 04:21:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a185c3be58fb103a109630e45f836467e9bc603a --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:21:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquiring lock "refresh_cache-12939443-ad97-4001-ab83-b6cd1aeec70a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:21:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquired lock "refresh_cache-12939443-ad97-4001-ab83-b6cd1aeec70a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:21:09 user nova-compute[75014]: DEBUG nova.network.neutron [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:21:09 user nova-compute[75014]: DEBUG nova.compute.manager [req-758dffbd-6a12-479f-9e2f-64baa40a6027 req-6f8b4419-6935-46a7-8d90-6af0d14cefca service nova] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Received event network-changed-9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:21:09 user nova-compute[75014]: DEBUG nova.compute.manager [req-758dffbd-6a12-479f-9e2f-64baa40a6027 req-6f8b4419-6935-46a7-8d90-6af0d14cefca service nova] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Refreshing instance network info cache due to event network-changed-9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:21:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-758dffbd-6a12-479f-9e2f-64baa40a6027 req-6f8b4419-6935-46a7-8d90-6af0d14cefca service nova] Acquiring lock "refresh_cache-12939443-ad97-4001-ab83-b6cd1aeec70a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:21:09 user nova-compute[75014]: DEBUG nova.network.neutron [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 04:21:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a185c3be58fb103a109630e45f836467e9bc603a --force-share --output=json" returned: 0 in 0.227s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:21:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquiring lock "a185c3be58fb103a109630e45f836467e9bc603a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:21:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "a185c3be58fb103a109630e45f836467e9bc603a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:21:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a185c3be58fb103a109630e45f836467e9bc603a --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:21:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a185c3be58fb103a109630e45f836467e9bc603a --force-share --output=json" returned: 0 in 0.172s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:21:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a185c3be58fb103a109630e45f836467e9bc603a,backing_fmt=raw /opt/stack/data/nova/instances/12939443-ad97-4001-ab83-b6cd1aeec70a/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:21:09 user nova-compute[75014]: DEBUG nova.network.neutron [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Updating instance_info_cache with network_info: [{"id": "9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4", "address": "fa:16:3e:c2:0b:1f", "network": {"id": "4d522d89-a309-4855-b48c-eb20e3a7cdea", "bridge": "br-int", "label": "tempest-TestStampPattern-1021360457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bff47d48dd4d64bdfa4c4e60d04d60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffa1dc1-bb", "ovs_interfaceid": "9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:21:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a185c3be58fb103a109630e45f836467e9bc603a,backing_fmt=raw /opt/stack/data/nova/instances/12939443-ad97-4001-ab83-b6cd1aeec70a/disk 1073741824" returned: 0 in 0.048s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:21:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "a185c3be58fb103a109630e45f836467e9bc603a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:21:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a185c3be58fb103a109630e45f836467e9bc603a --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:21:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Releasing lock "refresh_cache-12939443-ad97-4001-ab83-b6cd1aeec70a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:21:09 user nova-compute[75014]: DEBUG nova.compute.manager [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Instance network_info: |[{"id": "9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4", "address": "fa:16:3e:c2:0b:1f", "network": {"id": "4d522d89-a309-4855-b48c-eb20e3a7cdea", "bridge": "br-int", "label": "tempest-TestStampPattern-1021360457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bff47d48dd4d64bdfa4c4e60d04d60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffa1dc1-bb", "ovs_interfaceid": "9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 04:21:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-758dffbd-6a12-479f-9e2f-64baa40a6027 req-6f8b4419-6935-46a7-8d90-6af0d14cefca service nova] Acquired lock "refresh_cache-12939443-ad97-4001-ab83-b6cd1aeec70a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:21:09 user nova-compute[75014]: DEBUG nova.network.neutron [req-758dffbd-6a12-479f-9e2f-64baa40a6027 req-6f8b4419-6935-46a7-8d90-6af0d14cefca service nova] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Refreshing network info cache for port 9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a185c3be58fb103a109630e45f836467e9bc603a --force-share --output=json" returned: 0 in 0.182s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Ensure instance console log exists: /opt/stack/data/nova/instances/12939443-ad97-4001-ab83-b6cd1aeec70a/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Start _get_guest_xml network_info=[{"id": "9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4", "address": "fa:16:3e:c2:0b:1f", "network": {"id": "4d522d89-a309-4855-b48c-eb20e3a7cdea", "bridge": "br-int", "label": "tempest-TestStampPattern-1021360457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bff47d48dd4d64bdfa4c4e60d04d60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffa1dc1-bb", "ovs_interfaceid": "9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='8bbdd9a2ce3a3e89b28552a12ca1bc44',container_format='bare',created_at=2023-11-08T04:20:59Z,direct_url=<?>,disk_format='qcow2',id=e8319025-c2d3-4b9c-bc07-48cab4c77112,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1944938007',owner='11bff47d48dd4d64bdfa4c4e60d04d60',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T04:21:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'e8319025-c2d3-4b9c-bc07-48cab4c77112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:21:10 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:21:10 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:21:10 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8bbdd9a2ce3a3e89b28552a12ca1bc44',container_format='bare',created_at=2023-11-08T04:20:59Z,direct_url=<?>,disk_format='qcow2',id=e8319025-c2d3-4b9c-bc07-48cab4c77112,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1944938007',owner='11bff47d48dd4d64bdfa4c4e60d04d60',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T04:21:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-375105003',display_name='tempest-TestStampPattern-server-375105003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-375105003',id=44,image_ref='e8319025-c2d3-4b9c-bc07-48cab4c77112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjAWwzwaU6mM0uAVsf8M4MDogDeVam7U1Q9qZmbmnyN2kPP3EA+mz3AuKWhN3KvaKw+FEfwvQyWF60LDgsm9usmH03QvjairlAc6n6xpMsjt7JR9DxroHR+P7DjVWteTQ==',key_name='tempest-TestStampPattern-1058561610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11bff47d48dd4d64bdfa4c4e60d04d60',ramdisk_id='',reservation_id='r-91is0fnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9edd3f37-b2c5-48ba-96ec-8f8f39975875',image_min_disk='1',image_min_ram='0',image_owner_id='11bff47d48dd4d64bdfa4c4e60d04d60',image_owner_project_name='tempest-TestStampPattern-1607533786',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1607533786-project-member',image_user_id='c1e37c55e4674f339ead74243d89e9ba',network_allocated='True',owner_project_name='tempest-TestStampPattern-1607533786',owner_user_name='tempest-TestStampPattern-1607533786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:21:08Z,user_data=None,user_id='c1e37c55e4674f339ead74243d89e9ba',uuid=12939443-ad97-4001-ab83-b6cd1aeec70a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4", "address": "fa:16:3e:c2:0b:1f", "network": {"id": "4d522d89-a309-4855-b48c-eb20e3a7cdea", "bridge": "br-int", "label": "tempest-TestStampPattern-1021360457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bff47d48dd4d64bdfa4c4e60d04d60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffa1dc1-bb", "ovs_interfaceid": "9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Converting VIF {"id": "9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4", "address": "fa:16:3e:c2:0b:1f", "network": {"id": "4d522d89-a309-4855-b48c-eb20e3a7cdea", "bridge": "br-int", "label": "tempest-TestStampPattern-1021360457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bff47d48dd4d64bdfa4c4e60d04d60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffa1dc1-bb", "ovs_interfaceid": "9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:0b:1f,bridge_name='br-int',has_traffic_filtering=True,id=9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4,network=Network(4d522d89-a309-4855-b48c-eb20e3a7cdea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ffa1dc1-bb') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG nova.objects.instance [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lazy-loading 'pci_devices' on Instance uuid 12939443-ad97-4001-ab83-b6cd1aeec70a {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:21:10 user nova-compute[75014]:   <uuid>12939443-ad97-4001-ab83-b6cd1aeec70a</uuid>
Nov 08 04:21:10 user nova-compute[75014]:   <name>instance-0000002c</name>
Nov 08 04:21:10 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:21:10 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:21:10 user nova-compute[75014]:   <metadata>
Nov 08 04:21:10 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:21:10 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:21:10 user nova-compute[75014]:       <nova:name>tempest-TestStampPattern-server-375105003</nova:name>
Nov 08 04:21:10 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:21:10</nova:creationTime>
Nov 08 04:21:10 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:21:10 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:21:10 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:21:10 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:21:10 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:21:10 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:21:10 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:21:10 user nova-compute[75014]:       <nova:owner>
Nov 08 04:21:10 user nova-compute[75014]:         <nova:user uuid="c1e37c55e4674f339ead74243d89e9ba">tempest-TestStampPattern-1607533786-project-member</nova:user>
Nov 08 04:21:10 user nova-compute[75014]:         <nova:project uuid="11bff47d48dd4d64bdfa4c4e60d04d60">tempest-TestStampPattern-1607533786</nova:project>
Nov 08 04:21:10 user nova-compute[75014]:       </nova:owner>
Nov 08 04:21:10 user nova-compute[75014]:       <nova:root type="image" uuid="e8319025-c2d3-4b9c-bc07-48cab4c77112"/>
Nov 08 04:21:10 user nova-compute[75014]:       <nova:ports>
Nov 08 04:21:10 user nova-compute[75014]:         <nova:port uuid="9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4">
Nov 08 04:21:10 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 04:21:10 user nova-compute[75014]:         </nova:port>
Nov 08 04:21:10 user nova-compute[75014]:       </nova:ports>
Nov 08 04:21:10 user nova-compute[75014]:     </nova:instance>
Nov 08 04:21:10 user nova-compute[75014]:   </metadata>
Nov 08 04:21:10 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:21:10 user nova-compute[75014]:     <system>
Nov 08 04:21:10 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:21:10 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:21:10 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:21:10 user nova-compute[75014]:       <entry name="serial">12939443-ad97-4001-ab83-b6cd1aeec70a</entry>
Nov 08 04:21:10 user nova-compute[75014]:       <entry name="uuid">12939443-ad97-4001-ab83-b6cd1aeec70a</entry>
Nov 08 04:21:10 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:21:10 user nova-compute[75014]:     </system>
Nov 08 04:21:10 user nova-compute[75014]:   </sysinfo>
Nov 08 04:21:10 user nova-compute[75014]:   <os>
Nov 08 04:21:10 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:21:10 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:21:10 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:21:10 user nova-compute[75014]:   </os>
Nov 08 04:21:10 user nova-compute[75014]:   <features>
Nov 08 04:21:10 user nova-compute[75014]:     <acpi/>
Nov 08 04:21:10 user nova-compute[75014]:     <apic/>
Nov 08 04:21:10 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:21:10 user nova-compute[75014]:   </features>
Nov 08 04:21:10 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:21:10 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:21:10 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:21:10 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:21:10 user nova-compute[75014]:   </clock>
Nov 08 04:21:10 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:21:10 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:21:10 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:21:10 user nova-compute[75014]:   </cpu>
Nov 08 04:21:10 user nova-compute[75014]:   <devices>
Nov 08 04:21:10 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 04:21:10 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 04:21:10 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/12939443-ad97-4001-ab83-b6cd1aeec70a/disk"/>
Nov 08 04:21:10 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:21:10 user nova-compute[75014]:     </disk>
Nov 08 04:21:10 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:21:10 user nova-compute[75014]:       <mac address="fa:16:3e:c2:0b:1f"/>
Nov 08 04:21:10 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:21:10 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:21:10 user nova-compute[75014]:       <target dev="tap9ffa1dc1-bb"/>
Nov 08 04:21:10 user nova-compute[75014]:     </interface>
Nov 08 04:21:10 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:21:10 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/12939443-ad97-4001-ab83-b6cd1aeec70a/console.log" append="off"/>
Nov 08 04:21:10 user nova-compute[75014]:     </serial>
Nov 08 04:21:10 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:21:10 user nova-compute[75014]:     <video>
Nov 08 04:21:10 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:21:10 user nova-compute[75014]:     </video>
Nov 08 04:21:10 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:21:10 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:21:10 user nova-compute[75014]:     </rng>
Nov 08 04:21:10 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:21:10 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:21:10 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:21:10 user nova-compute[75014]:     </memballoon>
Nov 08 04:21:10 user nova-compute[75014]:   </devices>
Nov 08 04:21:10 user nova-compute[75014]: </domain>
Nov 08 04:21:10 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-375105003',display_name='tempest-TestStampPattern-server-375105003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-375105003',id=44,image_ref='e8319025-c2d3-4b9c-bc07-48cab4c77112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjAWwzwaU6mM0uAVsf8M4MDogDeVam7U1Q9qZmbmnyN2kPP3EA+mz3AuKWhN3KvaKw+FEfwvQyWF60LDgsm9usmH03QvjairlAc6n6xpMsjt7JR9DxroHR+P7DjVWteTQ==',key_name='tempest-TestStampPattern-1058561610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11bff47d48dd4d64bdfa4c4e60d04d60',ramdisk_id='',reservation_id='r-91is0fnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9edd3f37-b2c5-48ba-96ec-8f8f39975875',image_min_disk='1',image_min_ram='0',image_owner_id='11bff47d48dd4d64bdfa4c4e60d04d60',image_owner_project_name='tempest-TestStampPattern-1607533786',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1607533786-project-member',image_user_id='c1e37c55e4674f339ead74243d89e9ba',network_allocated='True',owner_project_name='tempest-TestStampPattern-1607533786',owner_user_name='tempest-TestStampPattern-1607533786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:21:08Z,user_data=None,user_id='c1e37c55e4674f339ead74243d89e9ba',uuid=12939443-ad97-4001-ab83-b6cd1aeec70a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4", "address": "fa:16:3e:c2:0b:1f", "network": {"id": "4d522d89-a309-4855-b48c-eb20e3a7cdea", "bridge": "br-int", "label": "tempest-TestStampPattern-1021360457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bff47d48dd4d64bdfa4c4e60d04d60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffa1dc1-bb", "ovs_interfaceid": "9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Converting VIF {"id": "9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4", "address": "fa:16:3e:c2:0b:1f", "network": {"id": "4d522d89-a309-4855-b48c-eb20e3a7cdea", "bridge": "br-int", "label": "tempest-TestStampPattern-1021360457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bff47d48dd4d64bdfa4c4e60d04d60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffa1dc1-bb", "ovs_interfaceid": "9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:0b:1f,bridge_name='br-int',has_traffic_filtering=True,id=9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4,network=Network(4d522d89-a309-4855-b48c-eb20e3a7cdea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ffa1dc1-bb') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG os_vif [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:0b:1f,bridge_name='br-int',has_traffic_filtering=True,id=9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4,network=Network(4d522d89-a309-4855-b48c-eb20e3a7cdea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ffa1dc1-bb') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10a556d2-02b3-5fd2-af9d-3c46c70c370b', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ffa1dc1-bb, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9ffa1dc1-bb, col_values=(('qos', UUID('9cd68260-eb77-4595-be7f-22c0f7dbfe92')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9ffa1dc1-bb, col_values=(('external_ids', {'iface-id': '9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:0b:1f', 'vm-uuid': '12939443-ad97-4001-ab83-b6cd1aeec70a'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:10 user nova-compute[75014]: INFO os_vif [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:0b:1f,bridge_name='br-int',has_traffic_filtering=True,id=9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4,network=Network(4d522d89-a309-4855-b48c-eb20e3a7cdea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ffa1dc1-bb')
Nov 08 04:21:10 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] No VIF found with MAC fa:16:3e:c2:0b:1f, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG nova.network.neutron [req-758dffbd-6a12-479f-9e2f-64baa40a6027 req-6f8b4419-6935-46a7-8d90-6af0d14cefca service nova] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Updated VIF entry in instance network info cache for port 9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG nova.network.neutron [req-758dffbd-6a12-479f-9e2f-64baa40a6027 req-6f8b4419-6935-46a7-8d90-6af0d14cefca service nova] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Updating instance_info_cache with network_info: [{"id": "9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4", "address": "fa:16:3e:c2:0b:1f", "network": {"id": "4d522d89-a309-4855-b48c-eb20e3a7cdea", "bridge": "br-int", "label": "tempest-TestStampPattern-1021360457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bff47d48dd4d64bdfa4c4e60d04d60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffa1dc1-bb", "ovs_interfaceid": "9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:21:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-758dffbd-6a12-479f-9e2f-64baa40a6027 req-6f8b4419-6935-46a7-8d90-6af0d14cefca service nova] Releasing lock "refresh_cache-12939443-ad97-4001-ab83-b6cd1aeec70a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:21:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:11 user nova-compute[75014]: DEBUG nova.compute.manager [req-060f5de8-7fef-44df-86b6-3fe72626df10 req-a5ad8a87-8bca-49de-8ae4-a9510c090bb8 service nova] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Received event network-vif-plugged-9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:21:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-060f5de8-7fef-44df-86b6-3fe72626df10 req-a5ad8a87-8bca-49de-8ae4-a9510c090bb8 service nova] Acquiring lock "12939443-ad97-4001-ab83-b6cd1aeec70a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:21:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-060f5de8-7fef-44df-86b6-3fe72626df10 req-a5ad8a87-8bca-49de-8ae4-a9510c090bb8 service nova] Lock "12939443-ad97-4001-ab83-b6cd1aeec70a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:21:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-060f5de8-7fef-44df-86b6-3fe72626df10 req-a5ad8a87-8bca-49de-8ae4-a9510c090bb8 service nova] Lock "12939443-ad97-4001-ab83-b6cd1aeec70a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:21:11 user nova-compute[75014]: DEBUG nova.compute.manager [req-060f5de8-7fef-44df-86b6-3fe72626df10 req-a5ad8a87-8bca-49de-8ae4-a9510c090bb8 service nova] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] No waiting events found dispatching network-vif-plugged-9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:21:11 user nova-compute[75014]: WARNING nova.compute.manager [req-060f5de8-7fef-44df-86b6-3fe72626df10 req-a5ad8a87-8bca-49de-8ae4-a9510c090bb8 service nova] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Received unexpected event network-vif-plugged-9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4 for instance with vm_state building and task_state spawning.
Nov 08 04:21:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:13 user nova-compute[75014]: DEBUG nova.compute.manager [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:21:13 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 04:21:13 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Instance spawned successfully.
Nov 08 04:21:13 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 04:21:13 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:21:13 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:21:13 user nova-compute[75014]: DEBUG nova.compute.manager [req-93a7776c-3e8e-4469-a0d7-304e47e46415 req-1189e24f-4dea-44f7-bac7-376a716ab60d service nova] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Received event network-vif-plugged-9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:21:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-93a7776c-3e8e-4469-a0d7-304e47e46415 req-1189e24f-4dea-44f7-bac7-376a716ab60d service nova] Acquiring lock "12939443-ad97-4001-ab83-b6cd1aeec70a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:21:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-93a7776c-3e8e-4469-a0d7-304e47e46415 req-1189e24f-4dea-44f7-bac7-376a716ab60d service nova] Lock "12939443-ad97-4001-ab83-b6cd1aeec70a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:21:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-93a7776c-3e8e-4469-a0d7-304e47e46415 req-1189e24f-4dea-44f7-bac7-376a716ab60d service nova] Lock "12939443-ad97-4001-ab83-b6cd1aeec70a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:21:13 user nova-compute[75014]: DEBUG nova.compute.manager [req-93a7776c-3e8e-4469-a0d7-304e47e46415 req-1189e24f-4dea-44f7-bac7-376a716ab60d service nova] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] No waiting events found dispatching network-vif-plugged-9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:21:13 user nova-compute[75014]: WARNING nova.compute.manager [req-93a7776c-3e8e-4469-a0d7-304e47e46415 req-1189e24f-4dea-44f7-bac7-376a716ab60d service nova] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Received unexpected event network-vif-plugged-9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4 for instance with vm_state building and task_state spawning.
Nov 08 04:21:13 user nova-compute[75014]: INFO nova.compute.manager [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Took 6.15 seconds to spawn the instance on the hypervisor.
Nov 08 04:21:13 user nova-compute[75014]: DEBUG nova.compute.manager [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:21:14 user nova-compute[75014]: INFO nova.compute.manager [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Took 6.84 seconds to build instance.
Nov 08 04:21:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1e1c52f4-e0b5-473d-b373-b3756f474f38 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "12939443-ad97-4001-ab83-b6cd1aeec70a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.951s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:21:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:16 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:21:16 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=75014) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 04:21:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:20 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "b68ff427-f94a-4513-99d5-a1c63cb16f10" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:21:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "b68ff427-f94a-4513-99d5-a1c63cb16f10" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:21:36 user nova-compute[75014]: DEBUG nova.compute.manager [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 04:21:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:21:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:21:36 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 04:21:36 user nova-compute[75014]: INFO nova.compute.claims [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Claim successful on node user
Nov 08 04:21:36 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:21:36 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:21:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.298s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:21:36 user nova-compute[75014]: DEBUG nova.compute.manager [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 04:21:37 user nova-compute[75014]: DEBUG nova.compute.manager [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 04:21:37 user nova-compute[75014]: DEBUG nova.network.neutron [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 04:21:37 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 04:21:37 user nova-compute[75014]: DEBUG nova.compute.manager [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 04:21:37 user nova-compute[75014]: DEBUG nova.policy [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe1c5af56ab14da7986d64e38597d394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504ed2858e78480e9beef5aa5f5d9f1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 04:21:37 user nova-compute[75014]: INFO nova.virt.block_device [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Booting with volume snapshot 0ee4a261-54ee-4768-90aa-8c0e9bed4bf3 at /dev/vda
Nov 08 04:21:37 user nova-compute[75014]: DEBUG nova.network.neutron [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Successfully created port: 85ecf643-4d2e-475a-9f34-0c6c409a9be9 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 04:21:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:38 user nova-compute[75014]: DEBUG nova.network.neutron [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Successfully updated port: 85ecf643-4d2e-475a-9f34-0c6c409a9be9 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 04:21:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "refresh_cache-b68ff427-f94a-4513-99d5-a1c63cb16f10" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:21:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquired lock "refresh_cache-b68ff427-f94a-4513-99d5-a1c63cb16f10" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:21:38 user nova-compute[75014]: DEBUG nova.network.neutron [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:21:38 user nova-compute[75014]: DEBUG nova.compute.manager [req-ef8fc9e1-6ea7-41da-b9bf-e840d6b6be01 req-2c0391b6-716f-496e-9a28-7f2c13459611 service nova] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Received event network-changed-85ecf643-4d2e-475a-9f34-0c6c409a9be9 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:21:38 user nova-compute[75014]: DEBUG nova.compute.manager [req-ef8fc9e1-6ea7-41da-b9bf-e840d6b6be01 req-2c0391b6-716f-496e-9a28-7f2c13459611 service nova] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Refreshing instance network info cache due to event network-changed-85ecf643-4d2e-475a-9f34-0c6c409a9be9. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:21:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ef8fc9e1-6ea7-41da-b9bf-e840d6b6be01 req-2c0391b6-716f-496e-9a28-7f2c13459611 service nova] Acquiring lock "refresh_cache-b68ff427-f94a-4513-99d5-a1c63cb16f10" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:21:38 user nova-compute[75014]: DEBUG nova.network.neutron [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 04:21:38 user nova-compute[75014]: DEBUG nova.network.neutron [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Updating instance_info_cache with network_info: [{"id": "85ecf643-4d2e-475a-9f34-0c6c409a9be9", "address": "fa:16:3e:3d:13:6d", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ecf643-4d", "ovs_interfaceid": "85ecf643-4d2e-475a-9f34-0c6c409a9be9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:21:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Releasing lock "refresh_cache-b68ff427-f94a-4513-99d5-a1c63cb16f10" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:21:38 user nova-compute[75014]: DEBUG nova.compute.manager [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Instance network_info: |[{"id": "85ecf643-4d2e-475a-9f34-0c6c409a9be9", "address": "fa:16:3e:3d:13:6d", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ecf643-4d", "ovs_interfaceid": "85ecf643-4d2e-475a-9f34-0c6c409a9be9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 04:21:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ef8fc9e1-6ea7-41da-b9bf-e840d6b6be01 req-2c0391b6-716f-496e-9a28-7f2c13459611 service nova] Acquired lock "refresh_cache-b68ff427-f94a-4513-99d5-a1c63cb16f10" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:21:38 user nova-compute[75014]: DEBUG nova.network.neutron [req-ef8fc9e1-6ea7-41da-b9bf-e840d6b6be01 req-2c0391b6-716f-496e-9a28-7f2c13459611 service nova] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Refreshing network info cache for port 85ecf643-4d2e-475a-9f34-0c6c409a9be9 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:21:39 user nova-compute[75014]: DEBUG nova.network.neutron [req-ef8fc9e1-6ea7-41da-b9bf-e840d6b6be01 req-2c0391b6-716f-496e-9a28-7f2c13459611 service nova] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Updated VIF entry in instance network info cache for port 85ecf643-4d2e-475a-9f34-0c6c409a9be9. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:21:39 user nova-compute[75014]: DEBUG nova.network.neutron [req-ef8fc9e1-6ea7-41da-b9bf-e840d6b6be01 req-2c0391b6-716f-496e-9a28-7f2c13459611 service nova] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Updating instance_info_cache with network_info: [{"id": "85ecf643-4d2e-475a-9f34-0c6c409a9be9", "address": "fa:16:3e:3d:13:6d", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ecf643-4d", "ovs_interfaceid": "85ecf643-4d2e-475a-9f34-0c6c409a9be9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:21:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ef8fc9e1-6ea7-41da-b9bf-e840d6b6be01 req-2c0391b6-716f-496e-9a28-7f2c13459611 service nova] Releasing lock "refresh_cache-b68ff427-f94a-4513-99d5-a1c63cb16f10" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:21:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:42 user nova-compute[75014]: DEBUG os_brick.utils [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:21:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:21:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:21:42 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6e35de-4cd9-4a3e-b3bb-2477907be1e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:21:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:21:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:21:42 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e091837f-6dc3-4233-86ff-6de9f168a15b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:21:42 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:21:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:21:43 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb98766-4926-4c9f-bf1f-f985ebbf958d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:21:43 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c9d77c-41d2-4bfc-98fd-5cba2fd2a0f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:21:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:21:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:21:43 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:21:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:21:43 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:21:43 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:21:43 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f1a4d2-b16c-4dba-94ef-e3c9cc49ea82]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:21:43 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:21:43 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:21:43 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:21:43 user nova-compute[75014]: DEBUG os_brick.utils [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:21:43 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Updating existing volume attachment record: 8ac1346b-f29e-45e1-a57d-bea427ce9948 {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:21:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:45 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:21:46 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f9c4850a-7f1f-4a09-b3a9-8262dcce8416 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Acquiring lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f9c4850a-7f1f-4a09-b3a9-8262dcce8416 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f9c4850a-7f1f-4a09-b3a9-8262dcce8416 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Acquiring lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f9c4850a-7f1f-4a09-b3a9-8262dcce8416 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f9c4850a-7f1f-4a09-b3a9-8262dcce8416 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:21:47 user nova-compute[75014]: INFO nova.compute.manager [None req-f9c4850a-7f1f-4a09-b3a9-8262dcce8416 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Terminating instance
Nov 08 04:21:47 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f9c4850a-7f1f-4a09-b3a9-8262dcce8416 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG nova.compute.manager [req-57acf0c6-9a5f-4f50-815d-9f81700c2e85 req-e71de432-1994-457c-ae1f-c15c62a3a5d8 service nova] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Received event network-vif-unplugged-79c0199e-5d4c-4727-a0f5-75bae036c112 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-57acf0c6-9a5f-4f50-815d-9f81700c2e85 req-e71de432-1994-457c-ae1f-c15c62a3a5d8 service nova] Acquiring lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-57acf0c6-9a5f-4f50-815d-9f81700c2e85 req-e71de432-1994-457c-ae1f-c15c62a3a5d8 service nova] Lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-57acf0c6-9a5f-4f50-815d-9f81700c2e85 req-e71de432-1994-457c-ae1f-c15c62a3a5d8 service nova] Lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG nova.compute.manager [req-57acf0c6-9a5f-4f50-815d-9f81700c2e85 req-e71de432-1994-457c-ae1f-c15c62a3a5d8 service nova] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] No waiting events found dispatching network-vif-unplugged-79c0199e-5d4c-4727-a0f5-75bae036c112 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG nova.compute.manager [req-57acf0c6-9a5f-4f50-815d-9f81700c2e85 req-e71de432-1994-457c-ae1f-c15c62a3a5d8 service nova] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Received event network-vif-unplugged-79c0199e-5d4c-4727-a0f5-75bae036c112 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-9edd3f37-b2c5-48ba-96ec-8f8f39975875" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-9edd3f37-b2c5-48ba-96ec-8f8f39975875" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:47 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Instance destroyed successfully.
Nov 08 04:21:47 user nova-compute[75014]: DEBUG nova.objects.instance [None req-f9c4850a-7f1f-4a09-b3a9-8262dcce8416 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lazy-loading 'resources' on Instance uuid 077303d8-0afd-4c60-ad9a-1bd29bff4d2d {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-f9c4850a-7f1f-4a09-b3a9-8262dcce8416 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:12:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-64286730',display_name='tempest-ServersNegativeTestJSON-server-64286730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-64286730',id=38,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:12:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c769c7ba95ad41339b55e9baab80af07',ramdisk_id='',reservation_id='r-3ba98ji5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1651832936',owner_user_name='tempest-ServersNegativeTestJSON-1651832936-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:12:40Z,user_data=None,user_id='41f64f5dd3754997a7a4d2fc193748a2',uuid=077303d8-0afd-4c60-ad9a-1bd29bff4d2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79c0199e-5d4c-4727-a0f5-75bae036c112", "address": "fa:16:3e:57:01:6d", "network": {"id": "a47305e7-0cb6-456a-bcde-ab03a8ea643e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-429065517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c769c7ba95ad41339b55e9baab80af07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79c0199e-5d", "ovs_interfaceid": "79c0199e-5d4c-4727-a0f5-75bae036c112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-f9c4850a-7f1f-4a09-b3a9-8262dcce8416 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Converting VIF {"id": "79c0199e-5d4c-4727-a0f5-75bae036c112", "address": "fa:16:3e:57:01:6d", "network": {"id": "a47305e7-0cb6-456a-bcde-ab03a8ea643e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-429065517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c769c7ba95ad41339b55e9baab80af07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79c0199e-5d", "ovs_interfaceid": "79c0199e-5d4c-4727-a0f5-75bae036c112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-f9c4850a-7f1f-4a09-b3a9-8262dcce8416 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:01:6d,bridge_name='br-int',has_traffic_filtering=True,id=79c0199e-5d4c-4727-a0f5-75bae036c112,network=Network(a47305e7-0cb6-456a-bcde-ab03a8ea643e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79c0199e-5d') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG os_vif [None req-f9c4850a-7f1f-4a09-b3a9-8262dcce8416 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:01:6d,bridge_name='br-int',has_traffic_filtering=True,id=79c0199e-5d4c-4727-a0f5-75bae036c112,network=Network(a47305e7-0cb6-456a-bcde-ab03a8ea643e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79c0199e-5d') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79c0199e-5d, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ae94324-ecde-489a-91f9-ba4c4409ea49) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:21:48 user nova-compute[75014]: INFO os_vif [None req-f9c4850a-7f1f-4a09-b3a9-8262dcce8416 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:01:6d,bridge_name='br-int',has_traffic_filtering=True,id=79c0199e-5d4c-4727-a0f5-75bae036c112,network=Network(a47305e7-0cb6-456a-bcde-ab03a8ea643e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79c0199e-5d')
Nov 08 04:21:48 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-f9c4850a-7f1f-4a09-b3a9-8262dcce8416 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Deleting instance files /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d_del
Nov 08 04:21:48 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-f9c4850a-7f1f-4a09-b3a9-8262dcce8416 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Deletion of /opt/stack/data/nova/instances/077303d8-0afd-4c60-ad9a-1bd29bff4d2d_del complete
Nov 08 04:21:48 user nova-compute[75014]: INFO nova.compute.manager [None req-f9c4850a-7f1f-4a09-b3a9-8262dcce8416 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 08 04:21:48 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-f9c4850a-7f1f-4a09-b3a9-8262dcce8416 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:21:48 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:21:48 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:21:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:48 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Updating instance_info_cache with network_info: [{"id": "90d4a51e-8558-4326-b2c4-b29e584ba8e4", "address": "fa:16:3e:b8:c7:f9", "network": {"id": "4d522d89-a309-4855-b48c-eb20e3a7cdea", "bridge": "br-int", "label": "tempest-TestStampPattern-1021360457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bff47d48dd4d64bdfa4c4e60d04d60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90d4a51e-85", "ovs_interfaceid": "90d4a51e-8558-4326-b2c4-b29e584ba8e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:21:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-9edd3f37-b2c5-48ba-96ec-8f8f39975875" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:21:48 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 04:21:48 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:21:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:48 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:21:48 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Took 0.66 seconds to deallocate network for instance.
Nov 08 04:21:48 user nova-compute[75014]: DEBUG nova.compute.manager [req-adc9edb2-a570-4324-9418-76b4efbf4602 req-aca9edf7-e569-43f2-9319-ddaa62ee06ae service nova] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Received event network-vif-deleted-79c0199e-5d4c-4727-a0f5-75bae036c112 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:21:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f9c4850a-7f1f-4a09-b3a9-8262dcce8416 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:21:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f9c4850a-7f1f-4a09-b3a9-8262dcce8416 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:21:48 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-f9c4850a-7f1f-4a09-b3a9-8262dcce8416 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:21:49 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-f9c4850a-7f1f-4a09-b3a9-8262dcce8416 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:21:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f9c4850a-7f1f-4a09-b3a9-8262dcce8416 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.212s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:21:49 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-f9c4850a-7f1f-4a09-b3a9-8262dcce8416 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Deleted allocations for instance 077303d8-0afd-4c60-ad9a-1bd29bff4d2d
Nov 08 04:21:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f9c4850a-7f1f-4a09-b3a9-8262dcce8416 tempest-ServersNegativeTestJSON-1651832936 tempest-ServersNegativeTestJSON-1651832936-project-member] Lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.995s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:21:49 user nova-compute[75014]: DEBUG nova.compute.manager [req-e170487d-3ce0-4c74-bf25-39dbe76d4646 req-7b6b9843-a985-47ca-ade1-552c52f5a6b6 service nova] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Received event network-vif-plugged-79c0199e-5d4c-4727-a0f5-75bae036c112 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:21:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e170487d-3ce0-4c74-bf25-39dbe76d4646 req-7b6b9843-a985-47ca-ade1-552c52f5a6b6 service nova] Acquiring lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:21:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e170487d-3ce0-4c74-bf25-39dbe76d4646 req-7b6b9843-a985-47ca-ade1-552c52f5a6b6 service nova] Lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:21:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e170487d-3ce0-4c74-bf25-39dbe76d4646 req-7b6b9843-a985-47ca-ade1-552c52f5a6b6 service nova] Lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:21:49 user nova-compute[75014]: DEBUG nova.compute.manager [req-e170487d-3ce0-4c74-bf25-39dbe76d4646 req-7b6b9843-a985-47ca-ade1-552c52f5a6b6 service nova] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] No waiting events found dispatching network-vif-plugged-79c0199e-5d4c-4727-a0f5-75bae036c112 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:21:49 user nova-compute[75014]: WARNING nova.compute.manager [req-e170487d-3ce0-4c74-bf25-39dbe76d4646 req-7b6b9843-a985-47ca-ade1-552c52f5a6b6 service nova] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Received unexpected event network-vif-plugged-79c0199e-5d4c-4727-a0f5-75bae036c112 for instance with vm_state deleted and task_state None.
Nov 08 04:21:49 user nova-compute[75014]: DEBUG nova.compute.manager [req-e170487d-3ce0-4c74-bf25-39dbe76d4646 req-7b6b9843-a985-47ca-ade1-552c52f5a6b6 service nova] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Received event network-vif-plugged-79c0199e-5d4c-4727-a0f5-75bae036c112 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:21:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e170487d-3ce0-4c74-bf25-39dbe76d4646 req-7b6b9843-a985-47ca-ade1-552c52f5a6b6 service nova] Acquiring lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:21:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e170487d-3ce0-4c74-bf25-39dbe76d4646 req-7b6b9843-a985-47ca-ade1-552c52f5a6b6 service nova] Lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:21:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e170487d-3ce0-4c74-bf25-39dbe76d4646 req-7b6b9843-a985-47ca-ade1-552c52f5a6b6 service nova] Lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:21:49 user nova-compute[75014]: DEBUG nova.compute.manager [req-e170487d-3ce0-4c74-bf25-39dbe76d4646 req-7b6b9843-a985-47ca-ade1-552c52f5a6b6 service nova] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] No waiting events found dispatching network-vif-plugged-79c0199e-5d4c-4727-a0f5-75bae036c112 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:21:49 user nova-compute[75014]: WARNING nova.compute.manager [req-e170487d-3ce0-4c74-bf25-39dbe76d4646 req-7b6b9843-a985-47ca-ade1-552c52f5a6b6 service nova] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Received unexpected event network-vif-plugged-79c0199e-5d4c-4727-a0f5-75bae036c112 for instance with vm_state deleted and task_state None.
Nov 08 04:21:49 user nova-compute[75014]: DEBUG nova.compute.manager [req-e170487d-3ce0-4c74-bf25-39dbe76d4646 req-7b6b9843-a985-47ca-ade1-552c52f5a6b6 service nova] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Received event network-vif-plugged-79c0199e-5d4c-4727-a0f5-75bae036c112 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:21:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e170487d-3ce0-4c74-bf25-39dbe76d4646 req-7b6b9843-a985-47ca-ade1-552c52f5a6b6 service nova] Acquiring lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:21:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e170487d-3ce0-4c74-bf25-39dbe76d4646 req-7b6b9843-a985-47ca-ade1-552c52f5a6b6 service nova] Lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:21:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e170487d-3ce0-4c74-bf25-39dbe76d4646 req-7b6b9843-a985-47ca-ade1-552c52f5a6b6 service nova] Lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:21:49 user nova-compute[75014]: DEBUG nova.compute.manager [req-e170487d-3ce0-4c74-bf25-39dbe76d4646 req-7b6b9843-a985-47ca-ade1-552c52f5a6b6 service nova] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] No waiting events found dispatching network-vif-plugged-79c0199e-5d4c-4727-a0f5-75bae036c112 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:21:49 user nova-compute[75014]: WARNING nova.compute.manager [req-e170487d-3ce0-4c74-bf25-39dbe76d4646 req-7b6b9843-a985-47ca-ade1-552c52f5a6b6 service nova] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Received unexpected event network-vif-plugged-79c0199e-5d4c-4727-a0f5-75bae036c112 for instance with vm_state deleted and task_state None.
Nov 08 04:21:49 user nova-compute[75014]: DEBUG nova.compute.manager [req-e170487d-3ce0-4c74-bf25-39dbe76d4646 req-7b6b9843-a985-47ca-ade1-552c52f5a6b6 service nova] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Received event network-vif-unplugged-79c0199e-5d4c-4727-a0f5-75bae036c112 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:21:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e170487d-3ce0-4c74-bf25-39dbe76d4646 req-7b6b9843-a985-47ca-ade1-552c52f5a6b6 service nova] Acquiring lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:21:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e170487d-3ce0-4c74-bf25-39dbe76d4646 req-7b6b9843-a985-47ca-ade1-552c52f5a6b6 service nova] Lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:21:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e170487d-3ce0-4c74-bf25-39dbe76d4646 req-7b6b9843-a985-47ca-ade1-552c52f5a6b6 service nova] Lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:21:49 user nova-compute[75014]: DEBUG nova.compute.manager [req-e170487d-3ce0-4c74-bf25-39dbe76d4646 req-7b6b9843-a985-47ca-ade1-552c52f5a6b6 service nova] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] No waiting events found dispatching network-vif-unplugged-79c0199e-5d4c-4727-a0f5-75bae036c112 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:21:49 user nova-compute[75014]: WARNING nova.compute.manager [req-e170487d-3ce0-4c74-bf25-39dbe76d4646 req-7b6b9843-a985-47ca-ade1-552c52f5a6b6 service nova] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Received unexpected event network-vif-unplugged-79c0199e-5d4c-4727-a0f5-75bae036c112 for instance with vm_state deleted and task_state None.
Nov 08 04:21:49 user nova-compute[75014]: DEBUG nova.compute.manager [req-e170487d-3ce0-4c74-bf25-39dbe76d4646 req-7b6b9843-a985-47ca-ade1-552c52f5a6b6 service nova] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Received event network-vif-plugged-79c0199e-5d4c-4727-a0f5-75bae036c112 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:21:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e170487d-3ce0-4c74-bf25-39dbe76d4646 req-7b6b9843-a985-47ca-ade1-552c52f5a6b6 service nova] Acquiring lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:21:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e170487d-3ce0-4c74-bf25-39dbe76d4646 req-7b6b9843-a985-47ca-ade1-552c52f5a6b6 service nova] Lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:21:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e170487d-3ce0-4c74-bf25-39dbe76d4646 req-7b6b9843-a985-47ca-ade1-552c52f5a6b6 service nova] Lock "077303d8-0afd-4c60-ad9a-1bd29bff4d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:21:49 user nova-compute[75014]: DEBUG nova.compute.manager [req-e170487d-3ce0-4c74-bf25-39dbe76d4646 req-7b6b9843-a985-47ca-ade1-552c52f5a6b6 service nova] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] No waiting events found dispatching network-vif-plugged-79c0199e-5d4c-4727-a0f5-75bae036c112 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:21:49 user nova-compute[75014]: WARNING nova.compute.manager [req-e170487d-3ce0-4c74-bf25-39dbe76d4646 req-7b6b9843-a985-47ca-ade1-552c52f5a6b6 service nova] [instance: 077303d8-0afd-4c60-ad9a-1bd29bff4d2d] Received unexpected event network-vif-plugged-79c0199e-5d4c-4727-a0f5-75bae036c112 for instance with vm_state deleted and task_state None.
Nov 08 04:21:50 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:21:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:54 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:21:57 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:21:57 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:21:57 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:21:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:21:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:21:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:21:57 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:21:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:21:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:21:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:21:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:21:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:21:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:21:58 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:21:58 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:21:58 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:21:58 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12939443-ad97-4001-ab83-b6cd1aeec70a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:21:58 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12939443-ad97-4001-ab83-b6cd1aeec70a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:21:58 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12939443-ad97-4001-ab83-b6cd1aeec70a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:21:58 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12939443-ad97-4001-ab83-b6cd1aeec70a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:21:59 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:21:59 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:21:59 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=8596MB free_disk=24.803646087646484GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:21:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:21:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:21:59 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance c23c9e00-b782-4530-bb01-a7a167951c1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:21:59 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9edd3f37-b2c5-48ba-96ec-8f8f39975875 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:21:59 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 12939443-ad97-4001-ab83-b6cd1aeec70a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:21:59 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance b68ff427-f94a-4513-99d5-a1c63cb16f10 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:21:59 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:21:59 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:21:59 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:21:59 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:21:59 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:21:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.321s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:21:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:02 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:22:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:03 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:22:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:22:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:22:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:22:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:22:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:22:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:22:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:22:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:22:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:22:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG nova.compute.manager [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 04:22:15 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Creating image(s)
Nov 08 04:22:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Did not create local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Ensure instance console log exists: /opt/stack/data/nova/instances/b68ff427-f94a-4513-99d5-a1c63cb16f10/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Start _get_guest_xml network_info=[{"id": "85ecf643-4d2e-475a-9f34-0c6c409a9be9", "address": "fa:16:3e:3d:13:6d", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ecf643-4d", "ovs_interfaceid": "85ecf643-4d2e-475a-9f34-0c6c409a9be9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gHVIcAip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b68ff427-f94a-4513-99d5-a1c63cb16f10', 'attached_at': '', 'detached_at': '', 'volume_id': '98d07069-d8e0-4276-ba44-2dfb5aa529b9', 'serial': '98d07069-d8e0-4276-ba44-2dfb5aa529b9'}, 'device_type': 'disk', 'attachment_id': '8ac1346b-f29e-45e1-a57d-bea427ce9948', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:22:15 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:22:15 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:22:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gHVIcAip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:22:15 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:22:15 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:22:15 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:22:15 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:22:15 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:22:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff83816-ccee-4754-a318-13ff9a9a8781]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:22:15 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e95589-8cc1-4722-8cfe-a68949fc7a38]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9] added
Nov 08 04:22:15 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0dc4489-3075-4efc-9236-59d1b5ee0e42]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[789813ae-07b3-423f-8f59-399bd678058e]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:22:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gHVIcAip {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gHVIcAip" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76d0b51-9485-4202-a380-c747b13be4a3]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gHVIcAip'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f5cdf4-c78e-4580-bde4-658f9eedb3f8]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[29126bb7-80c7-45f7-804a-35e3a2896443]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:22:16 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:22:16 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[326ddbb6-f7bd-421b-888d-2a0380944efe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9, portal: 172.16.0.220,3260]
Nov 08 04:22:16 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9, portal: 172.16.0.220,3260] successful.
Nov 08 04:22:16 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e076afd0-7186-4222-9698-ee7ef14565bd]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3f1bd1-7b05-442e-a3a7-d901153300ec]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:22:16 user nova-compute[75014]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 (non-flash)
Nov 08 04:22:16 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:22:16 user nova-compute[75014]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 (non-flash)
Nov 08 04:22:16 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-62861d32-e887-470f-8064-b23ce75ee2d8 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "c23c9e00-b782-4530-bb01-a7a167951c1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-62861d32-e887-470f-8064-b23ce75ee2d8 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "c23c9e00-b782-4530-bb01-a7a167951c1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-62861d32-e887-470f-8064-b23ce75ee2d8 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "c23c9e00-b782-4530-bb01-a7a167951c1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-62861d32-e887-470f-8064-b23ce75ee2d8 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "c23c9e00-b782-4530-bb01-a7a167951c1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-62861d32-e887-470f-8064-b23ce75ee2d8 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "c23c9e00-b782-4530-bb01-a7a167951c1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:22:16 user nova-compute[75014]: INFO nova.compute.manager [None req-62861d32-e887-470f-8064-b23ce75ee2d8 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Terminating instance
Nov 08 04:22:16 user nova-compute[75014]: DEBUG nova.compute.manager [None req-62861d32-e887-470f-8064-b23ce75ee2d8 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c788b7-f045-4d6f-9056-37cd92dba7a2]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gHVIcAip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG nova.compute.manager [req-5a9e62fe-1d32-41e9-aca2-a02eb9245fa6 req-7cb80dd8-a29d-4030-89a2-a3c7cea9a661 service nova] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Received event network-vif-unplugged-4f3b192f-a567-463a-b120-1b328e11feaa {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5a9e62fe-1d32-41e9-aca2-a02eb9245fa6 req-7cb80dd8-a29d-4030-89a2-a3c7cea9a661 service nova] Acquiring lock "c23c9e00-b782-4530-bb01-a7a167951c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5a9e62fe-1d32-41e9-aca2-a02eb9245fa6 req-7cb80dd8-a29d-4030-89a2-a3c7cea9a661 service nova] Lock "c23c9e00-b782-4530-bb01-a7a167951c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-5a9e62fe-1d32-41e9-aca2-a02eb9245fa6 req-7cb80dd8-a29d-4030-89a2-a3c7cea9a661 service nova] Lock "c23c9e00-b782-4530-bb01-a7a167951c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG nova.compute.manager [req-5a9e62fe-1d32-41e9-aca2-a02eb9245fa6 req-7cb80dd8-a29d-4030-89a2-a3c7cea9a661 service nova] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] No waiting events found dispatching network-vif-unplugged-4f3b192f-a567-463a-b120-1b328e11feaa {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG nova.compute.manager [req-5a9e62fe-1d32-41e9-aca2-a02eb9245fa6 req-7cb80dd8-a29d-4030-89a2-a3c7cea9a661 service nova] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Received event network-vif-unplugged-4f3b192f-a567-463a-b120-1b328e11feaa for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:16 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Instance destroyed successfully.
Nov 08 04:22:16 user nova-compute[75014]: DEBUG nova.objects.instance [None req-62861d32-e887-470f-8064-b23ce75ee2d8 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lazy-loading 'resources' on Instance uuid c23c9e00-b782-4530-bb01-a7a167951c1d {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-62861d32-e887-470f-8064-b23ce75ee2d8 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:00:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-508777179',display_name='tempest-ServerActionsTestOtherA-server-508777179',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-508777179',id=27,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrmtIbZxgIG+Mj0FCPzPyxgkvpjo1RlPcXcxfMKotFzO42Fyp9FxpoU2iamZDPiUFM+ibJrBLSV5KEQ2GBDLuvdHnBp4eyBffs9QFbrBPe1RSRIG54GYFQAZ3CvgZJG1Q==',key_name='tempest-keypair-516992333',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:00:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b9ecaed30ba4ad1a9d5eaca02633604',ramdisk_id='',reservation_id='r-nt4tf759',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-537496863',owner_user_name='tempest-ServerActionsTestOtherA-537496863-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:00:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8398fcf62a014e7f943bff6fcc3f72f3',uuid=c23c9e00-b782-4530-bb01-a7a167951c1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f3b192f-a567-463a-b120-1b328e11feaa", "address": "fa:16:3e:70:b6:a1", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3b192f-a5", "ovs_interfaceid": "4f3b192f-a567-463a-b120-1b328e11feaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-62861d32-e887-470f-8064-b23ce75ee2d8 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Converting VIF {"id": "4f3b192f-a567-463a-b120-1b328e11feaa", "address": "fa:16:3e:70:b6:a1", "network": {"id": "9966ce52-2b85-45e2-b09f-c8abdd4c8e9b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-331965167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b9ecaed30ba4ad1a9d5eaca02633604", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3b192f-a5", "ovs_interfaceid": "4f3b192f-a567-463a-b120-1b328e11feaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-62861d32-e887-470f-8064-b23ce75ee2d8 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:b6:a1,bridge_name='br-int',has_traffic_filtering=True,id=4f3b192f-a567-463a-b120-1b328e11feaa,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f3b192f-a5') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG os_vif [None req-62861d32-e887-470f-8064-b23ce75ee2d8 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:b6:a1,bridge_name='br-int',has_traffic_filtering=True,id=4f3b192f-a567-463a-b120-1b328e11feaa,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f3b192f-a5') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f3b192f-a5, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=80f3036d-6a80-498e-bd88-35656a26c037) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:22:16 user nova-compute[75014]: INFO os_vif [None req-62861d32-e887-470f-8064-b23ce75ee2d8 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:b6:a1,bridge_name='br-int',has_traffic_filtering=True,id=4f3b192f-a567-463a-b120-1b328e11feaa,network=Network(9966ce52-2b85-45e2-b09f-c8abdd4c8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f3b192f-a5')
Nov 08 04:22:16 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-62861d32-e887-470f-8064-b23ce75ee2d8 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Deleting instance files /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d_del
Nov 08 04:22:16 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-62861d32-e887-470f-8064-b23ce75ee2d8 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Deletion of /opt/stack/data/nova/instances/c23c9e00-b782-4530-bb01-a7a167951c1d_del complete
Nov 08 04:22:17 user nova-compute[75014]: INFO nova.compute.manager [None req-62861d32-e887-470f-8064-b23ce75ee2d8 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 08 04:22:17 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-62861d32-e887-470f-8064-b23ce75ee2d8 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26637326666626236', 'path': '/dev/sdb'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637326666626236', 'path': '/dev/sdb'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1425228586',display_name='tempest-TestVolumeBootPattern-server-1425228586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1425228586',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='504ed2858e78480e9beef5aa5f5d9f1d',ramdisk_id='',reservation_id='r-gpz0ick5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2082374398',owner_user_name='tempest-TestVolumeBootPattern-2082374398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:21:37Z,user_data=None,user_id='fe1c5af56ab14da7986d64e38597d394',uuid=b68ff427-f94a-4513-99d5-a1c63cb16f10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85ecf643-4d2e-475a-9f34-0c6c409a9be9", "address": "fa:16:3e:3d:13:6d", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ecf643-4d", "ovs_interfaceid": "85ecf643-4d2e-475a-9f34-0c6c409a9be9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converting VIF {"id": "85ecf643-4d2e-475a-9f34-0c6c409a9be9", "address": "fa:16:3e:3d:13:6d", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ecf643-4d", "ovs_interfaceid": "85ecf643-4d2e-475a-9f34-0c6c409a9be9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:13:6d,bridge_name='br-int',has_traffic_filtering=True,id=85ecf643-4d2e-475a-9f34-0c6c409a9be9,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ecf643-4d') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG nova.objects.instance [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lazy-loading 'pci_devices' on Instance uuid b68ff427-f94a-4513-99d5-a1c63cb16f10 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:22:17 user nova-compute[75014]:   <uuid>b68ff427-f94a-4513-99d5-a1c63cb16f10</uuid>
Nov 08 04:22:17 user nova-compute[75014]:   <name>instance-0000002d</name>
Nov 08 04:22:17 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:22:17 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:22:17 user nova-compute[75014]:   <metadata>
Nov 08 04:22:17 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:22:17 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:22:17 user nova-compute[75014]:       <nova:name>tempest-TestVolumeBootPattern-server-1425228586</nova:name>
Nov 08 04:22:17 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:22:15</nova:creationTime>
Nov 08 04:22:17 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:22:17 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:22:17 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:22:17 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:22:17 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:22:17 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:22:17 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:22:17 user nova-compute[75014]:       <nova:owner>
Nov 08 04:22:17 user nova-compute[75014]:         <nova:user uuid="fe1c5af56ab14da7986d64e38597d394">tempest-TestVolumeBootPattern-2082374398-project-member</nova:user>
Nov 08 04:22:17 user nova-compute[75014]:         <nova:project uuid="504ed2858e78480e9beef5aa5f5d9f1d">tempest-TestVolumeBootPattern-2082374398</nova:project>
Nov 08 04:22:17 user nova-compute[75014]:       </nova:owner>
Nov 08 04:22:17 user nova-compute[75014]:       <nova:ports>
Nov 08 04:22:17 user nova-compute[75014]:         <nova:port uuid="85ecf643-4d2e-475a-9f34-0c6c409a9be9">
Nov 08 04:22:17 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 04:22:17 user nova-compute[75014]:         </nova:port>
Nov 08 04:22:17 user nova-compute[75014]:       </nova:ports>
Nov 08 04:22:17 user nova-compute[75014]:     </nova:instance>
Nov 08 04:22:17 user nova-compute[75014]:   </metadata>
Nov 08 04:22:17 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:22:17 user nova-compute[75014]:     <system>
Nov 08 04:22:17 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:22:17 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:22:17 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:22:17 user nova-compute[75014]:       <entry name="serial">b68ff427-f94a-4513-99d5-a1c63cb16f10</entry>
Nov 08 04:22:17 user nova-compute[75014]:       <entry name="uuid">b68ff427-f94a-4513-99d5-a1c63cb16f10</entry>
Nov 08 04:22:17 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:22:17 user nova-compute[75014]:     </system>
Nov 08 04:22:17 user nova-compute[75014]:   </sysinfo>
Nov 08 04:22:17 user nova-compute[75014]:   <os>
Nov 08 04:22:17 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:22:17 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:22:17 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:22:17 user nova-compute[75014]:   </os>
Nov 08 04:22:17 user nova-compute[75014]:   <features>
Nov 08 04:22:17 user nova-compute[75014]:     <acpi/>
Nov 08 04:22:17 user nova-compute[75014]:     <apic/>
Nov 08 04:22:17 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:22:17 user nova-compute[75014]:   </features>
Nov 08 04:22:17 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:22:17 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:22:17 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:22:17 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:22:17 user nova-compute[75014]:   </clock>
Nov 08 04:22:17 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:22:17 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:22:17 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:22:17 user nova-compute[75014]:   </cpu>
Nov 08 04:22:17 user nova-compute[75014]:   <devices>
Nov 08 04:22:17 user nova-compute[75014]:     <disk type="block" device="disk">
Nov 08 04:22:17 user nova-compute[75014]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:22:17 user nova-compute[75014]:       <source dev="/dev/sdb"/>
Nov 08 04:22:17 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:22:17 user nova-compute[75014]:       <serial>98d07069-d8e0-4276-ba44-2dfb5aa529b9</serial>
Nov 08 04:22:17 user nova-compute[75014]:     </disk>
Nov 08 04:22:17 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:22:17 user nova-compute[75014]:       <mac address="fa:16:3e:3d:13:6d"/>
Nov 08 04:22:17 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:22:17 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:22:17 user nova-compute[75014]:       <target dev="tap85ecf643-4d"/>
Nov 08 04:22:17 user nova-compute[75014]:     </interface>
Nov 08 04:22:17 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:22:17 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/b68ff427-f94a-4513-99d5-a1c63cb16f10/console.log" append="off"/>
Nov 08 04:22:17 user nova-compute[75014]:     </serial>
Nov 08 04:22:17 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:22:17 user nova-compute[75014]:     <video>
Nov 08 04:22:17 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:22:17 user nova-compute[75014]:     </video>
Nov 08 04:22:17 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:22:17 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:22:17 user nova-compute[75014]:     </rng>
Nov 08 04:22:17 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:22:17 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:22:17 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:22:17 user nova-compute[75014]:     </memballoon>
Nov 08 04:22:17 user nova-compute[75014]:   </devices>
Nov 08 04:22:17 user nova-compute[75014]: </domain>
Nov 08 04:22:17 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1425228586',display_name='tempest-TestVolumeBootPattern-server-1425228586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1425228586',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='504ed2858e78480e9beef5aa5f5d9f1d',ramdisk_id='',reservation_id='r-gpz0ick5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2082374398',owner_user_name='tempest-TestVolumeBootPattern-2082374398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:21:37Z,user_data=None,user_id='fe1c5af56ab14da7986d64e38597d394',uuid=b68ff427-f94a-4513-99d5-a1c63cb16f10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85ecf643-4d2e-475a-9f34-0c6c409a9be9", "address": "fa:16:3e:3d:13:6d", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ecf643-4d", "ovs_interfaceid": "85ecf643-4d2e-475a-9f34-0c6c409a9be9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converting VIF {"id": "85ecf643-4d2e-475a-9f34-0c6c409a9be9", "address": "fa:16:3e:3d:13:6d", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ecf643-4d", "ovs_interfaceid": "85ecf643-4d2e-475a-9f34-0c6c409a9be9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:13:6d,bridge_name='br-int',has_traffic_filtering=True,id=85ecf643-4d2e-475a-9f34-0c6c409a9be9,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ecf643-4d') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG os_vif [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:13:6d,bridge_name='br-int',has_traffic_filtering=True,id=85ecf643-4d2e-475a-9f34-0c6c409a9be9,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ecf643-4d') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '91f99aa3-174c-5ac9-908f-45a0879606a5', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85ecf643-4d, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85ecf643-4d, col_values=(('qos', UUID('a79cb948-ffd7-4487-8f6c-87d2d3a3fdea')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85ecf643-4d, col_values=(('external_ids', {'iface-id': '85ecf643-4d2e-475a-9f34-0c6c409a9be9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:13:6d', 'vm-uuid': 'b68ff427-f94a-4513-99d5-a1c63cb16f10'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:17 user nova-compute[75014]: INFO os_vif [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:13:6d,bridge_name='br-int',has_traffic_filtering=True,id=85ecf643-4d2e-475a-9f34-0c6c409a9be9,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ecf643-4d')
Nov 08 04:22:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] No VIF found with MAC fa:16:3e:3d:13:6d, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:22:17 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Took 0.40 seconds to deallocate network for instance.
Nov 08 04:22:17 user nova-compute[75014]: DEBUG nova.compute.manager [req-ebda8a06-a7e5-4360-965a-05ef71dd9c23 req-b9b478df-a33e-44f9-89cd-907b0a226845 service nova] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Received event network-vif-deleted-4f3b192f-a567-463a-b120-1b328e11feaa {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:22:17 user nova-compute[75014]: INFO nova.compute.manager [req-ebda8a06-a7e5-4360-965a-05ef71dd9c23 req-b9b478df-a33e-44f9-89cd-907b0a226845 service nova] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Neutron deleted interface 4f3b192f-a567-463a-b120-1b328e11feaa; detaching it from the instance and deleting it from the info cache
Nov 08 04:22:17 user nova-compute[75014]: DEBUG nova.network.neutron [req-ebda8a06-a7e5-4360-965a-05ef71dd9c23 req-b9b478df-a33e-44f9-89cd-907b0a226845 service nova] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG nova.compute.manager [req-ebda8a06-a7e5-4360-965a-05ef71dd9c23 req-b9b478df-a33e-44f9-89cd-907b0a226845 service nova] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Detach interface failed, port_id=4f3b192f-a567-463a-b120-1b328e11feaa, reason: Instance c23c9e00-b782-4530-bb01-a7a167951c1d could not be found. {{(pid=75014) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-62861d32-e887-470f-8064-b23ce75ee2d8 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-62861d32-e887-470f-8064-b23ce75ee2d8 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-62861d32-e887-470f-8064-b23ce75ee2d8 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-62861d32-e887-470f-8064-b23ce75ee2d8 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:22:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-62861d32-e887-470f-8064-b23ce75ee2d8 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.204s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:22:17 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-62861d32-e887-470f-8064-b23ce75ee2d8 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Deleted allocations for instance c23c9e00-b782-4530-bb01-a7a167951c1d
Nov 08 04:22:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-62861d32-e887-470f-8064-b23ce75ee2d8 tempest-ServerActionsTestOtherA-537496863 tempest-ServerActionsTestOtherA-537496863-project-member] Lock "c23c9e00-b782-4530-bb01-a7a167951c1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.672s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:22:18 user nova-compute[75014]: DEBUG nova.compute.manager [req-c80c4664-c3f3-42e9-ad88-e95db1c37125 req-6a48c0fb-ca82-4211-bafd-61931b2e4310 service nova] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Received event network-vif-plugged-4f3b192f-a567-463a-b120-1b328e11feaa {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:22:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c80c4664-c3f3-42e9-ad88-e95db1c37125 req-6a48c0fb-ca82-4211-bafd-61931b2e4310 service nova] Acquiring lock "c23c9e00-b782-4530-bb01-a7a167951c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:22:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c80c4664-c3f3-42e9-ad88-e95db1c37125 req-6a48c0fb-ca82-4211-bafd-61931b2e4310 service nova] Lock "c23c9e00-b782-4530-bb01-a7a167951c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:22:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-c80c4664-c3f3-42e9-ad88-e95db1c37125 req-6a48c0fb-ca82-4211-bafd-61931b2e4310 service nova] Lock "c23c9e00-b782-4530-bb01-a7a167951c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:22:18 user nova-compute[75014]: DEBUG nova.compute.manager [req-c80c4664-c3f3-42e9-ad88-e95db1c37125 req-6a48c0fb-ca82-4211-bafd-61931b2e4310 service nova] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] No waiting events found dispatching network-vif-plugged-4f3b192f-a567-463a-b120-1b328e11feaa {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:22:18 user nova-compute[75014]: WARNING nova.compute.manager [req-c80c4664-c3f3-42e9-ad88-e95db1c37125 req-6a48c0fb-ca82-4211-bafd-61931b2e4310 service nova] [instance: c23c9e00-b782-4530-bb01-a7a167951c1d] Received unexpected event network-vif-plugged-4f3b192f-a567-463a-b120-1b328e11feaa for instance with vm_state deleted and task_state None.
Nov 08 04:22:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:18 user nova-compute[75014]: DEBUG nova.compute.manager [req-f5be6527-db00-47a5-9244-268606438330 req-3088ef9a-114d-425c-b411-a91052086fdf service nova] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Received event network-vif-plugged-85ecf643-4d2e-475a-9f34-0c6c409a9be9 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:22:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f5be6527-db00-47a5-9244-268606438330 req-3088ef9a-114d-425c-b411-a91052086fdf service nova] Acquiring lock "b68ff427-f94a-4513-99d5-a1c63cb16f10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:22:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f5be6527-db00-47a5-9244-268606438330 req-3088ef9a-114d-425c-b411-a91052086fdf service nova] Lock "b68ff427-f94a-4513-99d5-a1c63cb16f10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:22:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f5be6527-db00-47a5-9244-268606438330 req-3088ef9a-114d-425c-b411-a91052086fdf service nova] Lock "b68ff427-f94a-4513-99d5-a1c63cb16f10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:22:18 user nova-compute[75014]: DEBUG nova.compute.manager [req-f5be6527-db00-47a5-9244-268606438330 req-3088ef9a-114d-425c-b411-a91052086fdf service nova] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] No waiting events found dispatching network-vif-plugged-85ecf643-4d2e-475a-9f34-0c6c409a9be9 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:22:18 user nova-compute[75014]: WARNING nova.compute.manager [req-f5be6527-db00-47a5-9244-268606438330 req-3088ef9a-114d-425c-b411-a91052086fdf service nova] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Received unexpected event network-vif-plugged-85ecf643-4d2e-475a-9f34-0c6c409a9be9 for instance with vm_state building and task_state spawning.
Nov 08 04:22:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:20 user nova-compute[75014]: DEBUG nova.compute.manager [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:22:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 04:22:20 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Instance spawned successfully.
Nov 08 04:22:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 04:22:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:22:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:22:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:22:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:22:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:22:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:22:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-49012ca1-592d-4a09-98e6-3669501fcd2b req-088f58cf-18fa-4394-92a8-236f0b41954b service nova] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Received event network-vif-plugged-85ecf643-4d2e-475a-9f34-0c6c409a9be9 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:22:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-49012ca1-592d-4a09-98e6-3669501fcd2b req-088f58cf-18fa-4394-92a8-236f0b41954b service nova] Acquiring lock "b68ff427-f94a-4513-99d5-a1c63cb16f10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:22:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-49012ca1-592d-4a09-98e6-3669501fcd2b req-088f58cf-18fa-4394-92a8-236f0b41954b service nova] Lock "b68ff427-f94a-4513-99d5-a1c63cb16f10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:22:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-49012ca1-592d-4a09-98e6-3669501fcd2b req-088f58cf-18fa-4394-92a8-236f0b41954b service nova] Lock "b68ff427-f94a-4513-99d5-a1c63cb16f10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:22:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-49012ca1-592d-4a09-98e6-3669501fcd2b req-088f58cf-18fa-4394-92a8-236f0b41954b service nova] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] No waiting events found dispatching network-vif-plugged-85ecf643-4d2e-475a-9f34-0c6c409a9be9 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:22:20 user nova-compute[75014]: WARNING nova.compute.manager [req-49012ca1-592d-4a09-98e6-3669501fcd2b req-088f58cf-18fa-4394-92a8-236f0b41954b service nova] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Received unexpected event network-vif-plugged-85ecf643-4d2e-475a-9f34-0c6c409a9be9 for instance with vm_state building and task_state spawning.
Nov 08 04:22:20 user nova-compute[75014]: INFO nova.compute.manager [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Took 5.05 seconds to spawn the instance on the hypervisor.
Nov 08 04:22:20 user nova-compute[75014]: DEBUG nova.compute.manager [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:22:21 user nova-compute[75014]: INFO nova.compute.manager [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Took 44.35 seconds to build instance.
Nov 08 04:22:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-9035523e-8be4-4c26-b360-8a4412cc1b9b tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "b68ff427-f94a-4513-99d5-a1c63cb16f10" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 44.441s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:22:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:22:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:22:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:22:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:22:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:22:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:45 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:22:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:47 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:22:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:48 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:22:49 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:22:49 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:22:49 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Rebuilding the list of instances to heal {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 04:22:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-9edd3f37-b2c5-48ba-96ec-8f8f39975875" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:22:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-9edd3f37-b2c5-48ba-96ec-8f8f39975875" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:22:49 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 04:22:49 user nova-compute[75014]: DEBUG nova.objects.instance [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lazy-loading 'info_cache' on Instance uuid 9edd3f37-b2c5-48ba-96ec-8f8f39975875 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:22:49 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Updating instance_info_cache with network_info: [{"id": "90d4a51e-8558-4326-b2c4-b29e584ba8e4", "address": "fa:16:3e:b8:c7:f9", "network": {"id": "4d522d89-a309-4855-b48c-eb20e3a7cdea", "bridge": "br-int", "label": "tempest-TestStampPattern-1021360457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bff47d48dd4d64bdfa4c4e60d04d60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90d4a51e-85", "ovs_interfaceid": "90d4a51e-8558-4326-b2c4-b29e584ba8e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:22:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-9edd3f37-b2c5-48ba-96ec-8f8f39975875" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:22:49 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 04:22:51 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:22:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:56 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:22:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:22:57 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:22:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:22:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:22:57 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:22:57 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:22:57 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:22:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:22:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:22:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:22:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:22:57 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12939443-ad97-4001-ab83-b6cd1aeec70a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:22:58 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12939443-ad97-4001-ab83-b6cd1aeec70a/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:22:58 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12939443-ad97-4001-ab83-b6cd1aeec70a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:22:58 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12939443-ad97-4001-ab83-b6cd1aeec70a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:22:58 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:22:58 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:22:58 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=8618MB free_disk=24.827945709228516GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:22:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:22:58 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:22:58 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9edd3f37-b2c5-48ba-96ec-8f8f39975875 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:22:58 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 12939443-ad97-4001-ab83-b6cd1aeec70a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:22:58 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance b68ff427-f94a-4513-99d5-a1c63cb16f10 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:22:58 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:22:58 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:22:58 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:22:59 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:22:59 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:22:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.331s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:22:59 user nova-compute[75014]: DEBUG nova.compute.manager [req-0500e59a-f2ab-440f-af0e-ed9bad245395 req-e3474111-637d-42b0-9fa9-4027fcab5d00 service nova] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Received event network-changed-9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:22:59 user nova-compute[75014]: DEBUG nova.compute.manager [req-0500e59a-f2ab-440f-af0e-ed9bad245395 req-e3474111-637d-42b0-9fa9-4027fcab5d00 service nova] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Refreshing instance network info cache due to event network-changed-9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:22:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0500e59a-f2ab-440f-af0e-ed9bad245395 req-e3474111-637d-42b0-9fa9-4027fcab5d00 service nova] Acquiring lock "refresh_cache-12939443-ad97-4001-ab83-b6cd1aeec70a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:22:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0500e59a-f2ab-440f-af0e-ed9bad245395 req-e3474111-637d-42b0-9fa9-4027fcab5d00 service nova] Acquired lock "refresh_cache-12939443-ad97-4001-ab83-b6cd1aeec70a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:22:59 user nova-compute[75014]: DEBUG nova.network.neutron [req-0500e59a-f2ab-440f-af0e-ed9bad245395 req-e3474111-637d-42b0-9fa9-4027fcab5d00 service nova] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Refreshing network info cache for port 9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:22:59 user nova-compute[75014]: DEBUG nova.network.neutron [req-0500e59a-f2ab-440f-af0e-ed9bad245395 req-e3474111-637d-42b0-9fa9-4027fcab5d00 service nova] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Updated VIF entry in instance network info cache for port 9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:22:59 user nova-compute[75014]: DEBUG nova.network.neutron [req-0500e59a-f2ab-440f-af0e-ed9bad245395 req-e3474111-637d-42b0-9fa9-4027fcab5d00 service nova] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Updating instance_info_cache with network_info: [{"id": "9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4", "address": "fa:16:3e:c2:0b:1f", "network": {"id": "4d522d89-a309-4855-b48c-eb20e3a7cdea", "bridge": "br-int", "label": "tempest-TestStampPattern-1021360457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bff47d48dd4d64bdfa4c4e60d04d60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffa1dc1-bb", "ovs_interfaceid": "9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:22:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0500e59a-f2ab-440f-af0e-ed9bad245395 req-e3474111-637d-42b0-9fa9-4027fcab5d00 service nova] Releasing lock "refresh_cache-12939443-ad97-4001-ab83-b6cd1aeec70a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:22:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquiring lock "12939443-ad97-4001-ab83-b6cd1aeec70a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:22:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "12939443-ad97-4001-ab83-b6cd1aeec70a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:22:59 user nova-compute[75014]: DEBUG nova.objects.instance [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lazy-loading 'flavor' on Instance uuid 12939443-ad97-4001-ab83-b6cd1aeec70a {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:22:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "12939443-ad97-4001-ab83-b6cd1aeec70a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.101s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:23:00 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:23:00 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:23:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquiring lock "12939443-ad97-4001-ab83-b6cd1aeec70a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:23:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "12939443-ad97-4001-ab83-b6cd1aeec70a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:23:00 user nova-compute[75014]: INFO nova.compute.manager [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Attaching volume 94bf8f9f-98df-4376-bb80-3838f4bbe08d to /dev/vdb
Nov 08 04:23:00 user nova-compute[75014]: DEBUG os_brick.utils [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:23:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:00 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1415e6-1538-4684-8ad3-3e09b7fe94ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:00 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[db94108d-62ab-49ce-9be8-54ddf289d014]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:00 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d439d7-b673-49a6-9fbe-5c39232c76b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:00 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc4108c-cc3b-4587-a8b7-637d4c0d8184]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:23:00 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:23:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:23:00 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:23:00 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4513ad2b-28f5-4464-8711-f3503a1db5d9]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:00 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:23:00 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:23:00 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:23:00 user nova-compute[75014]: DEBUG os_brick.utils [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:23:00 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Updating existing volume attachment record: db321465-3c7b-4bf0-ade7-c5b59422264a {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:23:01 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:23:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:23:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:12 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquiring lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:23:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:23:20 user nova-compute[75014]: DEBUG nova.compute.manager [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 04:23:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:23:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:23:20 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 04:23:20 user nova-compute[75014]: INFO nova.compute.claims [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Claim successful on node user
Nov 08 04:23:21 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:23:21 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:23:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.308s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:23:21 user nova-compute[75014]: DEBUG nova.compute.manager [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 04:23:21 user nova-compute[75014]: DEBUG nova.compute.manager [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 04:23:21 user nova-compute[75014]: DEBUG nova.network.neutron [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 04:23:21 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 04:23:21 user nova-compute[75014]: DEBUG nova.compute.manager [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 04:23:21 user nova-compute[75014]: DEBUG nova.policy [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b0c5324a67d4137b0ac20c505d28251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec7bf4b5935436792895f9a522431c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 04:23:21 user nova-compute[75014]: DEBUG nova.compute.manager [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 04:23:21 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 04:23:21 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Creating image(s)
Nov 08 04:23:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquiring lock "/opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:23:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "/opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:23:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "/opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:23:21 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:21 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.182s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:23:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:23:21 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:21 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.178s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:21 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:21 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk 1073741824" returned: 0 in 0.051s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:23:21 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:21 user nova-compute[75014]: DEBUG nova.network.neutron [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Successfully created port: 3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.190s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Checking if we can resize image /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Cannot resize image /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Ensure instance console log exists: /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG nova.network.neutron [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Successfully updated port: 3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquiring lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquired lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG nova.network.neutron [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG nova.compute.manager [req-d35a632d-fb4a-4a98-9741-cb1239c8456d req-c0561843-b052-491d-a0d6-21b691b7a399 service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received event network-changed-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG nova.compute.manager [req-d35a632d-fb4a-4a98-9741-cb1239c8456d req-c0561843-b052-491d-a0d6-21b691b7a399 service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Refreshing instance network info cache due to event network-changed-3137db93-bf8f-4d21-a1df-f9b6014d46bf. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d35a632d-fb4a-4a98-9741-cb1239c8456d req-c0561843-b052-491d-a0d6-21b691b7a399 service nova] Acquiring lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG nova.network.neutron [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG nova.network.neutron [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Updating instance_info_cache with network_info: [{"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Releasing lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG nova.compute.manager [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Instance network_info: |[{"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d35a632d-fb4a-4a98-9741-cb1239c8456d req-c0561843-b052-491d-a0d6-21b691b7a399 service nova] Acquired lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG nova.network.neutron [req-d35a632d-fb4a-4a98-9741-cb1239c8456d req-c0561843-b052-491d-a0d6-21b691b7a399 service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Refreshing network info cache for port 3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Start _get_guest_xml network_info=[{"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:23:22 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:23:22 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:23:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:23:22 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:23:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-809427286',display_name='tempest-ServerActionsTestOtherB-server-809427286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-809427286',id=46,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdfoac/qWiSELcxtzUkuk+o8acjsOIEGrFVZM627fy7ovi3OfsfBH6nUCuIfY7BK2ldXdAqxdoVU6c1JyFZHm23ngkkF9j7Yy2b+7zJu1QcSK4PuxDPCnQBF7ZI6NxBlg==',key_name='tempest-keypair-1823743126',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ec7bf4b5935436792895f9a522431c4',ramdisk_id='',reservation_id='r-o63p9ir8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1064545051',owner_user_name='tempest-ServerActionsTestOtherB-1064545051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:23:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b0c5324a67d4137b0ac20c505d28251',uuid=08acc858-dc89-4ae8-9b48-08e6de5db0d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:23:23 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Converting VIF {"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:23:23 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:95:35,bridge_name='br-int',has_traffic_filtering=True,id=3137db93-bf8f-4d21-a1df-f9b6014d46bf,network=Network(5dbeed84-c2af-4e98-b511-a7500ba483e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3137db93-bf') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:23:23 user nova-compute[75014]: DEBUG nova.objects.instance [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lazy-loading 'pci_devices' on Instance uuid 08acc858-dc89-4ae8-9b48-08e6de5db0d0 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:23:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:23:23 user nova-compute[75014]:   <uuid>08acc858-dc89-4ae8-9b48-08e6de5db0d0</uuid>
Nov 08 04:23:23 user nova-compute[75014]:   <name>instance-0000002e</name>
Nov 08 04:23:23 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:23:23 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:23:23 user nova-compute[75014]:   <metadata>
Nov 08 04:23:23 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:23:23 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:23:23 user nova-compute[75014]:       <nova:name>tempest-ServerActionsTestOtherB-server-809427286</nova:name>
Nov 08 04:23:23 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:23:22</nova:creationTime>
Nov 08 04:23:23 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:23:23 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:23:23 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:23:23 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:23:23 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:23:23 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:23:23 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:23:23 user nova-compute[75014]:       <nova:owner>
Nov 08 04:23:23 user nova-compute[75014]:         <nova:user uuid="4b0c5324a67d4137b0ac20c505d28251">tempest-ServerActionsTestOtherB-1064545051-project-member</nova:user>
Nov 08 04:23:23 user nova-compute[75014]:         <nova:project uuid="7ec7bf4b5935436792895f9a522431c4">tempest-ServerActionsTestOtherB-1064545051</nova:project>
Nov 08 04:23:23 user nova-compute[75014]:       </nova:owner>
Nov 08 04:23:23 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:23:23 user nova-compute[75014]:       <nova:ports>
Nov 08 04:23:23 user nova-compute[75014]:         <nova:port uuid="3137db93-bf8f-4d21-a1df-f9b6014d46bf">
Nov 08 04:23:23 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 04:23:23 user nova-compute[75014]:         </nova:port>
Nov 08 04:23:23 user nova-compute[75014]:       </nova:ports>
Nov 08 04:23:23 user nova-compute[75014]:     </nova:instance>
Nov 08 04:23:23 user nova-compute[75014]:   </metadata>
Nov 08 04:23:23 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:23:23 user nova-compute[75014]:     <system>
Nov 08 04:23:23 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:23:23 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:23:23 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:23:23 user nova-compute[75014]:       <entry name="serial">08acc858-dc89-4ae8-9b48-08e6de5db0d0</entry>
Nov 08 04:23:23 user nova-compute[75014]:       <entry name="uuid">08acc858-dc89-4ae8-9b48-08e6de5db0d0</entry>
Nov 08 04:23:23 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:23:23 user nova-compute[75014]:     </system>
Nov 08 04:23:23 user nova-compute[75014]:   </sysinfo>
Nov 08 04:23:23 user nova-compute[75014]:   <os>
Nov 08 04:23:23 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:23:23 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:23:23 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:23:23 user nova-compute[75014]:   </os>
Nov 08 04:23:23 user nova-compute[75014]:   <features>
Nov 08 04:23:23 user nova-compute[75014]:     <acpi/>
Nov 08 04:23:23 user nova-compute[75014]:     <apic/>
Nov 08 04:23:23 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:23:23 user nova-compute[75014]:   </features>
Nov 08 04:23:23 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:23:23 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:23:23 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:23:23 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:23:23 user nova-compute[75014]:   </clock>
Nov 08 04:23:23 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:23:23 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:23:23 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:23:23 user nova-compute[75014]:   </cpu>
Nov 08 04:23:23 user nova-compute[75014]:   <devices>
Nov 08 04:23:23 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 04:23:23 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 04:23:23 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk"/>
Nov 08 04:23:23 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:23:23 user nova-compute[75014]:     </disk>
Nov 08 04:23:23 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:23:23 user nova-compute[75014]:       <mac address="fa:16:3e:42:95:35"/>
Nov 08 04:23:23 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:23:23 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:23:23 user nova-compute[75014]:       <target dev="tap3137db93-bf"/>
Nov 08 04:23:23 user nova-compute[75014]:     </interface>
Nov 08 04:23:23 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:23:23 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/console.log" append="off"/>
Nov 08 04:23:23 user nova-compute[75014]:     </serial>
Nov 08 04:23:23 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:23:23 user nova-compute[75014]:     <video>
Nov 08 04:23:23 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:23:23 user nova-compute[75014]:     </video>
Nov 08 04:23:23 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:23:23 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:23:23 user nova-compute[75014]:     </rng>
Nov 08 04:23:23 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:23:23 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:23:23 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:23:23 user nova-compute[75014]:     </memballoon>
Nov 08 04:23:23 user nova-compute[75014]:   </devices>
Nov 08 04:23:23 user nova-compute[75014]: </domain>
Nov 08 04:23:23 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:23:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-809427286',display_name='tempest-ServerActionsTestOtherB-server-809427286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-809427286',id=46,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdfoac/qWiSELcxtzUkuk+o8acjsOIEGrFVZM627fy7ovi3OfsfBH6nUCuIfY7BK2ldXdAqxdoVU6c1JyFZHm23ngkkF9j7Yy2b+7zJu1QcSK4PuxDPCnQBF7ZI6NxBlg==',key_name='tempest-keypair-1823743126',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ec7bf4b5935436792895f9a522431c4',ramdisk_id='',reservation_id='r-o63p9ir8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1064545051',owner_user_name='tempest-ServerActionsTestOtherB-1064545051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:23:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b0c5324a67d4137b0ac20c505d28251',uuid=08acc858-dc89-4ae8-9b48-08e6de5db0d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:23:23 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Converting VIF {"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:23:23 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:95:35,bridge_name='br-int',has_traffic_filtering=True,id=3137db93-bf8f-4d21-a1df-f9b6014d46bf,network=Network(5dbeed84-c2af-4e98-b511-a7500ba483e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3137db93-bf') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:23:23 user nova-compute[75014]: DEBUG os_vif [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:95:35,bridge_name='br-int',has_traffic_filtering=True,id=3137db93-bf8f-4d21-a1df-f9b6014d46bf,network=Network(5dbeed84-c2af-4e98-b511-a7500ba483e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3137db93-bf') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:23:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:23:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:23:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '156a7091-2ddc-5b39-a598-9e4511a43914', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:23:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:23:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3137db93-bf, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:23:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3137db93-bf, col_values=(('qos', UUID('91104fab-aca5-497f-a669-885f0b3506f4')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:23:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3137db93-bf, col_values=(('external_ids', {'iface-id': '3137db93-bf8f-4d21-a1df-f9b6014d46bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:95:35', 'vm-uuid': '08acc858-dc89-4ae8-9b48-08e6de5db0d0'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:23:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:23:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:23 user nova-compute[75014]: INFO os_vif [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:95:35,bridge_name='br-int',has_traffic_filtering=True,id=3137db93-bf8f-4d21-a1df-f9b6014d46bf,network=Network(5dbeed84-c2af-4e98-b511-a7500ba483e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3137db93-bf')
Nov 08 04:23:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:23:23 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] No VIF found with MAC fa:16:3e:42:95:35, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:23:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:23 user nova-compute[75014]: DEBUG nova.network.neutron [req-d35a632d-fb4a-4a98-9741-cb1239c8456d req-c0561843-b052-491d-a0d6-21b691b7a399 service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Updated VIF entry in instance network info cache for port 3137db93-bf8f-4d21-a1df-f9b6014d46bf. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:23:23 user nova-compute[75014]: DEBUG nova.network.neutron [req-d35a632d-fb4a-4a98-9741-cb1239c8456d req-c0561843-b052-491d-a0d6-21b691b7a399 service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Updating instance_info_cache with network_info: [{"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:23:23 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d35a632d-fb4a-4a98-9741-cb1239c8456d req-c0561843-b052-491d-a0d6-21b691b7a399 service nova] Releasing lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShUYzDHI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:23:24 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:23:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:23:24 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:23:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:23:24 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f54f70-2019-467f-93c1-fe1b8c74a523]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:23:24 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[af710c72-d606-4cb6-8f48-01751977daba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d] added
Nov 08 04:23:24 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67f2d7f-372e-410f-b081-d5675ecda829]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG nova.compute.manager [req-379b4234-c2a6-4f61-b8a3-4af5ac449503 req-848eaf40-5e6f-4eff-abc7-e5ff5af4648b service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received event network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-379b4234-c2a6-4f61-b8a3-4af5ac449503 req-848eaf40-5e6f-4eff-abc7-e5ff5af4648b service nova] Acquiring lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-379b4234-c2a6-4f61-b8a3-4af5ac449503 req-848eaf40-5e6f-4eff-abc7-e5ff5af4648b service nova] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-379b4234-c2a6-4f61-b8a3-4af5ac449503 req-848eaf40-5e6f-4eff-abc7-e5ff5af4648b service nova] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG nova.compute.manager [req-379b4234-c2a6-4f61-b8a3-4af5ac449503 req-848eaf40-5e6f-4eff-abc7-e5ff5af4648b service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] No waiting events found dispatching network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:23:24 user nova-compute[75014]: WARNING nova.compute.manager [req-379b4234-c2a6-4f61-b8a3-4af5ac449503 req-848eaf40-5e6f-4eff-abc7-e5ff5af4648b service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received unexpected event network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf for instance with vm_state building and task_state spawning.
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6a6f8a-e7c1-4d9a-8392-d840f02f4330]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ShUYzDHI {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ShUYzDHI" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c65a289-10d6-4ed3-beb6-3587423f0691]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ShUYzDHI'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cad59f-143e-41d4-8c78-70fa493c8bb6]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[19def7b4-716d-4913-8cc2-0898724ae8b0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:23:24 user nova-compute[75014]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 (non-flash)
Nov 08 04:23:24 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:23:24 user nova-compute[75014]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 (non-flash)
Nov 08 04:23:24 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[db76ee1f-fc02-4171-a1d4-bc27e3fa1282]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d, portal: 172.16.0.220,3260]
Nov 08 04:23:24 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d, portal: 172.16.0.220,3260] successful.
Nov 08 04:23:24 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2f0d61-9531-49b5-a090-c13b7d6fb162]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[638dd4f0-5e07-4c86-844d-02b0599ddc15]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:23:24 user nova-compute[75014]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 (non-flash)
Nov 08 04:23:24 user nova-compute[75014]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d (non-flash)
Nov 08 04:23:24 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:23:24 user nova-compute[75014]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 (non-flash)
Nov 08 04:23:24 user nova-compute[75014]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d (non-flash)
Nov 08 04:23:24 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee511e07-fb17-4f9d-8650-47625ffeac0c]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:23:24 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShUYzDHI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:23:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:23:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '23133346432373839', 'path': '/dev/sdc'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:23:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133346432373839', 'path': '/dev/sdc'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:23:25 user nova-compute[75014]: DEBUG nova.objects.instance [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lazy-loading 'flavor' on Instance uuid 12939443-ad97-4001-ab83-b6cd1aeec70a {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:23:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 04:23:25 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:23:25 user nova-compute[75014]:   <source dev="/dev/sdc"/>
Nov 08 04:23:25 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:23:25 user nova-compute[75014]:   <serial>94bf8f9f-98df-4376-bb80-3838f4bbe08d</serial>
Nov 08 04:23:25 user nova-compute[75014]: </disk>
Nov 08 04:23:25 user nova-compute[75014]:  {{(pid=75014) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 04:23:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:23:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:23:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] No VIF found with MAC fa:16:3e:c2:0b:1f, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:23:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-b6a8571f-d4b0-4d24-9dbb-fabbe21443ee tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "12939443-ad97-4001-ab83-b6cd1aeec70a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.279s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:23:26 user nova-compute[75014]: DEBUG nova.compute.manager [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:23:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 04:23:26 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Instance spawned successfully.
Nov 08 04:23:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 04:23:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:23:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:23:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:23:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:23:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:23:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:23:26 user nova-compute[75014]: DEBUG nova.compute.manager [req-2dd7762d-4611-40d6-8b11-0e36f78e44c8 req-ac50a42c-dee4-4b6c-bc49-813e124f498d service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received event network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:23:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2dd7762d-4611-40d6-8b11-0e36f78e44c8 req-ac50a42c-dee4-4b6c-bc49-813e124f498d service nova] Acquiring lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:23:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2dd7762d-4611-40d6-8b11-0e36f78e44c8 req-ac50a42c-dee4-4b6c-bc49-813e124f498d service nova] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:23:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-2dd7762d-4611-40d6-8b11-0e36f78e44c8 req-ac50a42c-dee4-4b6c-bc49-813e124f498d service nova] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:23:26 user nova-compute[75014]: DEBUG nova.compute.manager [req-2dd7762d-4611-40d6-8b11-0e36f78e44c8 req-ac50a42c-dee4-4b6c-bc49-813e124f498d service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] No waiting events found dispatching network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:23:26 user nova-compute[75014]: WARNING nova.compute.manager [req-2dd7762d-4611-40d6-8b11-0e36f78e44c8 req-ac50a42c-dee4-4b6c-bc49-813e124f498d service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received unexpected event network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf for instance with vm_state building and task_state spawning.
Nov 08 04:23:26 user nova-compute[75014]: INFO nova.compute.manager [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Took 5.45 seconds to spawn the instance on the hypervisor.
Nov 08 04:23:26 user nova-compute[75014]: DEBUG nova.compute.manager [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:23:26 user nova-compute[75014]: INFO nova.compute.manager [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Took 6.11 seconds to build instance.
Nov 08 04:23:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-377ff46d-ff46-4931-b1f0-b4d0d67a420d tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.239s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:23:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "b68ff427-f94a-4513-99d5-a1c63cb16f10" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:23:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "b68ff427-f94a-4513-99d5-a1c63cb16f10" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:23:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "b68ff427-f94a-4513-99d5-a1c63cb16f10-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:23:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "b68ff427-f94a-4513-99d5-a1c63cb16f10-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:23:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "b68ff427-f94a-4513-99d5-a1c63cb16f10-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:23:27 user nova-compute[75014]: INFO nova.compute.manager [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Terminating instance
Nov 08 04:23:27 user nova-compute[75014]: DEBUG nova.compute.manager [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:23:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:27 user nova-compute[75014]: DEBUG nova.compute.manager [req-9e3954a5-45cc-48f9-a757-be76ac349e74 req-90b9fb20-e394-4c69-8270-b382c795b5ca service nova] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Received event network-vif-unplugged-85ecf643-4d2e-475a-9f34-0c6c409a9be9 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:23:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-9e3954a5-45cc-48f9-a757-be76ac349e74 req-90b9fb20-e394-4c69-8270-b382c795b5ca service nova] Acquiring lock "b68ff427-f94a-4513-99d5-a1c63cb16f10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:23:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-9e3954a5-45cc-48f9-a757-be76ac349e74 req-90b9fb20-e394-4c69-8270-b382c795b5ca service nova] Lock "b68ff427-f94a-4513-99d5-a1c63cb16f10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:23:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-9e3954a5-45cc-48f9-a757-be76ac349e74 req-90b9fb20-e394-4c69-8270-b382c795b5ca service nova] Lock "b68ff427-f94a-4513-99d5-a1c63cb16f10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:23:27 user nova-compute[75014]: DEBUG nova.compute.manager [req-9e3954a5-45cc-48f9-a757-be76ac349e74 req-90b9fb20-e394-4c69-8270-b382c795b5ca service nova] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] No waiting events found dispatching network-vif-unplugged-85ecf643-4d2e-475a-9f34-0c6c409a9be9 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:23:27 user nova-compute[75014]: DEBUG nova.compute.manager [req-9e3954a5-45cc-48f9-a757-be76ac349e74 req-90b9fb20-e394-4c69-8270-b382c795b5ca service nova] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Received event network-vif-unplugged-85ecf643-4d2e-475a-9f34-0c6c409a9be9 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:23:28 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Instance destroyed successfully.
Nov 08 04:23:28 user nova-compute[75014]: DEBUG nova.objects.instance [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lazy-loading 'resources' on Instance uuid b68ff427-f94a-4513-99d5-a1c63cb16f10 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1425228586',display_name='tempest-TestVolumeBootPattern-server-1425228586',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1425228586',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:22:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='504ed2858e78480e9beef5aa5f5d9f1d',ramdisk_id='',reservation_id='r-gpz0ick5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2082374398',owner_user_name='tempest-TestVolumeBootPattern-2082374398-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:22:21Z,user_data=None,user_id='fe1c5af56ab14da7986d64e38597d394',uuid=b68ff427-f94a-4513-99d5-a1c63cb16f10,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85ecf643-4d2e-475a-9f34-0c6c409a9be9", "address": "fa:16:3e:3d:13:6d", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ecf643-4d", "ovs_interfaceid": "85ecf643-4d2e-475a-9f34-0c6c409a9be9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converting VIF {"id": "85ecf643-4d2e-475a-9f34-0c6c409a9be9", "address": "fa:16:3e:3d:13:6d", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ecf643-4d", "ovs_interfaceid": "85ecf643-4d2e-475a-9f34-0c6c409a9be9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:13:6d,bridge_name='br-int',has_traffic_filtering=True,id=85ecf643-4d2e-475a-9f34-0c6c409a9be9,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ecf643-4d') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG os_vif [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:13:6d,bridge_name='br-int',has_traffic_filtering=True,id=85ecf643-4d2e-475a-9f34-0c6c409a9be9,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ecf643-4d') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85ecf643-4d, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a79cb948-ffd7-4487-8f6c-87d2d3a3fdea) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:28 user nova-compute[75014]: INFO os_vif [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:13:6d,bridge_name='br-int',has_traffic_filtering=True,id=85ecf643-4d2e-475a-9f34-0c6c409a9be9,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ecf643-4d')
Nov 08 04:23:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gHVIcAip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:23:28 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:23:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5175742e-4e26-49b1-9eef-6b7e8081c6bf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:23:28 user nova-compute[75014]: No targets found.
Nov 08 04:23:28 user nova-compute[75014]: iSNS:
Nov 08 04:23:28 user nova-compute[75014]: No targets found.
Nov 08 04:23:28 user nova-compute[75014]: STATIC:
Nov 08 04:23:28 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:23:28 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:23:28 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:23:28 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d
Nov 08 04:23:28 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:23:28 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:23:28 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9
Nov 08 04:23:28 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:23:28 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:23:28 user nova-compute[75014]: FIRMWARE:
Nov 08 04:23:28 user nova-compute[75014]: No targets found.
Nov 08 04:23:28 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:23:28 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:23:28 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5855b94-16e9-4b62-bae0-72c4faa5bc29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6392685-662a-4200-87a2-d01c324e48d4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:23:28 user nova-compute[75014]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 (non-flash)
Nov 08 04:23:28 user nova-compute[75014]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d (non-flash)
Nov 08 04:23:28 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:23:28 user nova-compute[75014]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 (non-flash)
Nov 08 04:23:28 user nova-compute[75014]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d (non-flash)
Nov 08 04:23:28 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f040046edd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9'): ({'sdb'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Removing single pathed devices sdb {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[32441ccc-c545-453d-b6ac-6d9af06db914]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f92601-1cfc-4bce-854f-9b8064ac7dcc]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Flushing IO for device /dev/sdb {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4899c20-430d-4e49-96e0-7e8a3ebe04df]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c38bc2a-e8a4-41b0-a5d9-a96cff1d5f3e]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] SCSI volumes sdb have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26637326666626236', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_449de0fb', '/dev/disk/by-id/scsi-1SCST_BIO449de0fb-f72ffbb6ce61e43d') {{(pid=86544) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5ef886-15e4-4cbe-8cab-05fdc65d4359]: (4, None) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2333cee6-b8b3-4206-bcde-fbfdb45712ba]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ca162a-94a5-4a85-be74-864acca34a63]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9, portal: 172.16.0.220,3260]
Nov 08 04:23:28 user nova-compute[75014]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9, portal: 172.16.0.220,3260] successful.
Nov 08 04:23:28 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d07069-d8e0-4276-ba44-2dfb5aa529b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[84134f78-ed06-405d-8b01-025b3dafdd9f]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] <== disconnect_volume: return (361ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:23:28 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Deleting instance files /opt/stack/data/nova/instances/b68ff427-f94a-4513-99d5-a1c63cb16f10_del
Nov 08 04:23:28 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Deletion of /opt/stack/data/nova/instances/b68ff427-f94a-4513-99d5-a1c63cb16f10_del complete
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquiring lock "12939443-ad97-4001-ab83-b6cd1aeec70a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "12939443-ad97-4001-ab83-b6cd1aeec70a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:23:28 user nova-compute[75014]: INFO nova.compute.manager [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Detaching volume 94bf8f9f-98df-4376-bb80-3838f4bbe08d
Nov 08 04:23:28 user nova-compute[75014]: INFO nova.compute.manager [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 08 04:23:28 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:23:28 user nova-compute[75014]: INFO nova.virt.block_device [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Attempting to driver detach volume 94bf8f9f-98df-4376-bb80-3838f4bbe08d from mountpoint /dev/vdb
Nov 08 04:23:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Attempting to detach device vdb from instance 12939443-ad97-4001-ab83-b6cd1aeec70a from the persistent domain config. {{(pid=75014) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:23:28 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:23:28 user nova-compute[75014]:   <source dev="/dev/sdc"/>
Nov 08 04:23:28 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:23:28 user nova-compute[75014]:   <serial>94bf8f9f-98df-4376-bb80-3838f4bbe08d</serial>
Nov 08 04:23:28 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:23:28 user nova-compute[75014]: </disk>
Nov 08 04:23:28 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:23:28 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Successfully detached device vdb from instance 12939443-ad97-4001-ab83-b6cd1aeec70a from the persistent domain config.
Nov 08 04:23:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 12939443-ad97-4001-ab83-b6cd1aeec70a from the live domain config. {{(pid=75014) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:23:28 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:23:28 user nova-compute[75014]:   <source dev="/dev/sdc"/>
Nov 08 04:23:28 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:23:28 user nova-compute[75014]:   <serial>94bf8f9f-98df-4376-bb80-3838f4bbe08d</serial>
Nov 08 04:23:28 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:23:28 user nova-compute[75014]: </disk>
Nov 08 04:23:28 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:23:28 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:23:28 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Took 0.46 seconds to deallocate network for instance.
Nov 08 04:23:29 user nova-compute[75014]: DEBUG nova.compute.manager [req-991bedde-78bd-439b-8e7a-5b9ada7d2287 req-ff037109-2535-4fc7-be0b-b034d29b3895 service nova] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Received event network-vif-deleted-85ecf643-4d2e-475a-9f34-0c6c409a9be9 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:23:29 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 12939443-ad97-4001-ab83-b6cd1aeec70a {{(pid=75014) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 04:23:29 user nova-compute[75014]: DEBUG nova.compute.manager [req-aaf7b8ae-55df-43df-bbe5-ab095b52d9be req-de40773c-4731-4ed9-b353-3f9cb3f4464d service nova] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Received event network-vif-plugged-85ecf643-4d2e-475a-9f34-0c6c409a9be9 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:23:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-aaf7b8ae-55df-43df-bbe5-ab095b52d9be req-de40773c-4731-4ed9-b353-3f9cb3f4464d service nova] Acquiring lock "b68ff427-f94a-4513-99d5-a1c63cb16f10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:23:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-aaf7b8ae-55df-43df-bbe5-ab095b52d9be req-de40773c-4731-4ed9-b353-3f9cb3f4464d service nova] Lock "b68ff427-f94a-4513-99d5-a1c63cb16f10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:23:29 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-aaf7b8ae-55df-43df-bbe5-ab095b52d9be req-de40773c-4731-4ed9-b353-3f9cb3f4464d service nova] Lock "b68ff427-f94a-4513-99d5-a1c63cb16f10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:23:29 user nova-compute[75014]: DEBUG nova.compute.manager [req-aaf7b8ae-55df-43df-bbe5-ab095b52d9be req-de40773c-4731-4ed9-b353-3f9cb3f4464d service nova] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] No waiting events found dispatching network-vif-plugged-85ecf643-4d2e-475a-9f34-0c6c409a9be9 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:23:29 user nova-compute[75014]: WARNING nova.compute.manager [req-aaf7b8ae-55df-43df-bbe5-ab095b52d9be req-de40773c-4731-4ed9-b353-3f9cb3f4464d service nova] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Received unexpected event network-vif-plugged-85ecf643-4d2e-475a-9f34-0c6c409a9be9 for instance with vm_state active and task_state deleting.
Nov 08 04:23:30 user nova-compute[75014]: INFO nova.compute.manager [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Took 1.01 seconds to detach 1 volumes for instance.
Nov 08 04:23:30 user nova-compute[75014]: DEBUG nova.compute.manager [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: b68ff427-f94a-4513-99d5-a1c63cb16f10] Deleting volume: 98d07069-d8e0-4276-ba44-2dfb5aa529b9 {{(pid=75014) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 04:23:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:23:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:23:30 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:23:30 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:23:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.212s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:23:30 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Deleted allocations for instance b68ff427-f94a-4513-99d5-a1c63cb16f10
Nov 08 04:23:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-dc9796e4-3ed4-4b89-87ee-b0f1973c9bc4 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "b68ff427-f94a-4513-99d5-a1c63cb16f10" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.238s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:23:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:46 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:23:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:48 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:23:49 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 12939443-ad97-4001-ab83-b6cd1aeec70a is timed out.
Nov 08 04:23:49 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Successfully detached device vdb from instance 12939443-ad97-4001-ab83-b6cd1aeec70a from the live domain config.
Nov 08 04:23:49 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShUYzDHI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:23:49 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:23:49 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b22fb8-a121-4df4-96d7-d95c12c37b02]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:23:49 user nova-compute[75014]: No targets found.
Nov 08 04:23:49 user nova-compute[75014]: iSNS:
Nov 08 04:23:49 user nova-compute[75014]: No targets found.
Nov 08 04:23:49 user nova-compute[75014]: STATIC:
Nov 08 04:23:49 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:23:49 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:23:49 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:23:49 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d
Nov 08 04:23:49 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:23:49 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:23:49 user nova-compute[75014]: FIRMWARE:
Nov 08 04:23:49 user nova-compute[75014]: No targets found.
Nov 08 04:23:49 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:23:49 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:23:49 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[29794431-ddd8-4043-9a5a-830e55559305]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f869c34-2406-4012-9d88-608b235acabc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:23:49 user nova-compute[75014]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d (non-flash)
Nov 08 04:23:49 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:23:49 user nova-compute[75014]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d (non-flash)
Nov 08 04:23:49 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f04200f3490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d'): ({'sdc'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Removing single pathed devices sdc {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4134d660-4ef5-4a70-b27d-17b9c05b2b60]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb8e7a9-ebcc-4566-966a-972f2b34de5a]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Flushing IO for device /dev/sdc {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de48876-4ee5-4727-8223-460bf4f6717b]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.139s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6f4941-3e99-48f7-9c1e-d3ca133b346b]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] SCSI volumes sdc have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a2e579-532b-49cf-9bef-627e3047d352]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[71aa7135-a2e8-4edd-b76e-2b2257a837d5]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d, portal: 172.16.0.220,3260]
Nov 08 04:23:49 user nova-compute[75014]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d, portal: 172.16.0.220,3260] successful.
Nov 08 04:23:49 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-12939443-ad97-4001-ab83-b6cd1aeec70a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-12939443-ad97-4001-ab83-b6cd1aeec70a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bf8f9f-98df-4376-bb80-3838f4bbe08d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb478876-7c9f-42e0-bdcf-0d266ffadd16]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] <== disconnect_volume: return (413ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:23:49 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:23:50 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Updating instance_info_cache with network_info: [{"id": "9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4", "address": "fa:16:3e:c2:0b:1f", "network": {"id": "4d522d89-a309-4855-b48c-eb20e3a7cdea", "bridge": "br-int", "label": "tempest-TestStampPattern-1021360457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bff47d48dd4d64bdfa4c4e60d04d60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffa1dc1-bb", "ovs_interfaceid": "9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:23:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-12939443-ad97-4001-ab83-b6cd1aeec70a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:23:50 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 04:23:50 user nova-compute[75014]: DEBUG nova.objects.instance [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lazy-loading 'flavor' on Instance uuid 12939443-ad97-4001-ab83-b6cd1aeec70a {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:23:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-e6c2bd51-0bce-4fd9-a191-837c37b5e324 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "12939443-ad97-4001-ab83-b6cd1aeec70a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.057s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:23:52 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:23:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:56 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:23:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:23:58 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:23:58 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:23:59 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:23:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:23:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:23:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:23:59 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:23:59 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:59 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:59 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:23:59 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:23:59 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:24:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:24:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:24:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:24:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12939443-ad97-4001-ab83-b6cd1aeec70a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:24:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12939443-ad97-4001-ab83-b6cd1aeec70a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:24:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12939443-ad97-4001-ab83-b6cd1aeec70a/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:24:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12939443-ad97-4001-ab83-b6cd1aeec70a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:24:00 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:24:00 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:24:00 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=8610MB free_disk=24.787620544433594GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:24:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:24:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:24:01 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9edd3f37-b2c5-48ba-96ec-8f8f39975875 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:24:01 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 12939443-ad97-4001-ab83-b6cd1aeec70a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:24:01 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 08acc858-dc89-4ae8-9b48-08e6de5db0d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:24:01 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:24:01 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:24:01 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:24:01 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:24:01 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:24:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:24:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:24:05 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:24:05 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:24:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:24:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:24:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:24:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:24:19 user nova-compute[75014]: DEBUG nova.compute.manager [req-64611fc8-623a-40cb-9bb3-d94e2f4fc45f req-c54586d8-68db-44e1-a23c-aa01acfe5ac4 service nova] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Received event network-changed-9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:24:19 user nova-compute[75014]: DEBUG nova.compute.manager [req-64611fc8-623a-40cb-9bb3-d94e2f4fc45f req-c54586d8-68db-44e1-a23c-aa01acfe5ac4 service nova] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Refreshing instance network info cache due to event network-changed-9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:24:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-64611fc8-623a-40cb-9bb3-d94e2f4fc45f req-c54586d8-68db-44e1-a23c-aa01acfe5ac4 service nova] Acquiring lock "refresh_cache-12939443-ad97-4001-ab83-b6cd1aeec70a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:24:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-64611fc8-623a-40cb-9bb3-d94e2f4fc45f req-c54586d8-68db-44e1-a23c-aa01acfe5ac4 service nova] Acquired lock "refresh_cache-12939443-ad97-4001-ab83-b6cd1aeec70a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:24:19 user nova-compute[75014]: DEBUG nova.network.neutron [req-64611fc8-623a-40cb-9bb3-d94e2f4fc45f req-c54586d8-68db-44e1-a23c-aa01acfe5ac4 service nova] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Refreshing network info cache for port 9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:24:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1b4a672a-c319-43a3-bdb6-73b1e9681c0f tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquiring lock "12939443-ad97-4001-ab83-b6cd1aeec70a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:24:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1b4a672a-c319-43a3-bdb6-73b1e9681c0f tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "12939443-ad97-4001-ab83-b6cd1aeec70a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:24:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1b4a672a-c319-43a3-bdb6-73b1e9681c0f tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquiring lock "12939443-ad97-4001-ab83-b6cd1aeec70a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:24:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1b4a672a-c319-43a3-bdb6-73b1e9681c0f tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "12939443-ad97-4001-ab83-b6cd1aeec70a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:24:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1b4a672a-c319-43a3-bdb6-73b1e9681c0f tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "12939443-ad97-4001-ab83-b6cd1aeec70a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:24:19 user nova-compute[75014]: INFO nova.compute.manager [None req-1b4a672a-c319-43a3-bdb6-73b1e9681c0f tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Terminating instance
Nov 08 04:24:19 user nova-compute[75014]: DEBUG nova.compute.manager [None req-1b4a672a-c319-43a3-bdb6-73b1e9681c0f tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:24:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:24:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:24:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:24:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:24:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-180bf866-9f2a-4adf-8248-746de9cef264 req-27fa7caf-4c73-445f-a841-09e32ba27474 service nova] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Received event network-vif-unplugged-9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:24:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-180bf866-9f2a-4adf-8248-746de9cef264 req-27fa7caf-4c73-445f-a841-09e32ba27474 service nova] Acquiring lock "12939443-ad97-4001-ab83-b6cd1aeec70a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:24:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-180bf866-9f2a-4adf-8248-746de9cef264 req-27fa7caf-4c73-445f-a841-09e32ba27474 service nova] Lock "12939443-ad97-4001-ab83-b6cd1aeec70a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:24:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-180bf866-9f2a-4adf-8248-746de9cef264 req-27fa7caf-4c73-445f-a841-09e32ba27474 service nova] Lock "12939443-ad97-4001-ab83-b6cd1aeec70a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:24:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-180bf866-9f2a-4adf-8248-746de9cef264 req-27fa7caf-4c73-445f-a841-09e32ba27474 service nova] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] No waiting events found dispatching network-vif-unplugged-9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:24:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-180bf866-9f2a-4adf-8248-746de9cef264 req-27fa7caf-4c73-445f-a841-09e32ba27474 service nova] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Received event network-vif-unplugged-9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:24:20 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Instance destroyed successfully.
Nov 08 04:24:20 user nova-compute[75014]: DEBUG nova.objects.instance [None req-1b4a672a-c319-43a3-bdb6-73b1e9681c0f tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lazy-loading 'resources' on Instance uuid 12939443-ad97-4001-ab83-b6cd1aeec70a {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:24:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-1b4a672a-c319-43a3-bdb6-73b1e9681c0f tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-375105003',display_name='tempest-TestStampPattern-server-375105003',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-375105003',id=44,image_ref='e8319025-c2d3-4b9c-bc07-48cab4c77112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjAWwzwaU6mM0uAVsf8M4MDogDeVam7U1Q9qZmbmnyN2kPP3EA+mz3AuKWhN3KvaKw+FEfwvQyWF60LDgsm9usmH03QvjairlAc6n6xpMsjt7JR9DxroHR+P7DjVWteTQ==',key_name='tempest-TestStampPattern-1058561610',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:21:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11bff47d48dd4d64bdfa4c4e60d04d60',ramdisk_id='',reservation_id='r-91is0fnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9edd3f37-b2c5-48ba-96ec-8f8f39975875',image_min_disk='1',image_min_ram='0',image_owner_id='11bff47d48dd4d64bdfa4c4e60d04d60',image_owner_project_name='tempest-TestStampPattern-1607533786',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1607533786-project-member',image_user_id='c1e37c55e4674f339ead74243d89e9ba',owner_project_name='tempest-TestStampPattern-1607533786',owner_user_name='tempest-TestStampPattern-1607533786-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:21:14Z,user_data=None,user_id='c1e37c55e4674f339ead74243d89e9ba',uuid=12939443-ad97-4001-ab83-b6cd1aeec70a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4", "address": "fa:16:3e:c2:0b:1f", "network": {"id": "4d522d89-a309-4855-b48c-eb20e3a7cdea", "bridge": "br-int", "label": "tempest-TestStampPattern-1021360457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bff47d48dd4d64bdfa4c4e60d04d60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffa1dc1-bb", "ovs_interfaceid": "9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:24:20 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-1b4a672a-c319-43a3-bdb6-73b1e9681c0f tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Converting VIF {"id": "9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4", "address": "fa:16:3e:c2:0b:1f", "network": {"id": "4d522d89-a309-4855-b48c-eb20e3a7cdea", "bridge": "br-int", "label": "tempest-TestStampPattern-1021360457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bff47d48dd4d64bdfa4c4e60d04d60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffa1dc1-bb", "ovs_interfaceid": "9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:24:20 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-1b4a672a-c319-43a3-bdb6-73b1e9681c0f tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:0b:1f,bridge_name='br-int',has_traffic_filtering=True,id=9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4,network=Network(4d522d89-a309-4855-b48c-eb20e3a7cdea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ffa1dc1-bb') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:24:20 user nova-compute[75014]: DEBUG os_vif [None req-1b4a672a-c319-43a3-bdb6-73b1e9681c0f tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:0b:1f,bridge_name='br-int',has_traffic_filtering=True,id=9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4,network=Network(4d522d89-a309-4855-b48c-eb20e3a7cdea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ffa1dc1-bb') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:24:20 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:24:20 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ffa1dc1-bb, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:24:20 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:24:20 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:24:20 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9cd68260-eb77-4595-be7f-22c0f7dbfe92) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:24:20 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:24:20 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:24:20 user nova-compute[75014]: INFO os_vif [None req-1b4a672a-c319-43a3-bdb6-73b1e9681c0f tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:0b:1f,bridge_name='br-int',has_traffic_filtering=True,id=9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4,network=Network(4d522d89-a309-4855-b48c-eb20e3a7cdea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ffa1dc1-bb')
Nov 08 04:24:20 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-1b4a672a-c319-43a3-bdb6-73b1e9681c0f tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Deleting instance files /opt/stack/data/nova/instances/12939443-ad97-4001-ab83-b6cd1aeec70a_del
Nov 08 04:24:20 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-1b4a672a-c319-43a3-bdb6-73b1e9681c0f tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Deletion of /opt/stack/data/nova/instances/12939443-ad97-4001-ab83-b6cd1aeec70a_del complete
Nov 08 04:24:20 user nova-compute[75014]: INFO nova.compute.manager [None req-1b4a672a-c319-43a3-bdb6-73b1e9681c0f tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 08 04:24:20 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-1b4a672a-c319-43a3-bdb6-73b1e9681c0f tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:24:20 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:24:20 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:24:20 user nova-compute[75014]: DEBUG nova.network.neutron [req-64611fc8-623a-40cb-9bb3-d94e2f4fc45f req-c54586d8-68db-44e1-a23c-aa01acfe5ac4 service nova] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Updated VIF entry in instance network info cache for port 9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:24:20 user nova-compute[75014]: DEBUG nova.network.neutron [req-64611fc8-623a-40cb-9bb3-d94e2f4fc45f req-c54586d8-68db-44e1-a23c-aa01acfe5ac4 service nova] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Updating instance_info_cache with network_info: [{"id": "9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4", "address": "fa:16:3e:c2:0b:1f", "network": {"id": "4d522d89-a309-4855-b48c-eb20e3a7cdea", "bridge": "br-int", "label": "tempest-TestStampPattern-1021360457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bff47d48dd4d64bdfa4c4e60d04d60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffa1dc1-bb", "ovs_interfaceid": "9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:24:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-64611fc8-623a-40cb-9bb3-d94e2f4fc45f req-c54586d8-68db-44e1-a23c-aa01acfe5ac4 service nova] Releasing lock "refresh_cache-12939443-ad97-4001-ab83-b6cd1aeec70a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:24:21 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:24:21 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Took 0.73 seconds to deallocate network for instance.
Nov 08 04:24:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1b4a672a-c319-43a3-bdb6-73b1e9681c0f tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:24:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1b4a672a-c319-43a3-bdb6-73b1e9681c0f tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:24:21 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-1b4a672a-c319-43a3-bdb6-73b1e9681c0f tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:24:21 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-1b4a672a-c319-43a3-bdb6-73b1e9681c0f tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:24:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1b4a672a-c319-43a3-bdb6-73b1e9681c0f tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:24:21 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-1b4a672a-c319-43a3-bdb6-73b1e9681c0f tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Deleted allocations for instance 12939443-ad97-4001-ab83-b6cd1aeec70a
Nov 08 04:24:21 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-1b4a672a-c319-43a3-bdb6-73b1e9681c0f tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "12939443-ad97-4001-ab83-b6cd1aeec70a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.078s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:24:22 user nova-compute[75014]: DEBUG nova.compute.manager [req-41cff87a-1700-4a06-bcba-e7a313f7d48d req-5d3aeb8e-38c2-4cdb-8949-b25638c74df7 service nova] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Received event network-vif-plugged-9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:24:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-41cff87a-1700-4a06-bcba-e7a313f7d48d req-5d3aeb8e-38c2-4cdb-8949-b25638c74df7 service nova] Acquiring lock "12939443-ad97-4001-ab83-b6cd1aeec70a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:24:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-41cff87a-1700-4a06-bcba-e7a313f7d48d req-5d3aeb8e-38c2-4cdb-8949-b25638c74df7 service nova] Lock "12939443-ad97-4001-ab83-b6cd1aeec70a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:24:22 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-41cff87a-1700-4a06-bcba-e7a313f7d48d req-5d3aeb8e-38c2-4cdb-8949-b25638c74df7 service nova] Lock "12939443-ad97-4001-ab83-b6cd1aeec70a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:24:22 user nova-compute[75014]: DEBUG nova.compute.manager [req-41cff87a-1700-4a06-bcba-e7a313f7d48d req-5d3aeb8e-38c2-4cdb-8949-b25638c74df7 service nova] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] No waiting events found dispatching network-vif-plugged-9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:24:22 user nova-compute[75014]: WARNING nova.compute.manager [req-41cff87a-1700-4a06-bcba-e7a313f7d48d req-5d3aeb8e-38c2-4cdb-8949-b25638c74df7 service nova] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Received unexpected event network-vif-plugged-9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4 for instance with vm_state deleted and task_state None.
Nov 08 04:24:22 user nova-compute[75014]: DEBUG nova.compute.manager [req-41cff87a-1700-4a06-bcba-e7a313f7d48d req-5d3aeb8e-38c2-4cdb-8949-b25638c74df7 service nova] [instance: 12939443-ad97-4001-ab83-b6cd1aeec70a] Received event network-vif-deleted-9ffa1dc1-bbd9-45f3-a6e6-26b0ea4bbfc4 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:24:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:24:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:24:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:24:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:24:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:24:48 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:24:49 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:24:50 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:24:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:24:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:24:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:24:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:24:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:24:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:24:50 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:24:50 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:24:50 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Didn't find any instances for network info cache update. {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 04:24:54 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:24:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:24:57 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:24:59 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:24:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:24:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:24:59 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:24:59 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:24:59 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:24:59 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:24:59 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:24:59 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:24:59 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:25:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:25:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:25:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:25:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:00 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:25:00 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:25:00 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=8730MB free_disk=24.786376953125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:25:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:25:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:25:00 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9edd3f37-b2c5-48ba-96ec-8f8f39975875 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:25:00 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 08acc858-dc89-4ae8-9b48-08e6de5db0d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:25:00 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:25:00 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:25:00 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:25:00 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:25:01 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:25:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.268s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:25:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "be882529-f74b-4743-a7a8-0a64e8f6c2c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:25:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "be882529-f74b-4743-a7a8-0a64e8f6c2c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:25:01 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 04:25:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:25:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:25:01 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 04:25:01 user nova-compute[75014]: INFO nova.compute.claims [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Claim successful on node user
Nov 08 04:25:02 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:25:02 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:25:02 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:25:02 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:25:02 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:25:02 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 04:25:02 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 04:25:02 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 04:25:02 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 04:25:02 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 04:25:02 user nova-compute[75014]: INFO nova.virt.block_device [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Booting with volume ac806863-3815-493b-806d-30a65a7d3301 at /dev/vda
Nov 08 04:25:02 user nova-compute[75014]: DEBUG nova.policy [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe1c5af56ab14da7986d64e38597d394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504ed2858e78480e9beef5aa5f5d9f1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 04:25:02 user nova-compute[75014]: DEBUG os_brick.utils [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:25:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:25:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:25:02 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c89cb8a-a149-4b7e-9a13-300fe4ce7eb0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:25:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:25:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:25:02 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb2f1c9-b284-4cd4-be0f-1439e7a33078]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:25:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:25:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:25:02 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fb9b40-012c-4c84-97ef-c36ad47f4dee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:25:02 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c185d61-ae7c-4213-b9d4-9bd80cd3b239]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:25:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:25:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:25:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:25:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:25:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:25:02 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:25:02 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fc60c0-315e-4104-8220-c6373e654143]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:25:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:25:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:25:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:25:02 user nova-compute[75014]: DEBUG os_brick.utils [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:25:02 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Updating existing volume attachment record: 3c98f1d5-f4c8-4a3b-9db2-f252bc00746e {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:25:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:03 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Successfully created port: 31de527f-d08b-4b86-8c23-c96c4ebe51f9 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 04:25:03 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:25:03 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Successfully updated port: 31de527f-d08b-4b86-8c23-c96c4ebe51f9 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 04:25:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "refresh_cache-be882529-f74b-4743-a7a8-0a64e8f6c2c0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:25:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquired lock "refresh_cache-be882529-f74b-4743-a7a8-0a64e8f6c2c0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:25:04 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:25:04 user nova-compute[75014]: DEBUG nova.compute.manager [req-17c91722-2c02-4520-b332-0a0b433d5ae0 req-1ec713c0-a7e1-4c76-8b9f-bebcb984a4dd service nova] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Received event network-changed-31de527f-d08b-4b86-8c23-c96c4ebe51f9 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:25:04 user nova-compute[75014]: DEBUG nova.compute.manager [req-17c91722-2c02-4520-b332-0a0b433d5ae0 req-1ec713c0-a7e1-4c76-8b9f-bebcb984a4dd service nova] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Refreshing instance network info cache due to event network-changed-31de527f-d08b-4b86-8c23-c96c4ebe51f9. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:25:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-17c91722-2c02-4520-b332-0a0b433d5ae0 req-1ec713c0-a7e1-4c76-8b9f-bebcb984a4dd service nova] Acquiring lock "refresh_cache-be882529-f74b-4743-a7a8-0a64e8f6c2c0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:25:04 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 04:25:04 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Updating instance_info_cache with network_info: [{"id": "31de527f-d08b-4b86-8c23-c96c4ebe51f9", "address": "fa:16:3e:36:70:4d", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31de527f-d0", "ovs_interfaceid": "31de527f-d08b-4b86-8c23-c96c4ebe51f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:25:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Releasing lock "refresh_cache-be882529-f74b-4743-a7a8-0a64e8f6c2c0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:25:04 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Instance network_info: |[{"id": "31de527f-d08b-4b86-8c23-c96c4ebe51f9", "address": "fa:16:3e:36:70:4d", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31de527f-d0", "ovs_interfaceid": "31de527f-d08b-4b86-8c23-c96c4ebe51f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 04:25:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-17c91722-2c02-4520-b332-0a0b433d5ae0 req-1ec713c0-a7e1-4c76-8b9f-bebcb984a4dd service nova] Acquired lock "refresh_cache-be882529-f74b-4743-a7a8-0a64e8f6c2c0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:25:04 user nova-compute[75014]: DEBUG nova.network.neutron [req-17c91722-2c02-4520-b332-0a0b433d5ae0 req-1ec713c0-a7e1-4c76-8b9f-bebcb984a4dd service nova] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Refreshing network info cache for port 31de527f-d08b-4b86-8c23-c96c4ebe51f9 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:25:04 user nova-compute[75014]: DEBUG nova.network.neutron [req-17c91722-2c02-4520-b332-0a0b433d5ae0 req-1ec713c0-a7e1-4c76-8b9f-bebcb984a4dd service nova] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Updated VIF entry in instance network info cache for port 31de527f-d08b-4b86-8c23-c96c4ebe51f9. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:25:04 user nova-compute[75014]: DEBUG nova.network.neutron [req-17c91722-2c02-4520-b332-0a0b433d5ae0 req-1ec713c0-a7e1-4c76-8b9f-bebcb984a4dd service nova] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Updating instance_info_cache with network_info: [{"id": "31de527f-d08b-4b86-8c23-c96c4ebe51f9", "address": "fa:16:3e:36:70:4d", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31de527f-d0", "ovs_interfaceid": "31de527f-d08b-4b86-8c23-c96c4ebe51f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:25:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-17c91722-2c02-4520-b332-0a0b433d5ae0 req-1ec713c0-a7e1-4c76-8b9f-bebcb984a4dd service nova] Releasing lock "refresh_cache-be882529-f74b-4743-a7a8-0a64e8f6c2c0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:25:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:11 user nova-compute[75014]: DEBUG nova.compute.manager [req-8fef86bf-30bf-4756-8fed-d70adc0ab088 req-94162acc-e47a-4617-8009-839f0a0cf816 service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received event network-changed-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:25:11 user nova-compute[75014]: DEBUG nova.compute.manager [req-8fef86bf-30bf-4756-8fed-d70adc0ab088 req-94162acc-e47a-4617-8009-839f0a0cf816 service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Refreshing instance network info cache due to event network-changed-3137db93-bf8f-4d21-a1df-f9b6014d46bf. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:25:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8fef86bf-30bf-4756-8fed-d70adc0ab088 req-94162acc-e47a-4617-8009-839f0a0cf816 service nova] Acquiring lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:25:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8fef86bf-30bf-4756-8fed-d70adc0ab088 req-94162acc-e47a-4617-8009-839f0a0cf816 service nova] Acquired lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:25:11 user nova-compute[75014]: DEBUG nova.network.neutron [req-8fef86bf-30bf-4756-8fed-d70adc0ab088 req-94162acc-e47a-4617-8009-839f0a0cf816 service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Refreshing network info cache for port 3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:25:12 user nova-compute[75014]: DEBUG nova.network.neutron [req-8fef86bf-30bf-4756-8fed-d70adc0ab088 req-94162acc-e47a-4617-8009-839f0a0cf816 service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Updated VIF entry in instance network info cache for port 3137db93-bf8f-4d21-a1df-f9b6014d46bf. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:25:12 user nova-compute[75014]: DEBUG nova.network.neutron [req-8fef86bf-30bf-4756-8fed-d70adc0ab088 req-94162acc-e47a-4617-8009-839f0a0cf816 service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Updating instance_info_cache with network_info: [{"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:25:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8fef86bf-30bf-4756-8fed-d70adc0ab088 req-94162acc-e47a-4617-8009-839f0a0cf816 service nova] Releasing lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:25:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:15 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:25:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:25:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:25:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:25:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:25:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:25:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:25:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Verify base images {{(pid=75014) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 08 04:25:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75014) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 08 04:25:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Image id 877f8699-2084-427a-babd-cf4f98c3b417 yields fingerprint eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 {{(pid=75014) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 08 04:25:15 user nova-compute[75014]: INFO nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] image 877f8699-2084-427a-babd-cf4f98c3b417 at (/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9): checking
Nov 08 04:25:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] image 877f8699-2084-427a-babd-cf4f98c3b417 at (/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9): image is in use {{(pid=75014) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 08 04:25:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] 08acc858-dc89-4ae8-9b48-08e6de5db0d0 is a valid instance name {{(pid=75014) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 08 04:25:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] 08acc858-dc89-4ae8-9b48-08e6de5db0d0 has a disk file {{(pid=75014) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 08 04:25:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:25:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:25:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 08acc858-dc89-4ae8-9b48-08e6de5db0d0 is backed by eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 {{(pid=75014) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 08 04:25:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] 9edd3f37-b2c5-48ba-96ec-8f8f39975875 is a valid instance name {{(pid=75014) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 08 04:25:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] 9edd3f37-b2c5-48ba-96ec-8f8f39975875 has a disk file {{(pid=75014) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 08 04:25:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:25:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:25:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 9edd3f37-b2c5-48ba-96ec-8f8f39975875 is backed by eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 {{(pid=75014) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 08 04:25:15 user nova-compute[75014]: WARNING nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/08b7bf9a6b50b0754ea0761e65ec879a4b29f627
Nov 08 04:25:15 user nova-compute[75014]: WARNING nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/68492d0b8b75f9135d6b506d5542c276cef0cb3e
Nov 08 04:25:15 user nova-compute[75014]: WARNING nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/3c9d8b16e7808d883edad3b51cf4a2f0cac724b0
Nov 08 04:25:15 user nova-compute[75014]: WARNING nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/728d8288d167f8fe50ca2c4a7d2fa3a2ea959596
Nov 08 04:25:15 user nova-compute[75014]: WARNING nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/9c99e942abfea2907bd68f08c69d92a9637e7f43
Nov 08 04:25:15 user nova-compute[75014]: WARNING nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/0fb68e36341c4b222863c97cccec08b006a88e0b
Nov 08 04:25:15 user nova-compute[75014]: WARNING nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/70b06594db4f69fb72e7d52bead792bddac47eb6
Nov 08 04:25:15 user nova-compute[75014]: WARNING nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/89c2815c291483866799f9b949731714d1878ff9
Nov 08 04:25:15 user nova-compute[75014]: WARNING nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/a185c3be58fb103a109630e45f836467e9bc603a
Nov 08 04:25:15 user nova-compute[75014]: INFO nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Active base files: /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9
Nov 08 04:25:15 user nova-compute[75014]: INFO nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Removable base files: /opt/stack/data/nova/instances/_base/08b7bf9a6b50b0754ea0761e65ec879a4b29f627 /opt/stack/data/nova/instances/_base/68492d0b8b75f9135d6b506d5542c276cef0cb3e /opt/stack/data/nova/instances/_base/3c9d8b16e7808d883edad3b51cf4a2f0cac724b0 /opt/stack/data/nova/instances/_base/728d8288d167f8fe50ca2c4a7d2fa3a2ea959596 /opt/stack/data/nova/instances/_base/9c99e942abfea2907bd68f08c69d92a9637e7f43 /opt/stack/data/nova/instances/_base/0fb68e36341c4b222863c97cccec08b006a88e0b /opt/stack/data/nova/instances/_base/70b06594db4f69fb72e7d52bead792bddac47eb6 /opt/stack/data/nova/instances/_base/89c2815c291483866799f9b949731714d1878ff9 /opt/stack/data/nova/instances/_base/a185c3be58fb103a109630e45f836467e9bc603a
Nov 08 04:25:15 user nova-compute[75014]: INFO nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/08b7bf9a6b50b0754ea0761e65ec879a4b29f627
Nov 08 04:25:15 user nova-compute[75014]: INFO nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/68492d0b8b75f9135d6b506d5542c276cef0cb3e
Nov 08 04:25:15 user nova-compute[75014]: INFO nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3c9d8b16e7808d883edad3b51cf4a2f0cac724b0
Nov 08 04:25:15 user nova-compute[75014]: INFO nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/728d8288d167f8fe50ca2c4a7d2fa3a2ea959596
Nov 08 04:25:15 user nova-compute[75014]: INFO nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9c99e942abfea2907bd68f08c69d92a9637e7f43
Nov 08 04:25:15 user nova-compute[75014]: INFO nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0fb68e36341c4b222863c97cccec08b006a88e0b
Nov 08 04:25:15 user nova-compute[75014]: INFO nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/70b06594db4f69fb72e7d52bead792bddac47eb6
Nov 08 04:25:15 user nova-compute[75014]: INFO nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/89c2815c291483866799f9b949731714d1878ff9
Nov 08 04:25:15 user nova-compute[75014]: INFO nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a185c3be58fb103a109630e45f836467e9bc603a
Nov 08 04:25:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Verification complete {{(pid=75014) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 08 04:25:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Verify swap images {{(pid=75014) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 08 04:25:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.imagecache [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Verify ephemeral images {{(pid=75014) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 08 04:25:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:20 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 04:25:25 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Creating image(s)
Nov 08 04:25:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Did not create local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Ensure instance console log exists: /opt/stack/data/nova/instances/be882529-f74b-4743-a7a8-0a64e8f6c2c0/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Start _get_guest_xml network_info=[{"id": "31de527f-d08b-4b86-8c23-c96c4ebe51f9", "address": "fa:16:3e:36:70:4d", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31de527f-d0", "ovs_interfaceid": "31de527f-d08b-4b86-8c23-c96c4ebe51f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDroSQcz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'be882529-f74b-4743-a7a8-0a64e8f6c2c0', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac806863-3815-493b-806d-30a65a7d3301', 'serial': 'ac806863-3815-493b-806d-30a65a7d3301'}, 'device_type': 'disk', 'attachment_id': '3c98f1d5-f4c8-4a3b-9db2-f252bc00746e', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:25:25 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:25:25 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:25:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDroSQcz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:25:25 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:25:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:25:25 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:25:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:25:25 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9058a3-ddd4-440b-8ae3-fbfc722e6ee7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:25:25 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[947e6a8a-a757-4f5f-a384-31f157391fae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301] added
Nov 08 04:25:25 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6204e8ae-687f-4cf6-8014-cd186b81c8e9]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1225951-6496-4a0a-82ab-294697278183]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qDroSQcz {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qDroSQcz" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bcdfbd-d1a5-4b48-9b07-594635f6ddb9]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qDroSQcz'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7259c65-c52e-4c3c-89e6-e96b3e2eec72]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68ae40a-c35b-4741-afda-78511ebf933c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:25:25 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:25:25 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcaa8185-45d7-4761-91dd-a9ef3c792fcd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301, portal: 172.16.0.220,3260]
Nov 08 04:25:25 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301, portal: 172.16.0.220,3260] successful.
Nov 08 04:25:25 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[873b495f-23dc-49c6-8459-42c7a7ad8073]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae006d4-0bc3-40bf-aecb-3804044d0d24]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:25:25 user nova-compute[75014]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)
Nov 08 04:25:25 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:25:25 user nova-compute[75014]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)
Nov 08 04:25:25 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f69899-7338-4f55-9596-0a1c464e3656]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:25:25 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:25:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDroSQcz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:25:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:25:27 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23338613031393933', 'path': '/dev/sdb'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:25:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338613031393933', 'path': '/dev/sdb'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:25:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1531009516',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1531009516',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1531009516',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvF7c7rllNn/vREGD4u5XUBoBAxMKKfMsFRGKEIs7UzEDu7w8EwScfMWQnWTwnnujJNAuwBdU53agt5ghT8nbH2Bw90VOiMtacRG7342uafjTEXaBKCKmT/3IzOKX1BTQ==',key_name='tempest-keypair-586165679',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='504ed2858e78480e9beef5aa5f5d9f1d',ramdisk_id='',reservation_id='r-501ql3z4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2082374398',owner_user_name='tempest-TestVolumeBootPattern-2082374398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:25:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe1c5af56ab14da7986d64e38597d394',uuid=be882529-f74b-4743-a7a8-0a64e8f6c2c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31de527f-d08b-4b86-8c23-c96c4ebe51f9", "address": "fa:16:3e:36:70:4d", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31de527f-d0", "ovs_interfaceid": "31de527f-d08b-4b86-8c23-c96c4ebe51f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:25:27 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converting VIF {"id": "31de527f-d08b-4b86-8c23-c96c4ebe51f9", "address": "fa:16:3e:36:70:4d", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31de527f-d0", "ovs_interfaceid": "31de527f-d08b-4b86-8c23-c96c4ebe51f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:25:27 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:70:4d,bridge_name='br-int',has_traffic_filtering=True,id=31de527f-d08b-4b86-8c23-c96c4ebe51f9,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31de527f-d0') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:25:27 user nova-compute[75014]: DEBUG nova.objects.instance [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lazy-loading 'pci_devices' on Instance uuid be882529-f74b-4743-a7a8-0a64e8f6c2c0 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:25:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:25:27 user nova-compute[75014]:   <uuid>be882529-f74b-4743-a7a8-0a64e8f6c2c0</uuid>
Nov 08 04:25:27 user nova-compute[75014]:   <name>instance-0000002f</name>
Nov 08 04:25:27 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:25:27 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:25:27 user nova-compute[75014]:   <metadata>
Nov 08 04:25:27 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:25:27 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:25:27 user nova-compute[75014]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1531009516</nova:name>
Nov 08 04:25:27 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:25:25</nova:creationTime>
Nov 08 04:25:27 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:25:27 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:25:27 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:25:27 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:25:27 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:25:27 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:25:27 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:25:27 user nova-compute[75014]:       <nova:owner>
Nov 08 04:25:27 user nova-compute[75014]:         <nova:user uuid="fe1c5af56ab14da7986d64e38597d394">tempest-TestVolumeBootPattern-2082374398-project-member</nova:user>
Nov 08 04:25:27 user nova-compute[75014]:         <nova:project uuid="504ed2858e78480e9beef5aa5f5d9f1d">tempest-TestVolumeBootPattern-2082374398</nova:project>
Nov 08 04:25:27 user nova-compute[75014]:       </nova:owner>
Nov 08 04:25:27 user nova-compute[75014]:       <nova:ports>
Nov 08 04:25:27 user nova-compute[75014]:         <nova:port uuid="31de527f-d08b-4b86-8c23-c96c4ebe51f9">
Nov 08 04:25:27 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 04:25:27 user nova-compute[75014]:         </nova:port>
Nov 08 04:25:27 user nova-compute[75014]:       </nova:ports>
Nov 08 04:25:27 user nova-compute[75014]:     </nova:instance>
Nov 08 04:25:27 user nova-compute[75014]:   </metadata>
Nov 08 04:25:27 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:25:27 user nova-compute[75014]:     <system>
Nov 08 04:25:27 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:25:27 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:25:27 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:25:27 user nova-compute[75014]:       <entry name="serial">be882529-f74b-4743-a7a8-0a64e8f6c2c0</entry>
Nov 08 04:25:27 user nova-compute[75014]:       <entry name="uuid">be882529-f74b-4743-a7a8-0a64e8f6c2c0</entry>
Nov 08 04:25:27 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:25:27 user nova-compute[75014]:     </system>
Nov 08 04:25:27 user nova-compute[75014]:   </sysinfo>
Nov 08 04:25:27 user nova-compute[75014]:   <os>
Nov 08 04:25:27 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:25:27 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:25:27 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:25:27 user nova-compute[75014]:   </os>
Nov 08 04:25:27 user nova-compute[75014]:   <features>
Nov 08 04:25:27 user nova-compute[75014]:     <acpi/>
Nov 08 04:25:27 user nova-compute[75014]:     <apic/>
Nov 08 04:25:27 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:25:27 user nova-compute[75014]:   </features>
Nov 08 04:25:27 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:25:27 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:25:27 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:25:27 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:25:27 user nova-compute[75014]:   </clock>
Nov 08 04:25:27 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:25:27 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:25:27 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:25:27 user nova-compute[75014]:   </cpu>
Nov 08 04:25:27 user nova-compute[75014]:   <devices>
Nov 08 04:25:27 user nova-compute[75014]:     <disk type="block" device="disk">
Nov 08 04:25:27 user nova-compute[75014]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:25:27 user nova-compute[75014]:       <source dev="/dev/sdb"/>
Nov 08 04:25:27 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:25:27 user nova-compute[75014]:       <serial>ac806863-3815-493b-806d-30a65a7d3301</serial>
Nov 08 04:25:27 user nova-compute[75014]:     </disk>
Nov 08 04:25:27 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:25:27 user nova-compute[75014]:       <mac address="fa:16:3e:36:70:4d"/>
Nov 08 04:25:27 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:25:27 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:25:27 user nova-compute[75014]:       <target dev="tap31de527f-d0"/>
Nov 08 04:25:27 user nova-compute[75014]:     </interface>
Nov 08 04:25:27 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:25:27 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/be882529-f74b-4743-a7a8-0a64e8f6c2c0/console.log" append="off"/>
Nov 08 04:25:27 user nova-compute[75014]:     </serial>
Nov 08 04:25:27 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:25:27 user nova-compute[75014]:     <video>
Nov 08 04:25:27 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:25:27 user nova-compute[75014]:     </video>
Nov 08 04:25:27 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:25:27 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:25:27 user nova-compute[75014]:     </rng>
Nov 08 04:25:27 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:25:27 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:25:27 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:25:27 user nova-compute[75014]:     </memballoon>
Nov 08 04:25:27 user nova-compute[75014]:   </devices>
Nov 08 04:25:27 user nova-compute[75014]: </domain>
Nov 08 04:25:27 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:25:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1531009516',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1531009516',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1531009516',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvF7c7rllNn/vREGD4u5XUBoBAxMKKfMsFRGKEIs7UzEDu7w8EwScfMWQnWTwnnujJNAuwBdU53agt5ghT8nbH2Bw90VOiMtacRG7342uafjTEXaBKCKmT/3IzOKX1BTQ==',key_name='tempest-keypair-586165679',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='504ed2858e78480e9beef5aa5f5d9f1d',ramdisk_id='',reservation_id='r-501ql3z4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2082374398',owner_user_name='tempest-TestVolumeBootPattern-2082374398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:25:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe1c5af56ab14da7986d64e38597d394',uuid=be882529-f74b-4743-a7a8-0a64e8f6c2c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31de527f-d08b-4b86-8c23-c96c4ebe51f9", "address": "fa:16:3e:36:70:4d", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31de527f-d0", "ovs_interfaceid": "31de527f-d08b-4b86-8c23-c96c4ebe51f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:25:27 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converting VIF {"id": "31de527f-d08b-4b86-8c23-c96c4ebe51f9", "address": "fa:16:3e:36:70:4d", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31de527f-d0", "ovs_interfaceid": "31de527f-d08b-4b86-8c23-c96c4ebe51f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:25:27 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:70:4d,bridge_name='br-int',has_traffic_filtering=True,id=31de527f-d08b-4b86-8c23-c96c4ebe51f9,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31de527f-d0') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:25:27 user nova-compute[75014]: DEBUG os_vif [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:70:4d,bridge_name='br-int',has_traffic_filtering=True,id=31de527f-d08b-4b86-8c23-c96c4ebe51f9,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31de527f-d0') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:25:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:25:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:25:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0cb08586-4388-5226-b2c3-05a76fc1cc04', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:25:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31de527f-d0, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:25:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap31de527f-d0, col_values=(('qos', UUID('dc00f203-f294-4611-bc9b-6e1c8e68056e')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:25:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap31de527f-d0, col_values=(('external_ids', {'iface-id': '31de527f-d08b-4b86-8c23-c96c4ebe51f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:70:4d', 'vm-uuid': 'be882529-f74b-4743-a7a8-0a64e8f6c2c0'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:25:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:25:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:27 user nova-compute[75014]: INFO os_vif [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:70:4d,bridge_name='br-int',has_traffic_filtering=True,id=31de527f-d08b-4b86-8c23-c96c4ebe51f9,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31de527f-d0')
Nov 08 04:25:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:25:27 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] No VIF found with MAC fa:16:3e:36:70:4d, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:25:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:28 user nova-compute[75014]: DEBUG nova.compute.manager [req-46bd3f82-3007-40c5-a920-286a2a7fc95b req-025197f1-50a6-44dc-8c39-d0efa23105db service nova] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Received event network-vif-plugged-31de527f-d08b-4b86-8c23-c96c4ebe51f9 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:25:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-46bd3f82-3007-40c5-a920-286a2a7fc95b req-025197f1-50a6-44dc-8c39-d0efa23105db service nova] Acquiring lock "be882529-f74b-4743-a7a8-0a64e8f6c2c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:25:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-46bd3f82-3007-40c5-a920-286a2a7fc95b req-025197f1-50a6-44dc-8c39-d0efa23105db service nova] Lock "be882529-f74b-4743-a7a8-0a64e8f6c2c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:25:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-46bd3f82-3007-40c5-a920-286a2a7fc95b req-025197f1-50a6-44dc-8c39-d0efa23105db service nova] Lock "be882529-f74b-4743-a7a8-0a64e8f6c2c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:25:28 user nova-compute[75014]: DEBUG nova.compute.manager [req-46bd3f82-3007-40c5-a920-286a2a7fc95b req-025197f1-50a6-44dc-8c39-d0efa23105db service nova] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] No waiting events found dispatching network-vif-plugged-31de527f-d08b-4b86-8c23-c96c4ebe51f9 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:25:28 user nova-compute[75014]: WARNING nova.compute.manager [req-46bd3f82-3007-40c5-a920-286a2a7fc95b req-025197f1-50a6-44dc-8c39-d0efa23105db service nova] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Received unexpected event network-vif-plugged-31de527f-d08b-4b86-8c23-c96c4ebe51f9 for instance with vm_state building and task_state spawning.
Nov 08 04:25:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:30 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:25:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 04:25:30 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Instance spawned successfully.
Nov 08 04:25:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 04:25:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:25:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:25:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:25:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:25:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:25:30 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:25:30 user nova-compute[75014]: DEBUG nova.compute.manager [req-56c73c36-82c9-4739-a3e0-f10ec7ff065e req-6e2b77f4-0c4f-4252-b7ee-628645c9bc5a service nova] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Received event network-vif-plugged-31de527f-d08b-4b86-8c23-c96c4ebe51f9 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:25:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-56c73c36-82c9-4739-a3e0-f10ec7ff065e req-6e2b77f4-0c4f-4252-b7ee-628645c9bc5a service nova] Acquiring lock "be882529-f74b-4743-a7a8-0a64e8f6c2c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:25:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-56c73c36-82c9-4739-a3e0-f10ec7ff065e req-6e2b77f4-0c4f-4252-b7ee-628645c9bc5a service nova] Lock "be882529-f74b-4743-a7a8-0a64e8f6c2c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:25:30 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-56c73c36-82c9-4739-a3e0-f10ec7ff065e req-6e2b77f4-0c4f-4252-b7ee-628645c9bc5a service nova] Lock "be882529-f74b-4743-a7a8-0a64e8f6c2c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:25:30 user nova-compute[75014]: DEBUG nova.compute.manager [req-56c73c36-82c9-4739-a3e0-f10ec7ff065e req-6e2b77f4-0c4f-4252-b7ee-628645c9bc5a service nova] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] No waiting events found dispatching network-vif-plugged-31de527f-d08b-4b86-8c23-c96c4ebe51f9 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:25:30 user nova-compute[75014]: WARNING nova.compute.manager [req-56c73c36-82c9-4739-a3e0-f10ec7ff065e req-6e2b77f4-0c4f-4252-b7ee-628645c9bc5a service nova] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Received unexpected event network-vif-plugged-31de527f-d08b-4b86-8c23-c96c4ebe51f9 for instance with vm_state building and task_state spawning.
Nov 08 04:25:30 user nova-compute[75014]: INFO nova.compute.manager [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Took 5.29 seconds to spawn the instance on the hypervisor.
Nov 08 04:25:30 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:25:30 user nova-compute[75014]: INFO nova.compute.manager [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Took 29.12 seconds to build instance.
Nov 08 04:25:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4675bc60-c94f-4c2c-8d90-c0a5c6d09d9c tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "be882529-f74b-4743-a7a8-0a64e8f6c2c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.209s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:25:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:35 user nova-compute[75014]: DEBUG nova.compute.manager [req-a59549ca-6c09-4e85-a67c-85360f0db7ce req-a5230e56-c871-4e1b-b8db-526ea4723eb0 service nova] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Received event network-changed-90d4a51e-8558-4326-b2c4-b29e584ba8e4 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:25:35 user nova-compute[75014]: DEBUG nova.compute.manager [req-a59549ca-6c09-4e85-a67c-85360f0db7ce req-a5230e56-c871-4e1b-b8db-526ea4723eb0 service nova] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Refreshing instance network info cache due to event network-changed-90d4a51e-8558-4326-b2c4-b29e584ba8e4. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:25:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a59549ca-6c09-4e85-a67c-85360f0db7ce req-a5230e56-c871-4e1b-b8db-526ea4723eb0 service nova] Acquiring lock "refresh_cache-9edd3f37-b2c5-48ba-96ec-8f8f39975875" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:25:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a59549ca-6c09-4e85-a67c-85360f0db7ce req-a5230e56-c871-4e1b-b8db-526ea4723eb0 service nova] Acquired lock "refresh_cache-9edd3f37-b2c5-48ba-96ec-8f8f39975875" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:25:35 user nova-compute[75014]: DEBUG nova.network.neutron [req-a59549ca-6c09-4e85-a67c-85360f0db7ce req-a5230e56-c871-4e1b-b8db-526ea4723eb0 service nova] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Refreshing network info cache for port 90d4a51e-8558-4326-b2c4-b29e584ba8e4 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:25:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-65de1967-905a-432f-a5bf-91b9d53076f0 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquiring lock "9edd3f37-b2c5-48ba-96ec-8f8f39975875" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:25:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-65de1967-905a-432f-a5bf-91b9d53076f0 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "9edd3f37-b2c5-48ba-96ec-8f8f39975875" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:25:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-65de1967-905a-432f-a5bf-91b9d53076f0 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquiring lock "9edd3f37-b2c5-48ba-96ec-8f8f39975875-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:25:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-65de1967-905a-432f-a5bf-91b9d53076f0 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "9edd3f37-b2c5-48ba-96ec-8f8f39975875-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:25:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-65de1967-905a-432f-a5bf-91b9d53076f0 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "9edd3f37-b2c5-48ba-96ec-8f8f39975875-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:25:35 user nova-compute[75014]: INFO nova.compute.manager [None req-65de1967-905a-432f-a5bf-91b9d53076f0 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Terminating instance
Nov 08 04:25:35 user nova-compute[75014]: DEBUG nova.compute.manager [None req-65de1967-905a-432f-a5bf-91b9d53076f0 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:25:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:35 user nova-compute[75014]: DEBUG nova.compute.manager [req-ddbd2267-2d12-4e17-92a7-605fe3eb298e req-dec3a3c9-d7aa-45d3-bfc6-59810b39dc72 service nova] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Received event network-vif-unplugged-90d4a51e-8558-4326-b2c4-b29e584ba8e4 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:25:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ddbd2267-2d12-4e17-92a7-605fe3eb298e req-dec3a3c9-d7aa-45d3-bfc6-59810b39dc72 service nova] Acquiring lock "9edd3f37-b2c5-48ba-96ec-8f8f39975875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:25:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ddbd2267-2d12-4e17-92a7-605fe3eb298e req-dec3a3c9-d7aa-45d3-bfc6-59810b39dc72 service nova] Lock "9edd3f37-b2c5-48ba-96ec-8f8f39975875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:25:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ddbd2267-2d12-4e17-92a7-605fe3eb298e req-dec3a3c9-d7aa-45d3-bfc6-59810b39dc72 service nova] Lock "9edd3f37-b2c5-48ba-96ec-8f8f39975875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:25:35 user nova-compute[75014]: DEBUG nova.compute.manager [req-ddbd2267-2d12-4e17-92a7-605fe3eb298e req-dec3a3c9-d7aa-45d3-bfc6-59810b39dc72 service nova] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] No waiting events found dispatching network-vif-unplugged-90d4a51e-8558-4326-b2c4-b29e584ba8e4 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:25:35 user nova-compute[75014]: DEBUG nova.compute.manager [req-ddbd2267-2d12-4e17-92a7-605fe3eb298e req-dec3a3c9-d7aa-45d3-bfc6-59810b39dc72 service nova] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Received event network-vif-unplugged-90d4a51e-8558-4326-b2c4-b29e584ba8e4 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:25:35 user nova-compute[75014]: DEBUG nova.network.neutron [req-a59549ca-6c09-4e85-a67c-85360f0db7ce req-a5230e56-c871-4e1b-b8db-526ea4723eb0 service nova] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Updated VIF entry in instance network info cache for port 90d4a51e-8558-4326-b2c4-b29e584ba8e4. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:25:35 user nova-compute[75014]: DEBUG nova.network.neutron [req-a59549ca-6c09-4e85-a67c-85360f0db7ce req-a5230e56-c871-4e1b-b8db-526ea4723eb0 service nova] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Updating instance_info_cache with network_info: [{"id": "90d4a51e-8558-4326-b2c4-b29e584ba8e4", "address": "fa:16:3e:b8:c7:f9", "network": {"id": "4d522d89-a309-4855-b48c-eb20e3a7cdea", "bridge": "br-int", "label": "tempest-TestStampPattern-1021360457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bff47d48dd4d64bdfa4c4e60d04d60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90d4a51e-85", "ovs_interfaceid": "90d4a51e-8558-4326-b2c4-b29e584ba8e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:25:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a59549ca-6c09-4e85-a67c-85360f0db7ce req-a5230e56-c871-4e1b-b8db-526ea4723eb0 service nova] Releasing lock "refresh_cache-9edd3f37-b2c5-48ba-96ec-8f8f39975875" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:25:35 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Instance destroyed successfully.
Nov 08 04:25:35 user nova-compute[75014]: DEBUG nova.objects.instance [None req-65de1967-905a-432f-a5bf-91b9d53076f0 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lazy-loading 'resources' on Instance uuid 9edd3f37-b2c5-48ba-96ec-8f8f39975875 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:25:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-65de1967-905a-432f-a5bf-91b9d53076f0 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:17:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1968017281',display_name='tempest-TestStampPattern-server-1968017281',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1968017281',id=43,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjAWwzwaU6mM0uAVsf8M4MDogDeVam7U1Q9qZmbmnyN2kPP3EA+mz3AuKWhN3KvaKw+FEfwvQyWF60LDgsm9usmH03QvjairlAc6n6xpMsjt7JR9DxroHR+P7DjVWteTQ==',key_name='tempest-TestStampPattern-1058561610',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:17:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11bff47d48dd4d64bdfa4c4e60d04d60',ramdisk_id='',reservation_id='r-119k9dgf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1607533786',owner_user_name='tempest-TestStampPattern-1607533786-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:21:05Z,user_data=None,user_id='c1e37c55e4674f339ead74243d89e9ba',uuid=9edd3f37-b2c5-48ba-96ec-8f8f39975875,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90d4a51e-8558-4326-b2c4-b29e584ba8e4", "address": "fa:16:3e:b8:c7:f9", "network": {"id": "4d522d89-a309-4855-b48c-eb20e3a7cdea", "bridge": "br-int", "label": "tempest-TestStampPattern-1021360457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bff47d48dd4d64bdfa4c4e60d04d60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90d4a51e-85", "ovs_interfaceid": "90d4a51e-8558-4326-b2c4-b29e584ba8e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:25:36 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-65de1967-905a-432f-a5bf-91b9d53076f0 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Converting VIF {"id": "90d4a51e-8558-4326-b2c4-b29e584ba8e4", "address": "fa:16:3e:b8:c7:f9", "network": {"id": "4d522d89-a309-4855-b48c-eb20e3a7cdea", "bridge": "br-int", "label": "tempest-TestStampPattern-1021360457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bff47d48dd4d64bdfa4c4e60d04d60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90d4a51e-85", "ovs_interfaceid": "90d4a51e-8558-4326-b2c4-b29e584ba8e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:25:36 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-65de1967-905a-432f-a5bf-91b9d53076f0 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:c7:f9,bridge_name='br-int',has_traffic_filtering=True,id=90d4a51e-8558-4326-b2c4-b29e584ba8e4,network=Network(4d522d89-a309-4855-b48c-eb20e3a7cdea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90d4a51e-85') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:25:36 user nova-compute[75014]: DEBUG os_vif [None req-65de1967-905a-432f-a5bf-91b9d53076f0 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:c7:f9,bridge_name='br-int',has_traffic_filtering=True,id=90d4a51e-8558-4326-b2c4-b29e584ba8e4,network=Network(4d522d89-a309-4855-b48c-eb20e3a7cdea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90d4a51e-85') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:25:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90d4a51e-85, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:25:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:25:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d5870e6-c21c-46ad-a11c-24783642e731) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:25:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:36 user nova-compute[75014]: INFO os_vif [None req-65de1967-905a-432f-a5bf-91b9d53076f0 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:c7:f9,bridge_name='br-int',has_traffic_filtering=True,id=90d4a51e-8558-4326-b2c4-b29e584ba8e4,network=Network(4d522d89-a309-4855-b48c-eb20e3a7cdea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90d4a51e-85')
Nov 08 04:25:36 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-65de1967-905a-432f-a5bf-91b9d53076f0 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Deleting instance files /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875_del
Nov 08 04:25:36 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-65de1967-905a-432f-a5bf-91b9d53076f0 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Deletion of /opt/stack/data/nova/instances/9edd3f37-b2c5-48ba-96ec-8f8f39975875_del complete
Nov 08 04:25:36 user nova-compute[75014]: INFO nova.compute.manager [None req-65de1967-905a-432f-a5bf-91b9d53076f0 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 08 04:25:36 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-65de1967-905a-432f-a5bf-91b9d53076f0 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:25:36 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:25:36 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:25:36 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:25:36 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Took 0.43 seconds to deallocate network for instance.
Nov 08 04:25:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-65de1967-905a-432f-a5bf-91b9d53076f0 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:25:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-65de1967-905a-432f-a5bf-91b9d53076f0 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:25:36 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-65de1967-905a-432f-a5bf-91b9d53076f0 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:25:36 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-65de1967-905a-432f-a5bf-91b9d53076f0 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:25:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-65de1967-905a-432f-a5bf-91b9d53076f0 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:25:36 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-65de1967-905a-432f-a5bf-91b9d53076f0 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Deleted allocations for instance 9edd3f37-b2c5-48ba-96ec-8f8f39975875
Nov 08 04:25:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-65de1967-905a-432f-a5bf-91b9d53076f0 tempest-TestStampPattern-1607533786 tempest-TestStampPattern-1607533786-project-member] Lock "9edd3f37-b2c5-48ba-96ec-8f8f39975875" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.764s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:25:37 user nova-compute[75014]: DEBUG nova.compute.manager [req-1c66cefb-5cf9-4d11-a57c-d1be1c18c490 req-fb76197d-3a09-4954-8a29-459c2fb9431e service nova] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Received event network-vif-deleted-90d4a51e-8558-4326-b2c4-b29e584ba8e4 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:25:37 user nova-compute[75014]: DEBUG nova.compute.manager [req-6c6dc22e-cbc6-4c87-a9f0-999dd477326e req-9b6fd805-f64a-4dc5-9bfd-a1a5d8a26414 service nova] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Received event network-vif-plugged-90d4a51e-8558-4326-b2c4-b29e584ba8e4 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:25:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-6c6dc22e-cbc6-4c87-a9f0-999dd477326e req-9b6fd805-f64a-4dc5-9bfd-a1a5d8a26414 service nova] Acquiring lock "9edd3f37-b2c5-48ba-96ec-8f8f39975875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:25:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-6c6dc22e-cbc6-4c87-a9f0-999dd477326e req-9b6fd805-f64a-4dc5-9bfd-a1a5d8a26414 service nova] Lock "9edd3f37-b2c5-48ba-96ec-8f8f39975875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:25:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-6c6dc22e-cbc6-4c87-a9f0-999dd477326e req-9b6fd805-f64a-4dc5-9bfd-a1a5d8a26414 service nova] Lock "9edd3f37-b2c5-48ba-96ec-8f8f39975875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:25:37 user nova-compute[75014]: DEBUG nova.compute.manager [req-6c6dc22e-cbc6-4c87-a9f0-999dd477326e req-9b6fd805-f64a-4dc5-9bfd-a1a5d8a26414 service nova] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] No waiting events found dispatching network-vif-plugged-90d4a51e-8558-4326-b2c4-b29e584ba8e4 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:25:37 user nova-compute[75014]: WARNING nova.compute.manager [req-6c6dc22e-cbc6-4c87-a9f0-999dd477326e req-9b6fd805-f64a-4dc5-9bfd-a1a5d8a26414 service nova] [instance: 9edd3f37-b2c5-48ba-96ec-8f8f39975875] Received unexpected event network-vif-plugged-90d4a51e-8558-4326-b2c4-b29e584ba8e4 for instance with vm_state deleted and task_state None.
Nov 08 04:25:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:46 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:49 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:25:50 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:25:50 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:25:50 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Rebuilding the list of instances to heal {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 04:25:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:25:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:25:50 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 04:25:50 user nova-compute[75014]: DEBUG nova.objects.instance [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lazy-loading 'info_cache' on Instance uuid 08acc858-dc89-4ae8-9b48-08e6de5db0d0 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:25:50 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Updating instance_info_cache with network_info: [{"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:25:50 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:25:50 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 04:25:50 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:25:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:51 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:25:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:55 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:25:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:25:57 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:25:57 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:25:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:26:00 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:26:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:26:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:26:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:26:00 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:26:00 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:26:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:26:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:26:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:26:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:26:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:26:01 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:26:01 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:26:01 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=8667MB free_disk=24.89966583251953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:26:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:26:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:26:01 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 08acc858-dc89-4ae8-9b48-08e6de5db0d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:26:01 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance be882529-f74b-4743-a7a8-0a64e8f6c2c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:26:01 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:26:01 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:26:01 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Refreshing inventories for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 04:26:01 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Updating ProviderTree inventory for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 04:26:01 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Updating inventory in ProviderTree for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 04:26:01 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Refreshing aggregate associations for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0, aggregates: None {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 04:26:01 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Refreshing trait associations for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 04:26:01 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:26:01 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:26:01 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:26:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.481s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:26:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:26:03 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:26:03 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:26:03 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:26:05 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:26:05 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Cleaning up deleted instances {{(pid=75014) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 04:26:05 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] There are 0 instances to clean {{(pid=75014) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 04:26:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:26:07 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:26:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:26:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:26:21 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:26:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:26:30 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:26:30 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=75014) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 04:26:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:26:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:26:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:26:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:26:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:26:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:26:46 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:26:50 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:26:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:26:52 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:26:52 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:26:52 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:26:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-be882529-f74b-4743-a7a8-0a64e8f6c2c0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:26:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-be882529-f74b-4743-a7a8-0a64e8f6c2c0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:26:52 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 04:26:53 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Updating instance_info_cache with network_info: [{"id": "31de527f-d08b-4b86-8c23-c96c4ebe51f9", "address": "fa:16:3e:36:70:4d", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31de527f-d0", "ovs_interfaceid": "31de527f-d08b-4b86-8c23-c96c4ebe51f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:26:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-be882529-f74b-4743-a7a8-0a64e8f6c2c0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:26:53 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 04:26:53 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:26:53 user nova-compute[75014]: DEBUG nova.compute.manager [req-0d6c7b46-ac3b-4973-9255-2ef3e56b951c req-4ace91a8-689c-482d-816f-f62a479b1539 service nova] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Received event network-changed-31de527f-d08b-4b86-8c23-c96c4ebe51f9 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:26:53 user nova-compute[75014]: DEBUG nova.compute.manager [req-0d6c7b46-ac3b-4973-9255-2ef3e56b951c req-4ace91a8-689c-482d-816f-f62a479b1539 service nova] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Refreshing instance network info cache due to event network-changed-31de527f-d08b-4b86-8c23-c96c4ebe51f9. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:26:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0d6c7b46-ac3b-4973-9255-2ef3e56b951c req-4ace91a8-689c-482d-816f-f62a479b1539 service nova] Acquiring lock "refresh_cache-be882529-f74b-4743-a7a8-0a64e8f6c2c0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:26:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0d6c7b46-ac3b-4973-9255-2ef3e56b951c req-4ace91a8-689c-482d-816f-f62a479b1539 service nova] Acquired lock "refresh_cache-be882529-f74b-4743-a7a8-0a64e8f6c2c0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:26:53 user nova-compute[75014]: DEBUG nova.network.neutron [req-0d6c7b46-ac3b-4973-9255-2ef3e56b951c req-4ace91a8-689c-482d-816f-f62a479b1539 service nova] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Refreshing network info cache for port 31de527f-d08b-4b86-8c23-c96c4ebe51f9 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:26:54 user nova-compute[75014]: DEBUG nova.network.neutron [req-0d6c7b46-ac3b-4973-9255-2ef3e56b951c req-4ace91a8-689c-482d-816f-f62a479b1539 service nova] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Updated VIF entry in instance network info cache for port 31de527f-d08b-4b86-8c23-c96c4ebe51f9. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:26:54 user nova-compute[75014]: DEBUG nova.network.neutron [req-0d6c7b46-ac3b-4973-9255-2ef3e56b951c req-4ace91a8-689c-482d-816f-f62a479b1539 service nova] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Updating instance_info_cache with network_info: [{"id": "31de527f-d08b-4b86-8c23-c96c4ebe51f9", "address": "fa:16:3e:36:70:4d", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31de527f-d0", "ovs_interfaceid": "31de527f-d08b-4b86-8c23-c96c4ebe51f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:26:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-0d6c7b46-ac3b-4973-9255-2ef3e56b951c req-4ace91a8-689c-482d-816f-f62a479b1539 service nova] Releasing lock "refresh_cache-be882529-f74b-4743-a7a8-0a64e8f6c2c0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:26:55 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:26:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:26:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:26:58 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:27:00 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:27:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:27:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:27:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:27:00 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:27:00 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:27:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:01 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:27:01 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:27:01 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=8836MB free_disk=24.897144317626953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:27:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:27:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:27:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:01 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 08acc858-dc89-4ae8-9b48-08e6de5db0d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:27:01 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance be882529-f74b-4743-a7a8-0a64e8f6c2c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:27:01 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:27:01 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:27:01 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:27:01 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:27:01 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:27:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.235s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:27:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:04 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:27:04 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:27:04 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:27:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquiring lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG nova.objects.instance [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lazy-loading 'flavor' on Instance uuid 08acc858-dc89-4ae8-9b48-08e6de5db0d0 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "01480a73-ec80-48df-8d55-a59669f0e64e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "01480a73-ec80-48df-8d55-a59669f0e64e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG nova.compute.manager [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquiring lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:27:09 user nova-compute[75014]: INFO nova.compute.manager [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Attaching volume 80f82440-69e0-4522-ac18-f17eeec2d76a to /dev/vdb
Nov 08 04:27:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG os_brick.utils [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 04:27:09 user nova-compute[75014]: INFO nova.compute.claims [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Claim successful on node user
Nov 08 04:27:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd66163-5e62-43ab-94e5-585f67f97ae6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c12bcf-64ed-4e10-a2eb-73ca458dbe77]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff34925-70e0-40bd-9286-23e6e430edb2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa4f795-50cc-4a39-aa16-c49c64227e7f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:27:09 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:27:09 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[891a1832-3ab6-4079-bed5-655203f3f8be]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG os_brick.utils [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Updating existing volume attachment record: 46137461-6b7b-409b-a754-61706bd6f70b {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.316s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:27:09 user nova-compute[75014]: DEBUG nova.compute.manager [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 04:27:10 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 04:27:10 user nova-compute[75014]: DEBUG nova.compute.manager [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 04:27:10 user nova-compute[75014]: DEBUG nova.network.neutron [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 04:27:10 user nova-compute[75014]: DEBUG nova.compute.manager [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 04:27:10 user nova-compute[75014]: DEBUG nova.policy [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe1c5af56ab14da7986d64e38597d394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504ed2858e78480e9beef5aa5f5d9f1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 04:27:10 user nova-compute[75014]: INFO nova.virt.block_device [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Booting with volume snapshot 8df8d56f-1d0a-4e1c-b8ce-666cc3f1da58 at /dev/vda
Nov 08 04:27:10 user nova-compute[75014]: DEBUG nova.network.neutron [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Successfully created port: fa5b0aad-e74d-4325-937d-82ace4686c34 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 04:27:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:27:11 user nova-compute[75014]: DEBUG nova.network.neutron [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Successfully updated port: fa5b0aad-e74d-4325-937d-82ace4686c34 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 04:27:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "refresh_cache-01480a73-ec80-48df-8d55-a59669f0e64e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:27:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquired lock "refresh_cache-01480a73-ec80-48df-8d55-a59669f0e64e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:27:11 user nova-compute[75014]: DEBUG nova.network.neutron [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:27:11 user nova-compute[75014]: DEBUG nova.compute.manager [req-a42b4d73-a2e1-4e48-af2c-519de4905c92 req-b5f0801e-faad-4bcd-b3e3-e80bb9398fec service nova] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Received event network-changed-fa5b0aad-e74d-4325-937d-82ace4686c34 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:27:11 user nova-compute[75014]: DEBUG nova.compute.manager [req-a42b4d73-a2e1-4e48-af2c-519de4905c92 req-b5f0801e-faad-4bcd-b3e3-e80bb9398fec service nova] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Refreshing instance network info cache due to event network-changed-fa5b0aad-e74d-4325-937d-82ace4686c34. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:27:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a42b4d73-a2e1-4e48-af2c-519de4905c92 req-b5f0801e-faad-4bcd-b3e3-e80bb9398fec service nova] Acquiring lock "refresh_cache-01480a73-ec80-48df-8d55-a59669f0e64e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:27:11 user nova-compute[75014]: DEBUG nova.network.neutron [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 04:27:11 user nova-compute[75014]: DEBUG nova.network.neutron [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Updating instance_info_cache with network_info: [{"id": "fa5b0aad-e74d-4325-937d-82ace4686c34", "address": "fa:16:3e:fc:a6:3e", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa5b0aad-e7", "ovs_interfaceid": "fa5b0aad-e74d-4325-937d-82ace4686c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:27:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Releasing lock "refresh_cache-01480a73-ec80-48df-8d55-a59669f0e64e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:27:11 user nova-compute[75014]: DEBUG nova.compute.manager [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Instance network_info: |[{"id": "fa5b0aad-e74d-4325-937d-82ace4686c34", "address": "fa:16:3e:fc:a6:3e", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa5b0aad-e7", "ovs_interfaceid": "fa5b0aad-e74d-4325-937d-82ace4686c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 04:27:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a42b4d73-a2e1-4e48-af2c-519de4905c92 req-b5f0801e-faad-4bcd-b3e3-e80bb9398fec service nova] Acquired lock "refresh_cache-01480a73-ec80-48df-8d55-a59669f0e64e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:27:11 user nova-compute[75014]: DEBUG nova.network.neutron [req-a42b4d73-a2e1-4e48-af2c-519de4905c92 req-b5f0801e-faad-4bcd-b3e3-e80bb9398fec service nova] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Refreshing network info cache for port fa5b0aad-e74d-4325-937d-82ace4686c34 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:27:12 user nova-compute[75014]: DEBUG nova.network.neutron [req-a42b4d73-a2e1-4e48-af2c-519de4905c92 req-b5f0801e-faad-4bcd-b3e3-e80bb9398fec service nova] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Updated VIF entry in instance network info cache for port fa5b0aad-e74d-4325-937d-82ace4686c34. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:27:12 user nova-compute[75014]: DEBUG nova.network.neutron [req-a42b4d73-a2e1-4e48-af2c-519de4905c92 req-b5f0801e-faad-4bcd-b3e3-e80bb9398fec service nova] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Updating instance_info_cache with network_info: [{"id": "fa5b0aad-e74d-4325-937d-82ace4686c34", "address": "fa:16:3e:fc:a6:3e", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa5b0aad-e7", "ovs_interfaceid": "fa5b0aad-e74d-4325-937d-82ace4686c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:27:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a42b4d73-a2e1-4e48-af2c-519de4905c92 req-b5f0801e-faad-4bcd-b3e3-e80bb9398fec service nova] Releasing lock "refresh_cache-01480a73-ec80-48df-8d55-a59669f0e64e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:27:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:15 user nova-compute[75014]: DEBUG os_brick.utils [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:27:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:15 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[120564c9-13b6-42e1-97a5-8ef536efbe17]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:15 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6b0961-1780-46f2-848a-6c3c53264c34]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a469fd-b1ad-4c99-a062-d159149a98e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0b5e54-78ff-4cb3-86db-8c4e7db9e057]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:27:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:27:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:27:16 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:27:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf5e872-e98d-4ca5-948c-ae6dc1bf7158]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:27:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:27:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:27:16 user nova-compute[75014]: DEBUG os_brick.utils [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:27:16 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Updating existing volume attachment record: cc1c6905-f6ca-48e6-b8a1-dcf4ba5b235e {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:27:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:21 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:27:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:27:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:27:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:27:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:27 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_power_states {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:27:27 user nova-compute[75014]: WARNING nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] While synchronizing instance power states, found 3 instances in the database and 2 instances on the hypervisor.
Nov 08 04:27:27 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid 08acc858-dc89-4ae8-9b48-08e6de5db0d0 {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 04:27:27 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid be882529-f74b-4743-a7a8-0a64e8f6c2c0 {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 04:27:27 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid 01480a73-ec80-48df-8d55-a59669f0e64e {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 04:27:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:27:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "be882529-f74b-4743-a7a8-0a64e8f6c2c0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:27:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "be882529-f74b-4743-a7a8-0a64e8f6c2c0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:27:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "01480a73-ec80-48df-8d55-a59669f0e64e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:27:27 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "be882529-f74b-4743-a7a8-0a64e8f6c2c0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:27:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfaYAQzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:27:32 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:27:32 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:27:32 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:27:32 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:27:32 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7891716f-5800-48a6-8eb6-4566467ad7ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:27:32 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0023cfd-a2d4-403a-a951-810f6fb952e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a] added
Nov 08 04:27:32 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcc51a1-4872-4d50-831e-ee77485fb63b]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[974fae1e-1351-4cf1-9b56-1012f32e3f79]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wfaYAQzI {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wfaYAQzI" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eef2ff7-82b7-475f-9b25-d04372a2adc1]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wfaYAQzI'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb93735-b9f4-453c-91cd-e481ff071d2d]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3037ef-b166-42ef-90f2-022a03e20e3e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:27:32 user nova-compute[75014]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)
Nov 08 04:27:32 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:27:32 user nova-compute[75014]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)
Nov 08 04:27:32 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66b44b9-3831-44fe-8655-70b1b5c932a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a, portal: 172.16.0.220,3260]
Nov 08 04:27:32 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a, portal: 172.16.0.220,3260] successful.
Nov 08 04:27:32 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39171ef-42fb-46a1-b9f2-e24e5558aa30]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f70ac2-7502-40fe-a3c1-de2f8ffd6d30]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:27:32 user nova-compute[75014]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)
Nov 08 04:27:32 user nova-compute[75014]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a (non-flash)
Nov 08 04:27:32 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:27:32 user nova-compute[75014]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)
Nov 08 04:27:32 user nova-compute[75014]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a (non-flash)
Nov 08 04:27:32 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[855242c7-ad98-4591-993b-0aa4056a9233]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:27:32 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfaYAQzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:27:33 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:27:33 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23539353334353163', 'path': '/dev/sdc'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:27:33 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539353334353163', 'path': '/dev/sdc'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:27:33 user nova-compute[75014]: DEBUG nova.objects.instance [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lazy-loading 'flavor' on Instance uuid 08acc858-dc89-4ae8-9b48-08e6de5db0d0 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:27:33 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 04:27:33 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:27:33 user nova-compute[75014]:   <source dev="/dev/sdc"/>
Nov 08 04:27:33 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:27:33 user nova-compute[75014]:   <serial>80f82440-69e0-4522-ac18-f17eeec2d76a</serial>
Nov 08 04:27:33 user nova-compute[75014]: </disk>
Nov 08 04:27:33 user nova-compute[75014]:  {{(pid=75014) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 04:27:33 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:27:33 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:27:33 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] No VIF found with MAC fa:16:3e:42:95:35, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:27:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-62487912-92de-4e6f-9777-bd7f492471d8 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.540s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:27:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 6.498s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:27:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:27:35 user nova-compute[75014]: DEBUG nova.compute.manager [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Stashing vm_state: active {{(pid=75014) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 08 04:27:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:27:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:27:35 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 04:27:35 user nova-compute[75014]: INFO nova.compute.claims [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Claim successful on node user
Nov 08 04:27:35 user nova-compute[75014]: INFO nova.compute.resource_tracker [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Updating resource usage from migration 2e871e6e-023a-4cca-b557-3b7d370fc76c
Nov 08 04:27:35 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:27:35 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:27:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.255s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:27:35 user nova-compute[75014]: INFO nova.compute.manager [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Migrating
Nov 08 04:27:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquiring lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:27:35 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquired lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:27:35 user nova-compute[75014]: DEBUG nova.network.neutron [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:27:36 user nova-compute[75014]: DEBUG nova.network.neutron [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Updating instance_info_cache with network_info: [{"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:27:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Releasing lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:27:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:27:36 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Starting migrate_disk_and_power_off {{(pid=75014) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 08 04:27:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:36 user nova-compute[75014]: DEBUG nova.compute.manager [req-4303cbff-5ac1-46af-a23b-1acc7c206faf req-7dbaa5aa-0928-446c-b61a-feed17661ee0 service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received event network-vif-unplugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:27:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4303cbff-5ac1-46af-a23b-1acc7c206faf req-7dbaa5aa-0928-446c-b61a-feed17661ee0 service nova] Acquiring lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:27:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4303cbff-5ac1-46af-a23b-1acc7c206faf req-7dbaa5aa-0928-446c-b61a-feed17661ee0 service nova] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:27:36 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4303cbff-5ac1-46af-a23b-1acc7c206faf req-7dbaa5aa-0928-446c-b61a-feed17661ee0 service nova] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:27:36 user nova-compute[75014]: DEBUG nova.compute.manager [req-4303cbff-5ac1-46af-a23b-1acc7c206faf req-7dbaa5aa-0928-446c-b61a-feed17661ee0 service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] No waiting events found dispatching network-vif-unplugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:27:36 user nova-compute[75014]: WARNING nova.compute.manager [req-4303cbff-5ac1-46af-a23b-1acc7c206faf req-7dbaa5aa-0928-446c-b61a-feed17661ee0 service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received unexpected event network-vif-unplugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf for instance with vm_state active and task_state resize_migrating.
Nov 08 04:27:37 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Instance destroyed successfully.
Nov 08 04:27:37 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-809427286',display_name='tempest-ServerActionsTestOtherB-server-809427286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-809427286',id=46,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdfoac/qWiSELcxtzUkuk+o8acjsOIEGrFVZM627fy7ovi3OfsfBH6nUCuIfY7BK2ldXdAqxdoVU6c1JyFZHm23ngkkF9j7Yy2b+7zJu1QcSK4PuxDPCnQBF7ZI6NxBlg==',key_name='tempest-keypair-1823743126',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:23:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7ec7bf4b5935436792895f9a522431c4',ramdisk_id='',reservation_id='r-o63p9ir8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1064545051',owner_user_name='tempest-ServerActionsTestOtherB-1064545051-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:27:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b0c5324a67d4137b0ac20c505d28251',uuid=08acc858-dc89-4ae8-9b48-08e6de5db0d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1674551282-network", "vif_mac": "fa:16:3e:42:95:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Converting VIF {"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1674551282-network", "vif_mac": "fa:16:3e:42:95:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:95:35,bridge_name='br-int',has_traffic_filtering=True,id=3137db93-bf8f-4d21-a1df-f9b6014d46bf,network=Network(5dbeed84-c2af-4e98-b511-a7500ba483e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3137db93-bf') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG os_vif [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:95:35,bridge_name='br-int',has_traffic_filtering=True,id=3137db93-bf8f-4d21-a1df-f9b6014d46bf,network=Network(5dbeed84-c2af-4e98-b511-a7500ba483e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3137db93-bf') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3137db93-bf, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=91104fab-aca5-497f-a669-885f0b3506f4) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:27:37 user nova-compute[75014]: INFO os_vif [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:95:35,bridge_name='br-int',has_traffic_filtering=True,id=3137db93-bf8f-4d21-a1df-f9b6014d46bf,network=Network(5dbeed84-c2af-4e98-b511-a7500ba483e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3137db93-bf')
Nov 08 04:27:37 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfaYAQzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:27:37 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:27:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3597cc-e533-4e1f-9197-b55a9a1b2d73]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:27:37 user nova-compute[75014]: No targets found.
Nov 08 04:27:37 user nova-compute[75014]: iSNS:
Nov 08 04:27:37 user nova-compute[75014]: No targets found.
Nov 08 04:27:37 user nova-compute[75014]: STATIC:
Nov 08 04:27:37 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:27:37 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:27:37 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:27:37 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a
Nov 08 04:27:37 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:27:37 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:27:37 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301
Nov 08 04:27:37 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:27:37 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:27:37 user nova-compute[75014]: FIRMWARE:
Nov 08 04:27:37 user nova-compute[75014]: No targets found.
Nov 08 04:27:37 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:27:37 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:27:37 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aee06bd-5d5b-473a-a4cb-514b5f50f509]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e38865e-4976-4fb2-8ebf-79191d2bdca9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:27:37 user nova-compute[75014]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)
Nov 08 04:27:37 user nova-compute[75014]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a (non-flash)
Nov 08 04:27:37 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:27:37 user nova-compute[75014]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)
Nov 08 04:27:37 user nova-compute[75014]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a (non-flash)
Nov 08 04:27:37 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f03dc7ca830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a'): ({'sdc'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Removing single pathed devices sdc {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e69af07-3262-436e-b4de-2a70bd9a7111]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[744b384b-39cc-45df-908c-7835044ae1dd]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Flushing IO for device /dev/sdc {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[559b2267-9d5b-4c3b-bb2b-3df160d32eee]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[06251da4-1426-48e1-b0d7-851cb314a6b7]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] SCSI volumes sdc have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e6fa5b-1ba1-4ca7-9bc5-6aa44efdde0e]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cc91be-3134-44f5-b799-9b1754638e31]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a, portal: 172.16.0.220,3260]
Nov 08 04:27:37 user nova-compute[75014]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a, portal: 172.16.0.220,3260] successful.
Nov 08 04:27:37 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1daae13b-f59a-49ef-a0e7-1b2290a89f64]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] <== disconnect_volume: return (311ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:27:37 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0_resize/disk /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] CMD "cp -r /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0_resize/disk /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk" returned: 0 in 0.363s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0_resize/disk.info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk.info {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] CMD "cp -r /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0_resize/disk.info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk.info" returned: 0 in 0.031s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG nova.compute.manager [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 04:27:38 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Creating image(s)
Nov 08 04:27:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Did not create local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Ensure instance console log exists: /opt/stack/data/nova/instances/01480a73-ec80-48df-8d55-a59669f0e64e/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Start _get_guest_xml network_info=[{"id": "fa5b0aad-e74d-4325-937d-82ace4686c34", "address": "fa:16:3e:fc:a6:3e", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa5b0aad-e7", "ovs_interfaceid": "fa5b0aad-e74d-4325-937d-82ace4686c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-08T04:26:55Z,direct_url=<?>,disk_format='qcow2',id=b3aa7cdd-3dcc-4b47-b6dc-2a1ca501021f,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-485385700',owner='504ed2858e78480e9beef5aa5f5d9f1d',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-08T04:26:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WrIPlEpf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '01480a73-ec80-48df-8d55-a59669f0e64e', 'attached_at': '', 'detached_at': '', 'volume_id': '337ed1bb-add0-4156-9b3b-56fd86328252', 'serial': '337ed1bb-add0-4156-9b3b-56fd86328252'}, 'device_type': 'disk', 'attachment_id': 'cc1c6905-f6ca-48e6-b8a1-dcf4ba5b235e', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:27:38 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:27:38 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:27:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-08T04:26:55Z,direct_url=<?>,disk_format='qcow2',id=b3aa7cdd-3dcc-4b47-b6dc-2a1ca501021f,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-485385700',owner='504ed2858e78480e9beef5aa5f5d9f1d',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-08T04:26:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WrIPlEpf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:27:38 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:27:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:27:38 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:27:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:27:38 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e749c41-0e39-4e54-b671-49cddd77e6ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:27:38 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5fc6db-2394-4267-9a8e-5bf17b14eddb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252] added
Nov 08 04:27:38 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35de16d-43ce-438a-9e98-347f0c88db39]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7fce62-96c3-4bec-a4ec-60614918c2ea]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG nova.compute.manager [req-b8ffdab2-0dcd-40a3-90ef-4d16bb08a127 req-ef477d2e-1243-47cf-8c1c-6c9983b6cfaf service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received event network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b8ffdab2-0dcd-40a3-90ef-4d16bb08a127 req-ef477d2e-1243-47cf-8c1c-6c9983b6cfaf service nova] Acquiring lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b8ffdab2-0dcd-40a3-90ef-4d16bb08a127 req-ef477d2e-1243-47cf-8c1c-6c9983b6cfaf service nova] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b8ffdab2-0dcd-40a3-90ef-4d16bb08a127 req-ef477d2e-1243-47cf-8c1c-6c9983b6cfaf service nova] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG nova.compute.manager [req-b8ffdab2-0dcd-40a3-90ef-4d16bb08a127 req-ef477d2e-1243-47cf-8c1c-6c9983b6cfaf service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] No waiting events found dispatching network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:27:38 user nova-compute[75014]: WARNING nova.compute.manager [req-b8ffdab2-0dcd-40a3-90ef-4d16bb08a127 req-ef477d2e-1243-47cf-8c1c-6c9983b6cfaf service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received unexpected event network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf for instance with vm_state active and task_state resize_migrating.
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WrIPlEpf {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WrIPlEpf" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ae7671-95ee-4e25-8376-07bc26c9c4b1]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WrIPlEpf'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[321f4c01-8251-4849-801f-9a929578b384]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bd1d73-1ca2-45f7-b60d-f146c01996f6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:27:38 user nova-compute[75014]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)
Nov 08 04:27:38 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:27:38 user nova-compute[75014]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)
Nov 08 04:27:38 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9397c9fe-eae8-4153-8144-6f51603af99b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252, portal: 172.16.0.220,3260]
Nov 08 04:27:38 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252, portal: 172.16.0.220,3260] successful.
Nov 08 04:27:38 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b2ac60-6a4f-4ef0-abd0-8edc0b0e151a]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a9b575-e60f-45a3-87a2-f09e84d347ef]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:27:38 user nova-compute[75014]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)
Nov 08 04:27:38 user nova-compute[75014]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 (non-flash)
Nov 08 04:27:38 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:27:38 user nova-compute[75014]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)
Nov 08 04:27:38 user nova-compute[75014]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 (non-flash)
Nov 08 04:27:38 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4b46cc-955e-436b-83b5-35f5c3eb7272]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:27:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WrIPlEpf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG nova.network.neutron [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Port 3137db93-bf8f-4d21-a1df-f9b6014d46bf binding to destination host user is already ACTIVE {{(pid=75014) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquiring lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquiring lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquired lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG nova.network.neutron [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26233376363623865', 'path': '/dev/sdc'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233376363623865', 'path': '/dev/sdc'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:27:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-12032405',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-12032405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-12032405',id=48,image_ref='b3aa7cdd-3dcc-4b47-b6dc-2a1ca501021f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1NFa2vvJ9OmSjmI5qq36vRl26rd19PxhRPLIzaIZTe57Qwba+f7N7mDM03GYwMhbBFK3zVZpmYaAOxRLvzlR/ie7AxtmPBVkEcBfD/FzB+7hoDS/TiVCQvp+GxbCz0DQ==',key_name='tempest-keypair-21223112',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='504ed2858e78480e9beef5aa5f5d9f1d',ramdisk_id='',reservation_id='r-tbgkcd6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2082374398',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2082374398-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2082374398',owner_user_name='tempest-TestVolumeBootPattern-2082374398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:27:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe1c5af56ab14da7986d64e38597d394',uuid=01480a73-ec80-48df-8d55-a59669f0e64e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa5b0aad-e74d-4325-937d-82ace4686c34", "address": "fa:16:3e:fc:a6:3e", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa5b0aad-e7", "ovs_interfaceid": "fa5b0aad-e74d-4325-937d-82ace4686c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converting VIF {"id": "fa5b0aad-e74d-4325-937d-82ace4686c34", "address": "fa:16:3e:fc:a6:3e", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa5b0aad-e7", "ovs_interfaceid": "fa5b0aad-e74d-4325-937d-82ace4686c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:a6:3e,bridge_name='br-int',has_traffic_filtering=True,id=fa5b0aad-e74d-4325-937d-82ace4686c34,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa5b0aad-e7') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG nova.objects.instance [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lazy-loading 'pci_devices' on Instance uuid 01480a73-ec80-48df-8d55-a59669f0e64e {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:27:39 user nova-compute[75014]:   <uuid>01480a73-ec80-48df-8d55-a59669f0e64e</uuid>
Nov 08 04:27:39 user nova-compute[75014]:   <name>instance-00000030</name>
Nov 08 04:27:39 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:27:39 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:27:39 user nova-compute[75014]:   <metadata>
Nov 08 04:27:39 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:27:39 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:27:39 user nova-compute[75014]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-12032405</nova:name>
Nov 08 04:27:39 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:27:38</nova:creationTime>
Nov 08 04:27:39 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:27:39 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:27:39 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:27:39 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:27:39 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:27:39 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:27:39 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:27:39 user nova-compute[75014]:       <nova:owner>
Nov 08 04:27:39 user nova-compute[75014]:         <nova:user uuid="fe1c5af56ab14da7986d64e38597d394">tempest-TestVolumeBootPattern-2082374398-project-member</nova:user>
Nov 08 04:27:39 user nova-compute[75014]:         <nova:project uuid="504ed2858e78480e9beef5aa5f5d9f1d">tempest-TestVolumeBootPattern-2082374398</nova:project>
Nov 08 04:27:39 user nova-compute[75014]:       </nova:owner>
Nov 08 04:27:39 user nova-compute[75014]:       <nova:root type="image" uuid="b3aa7cdd-3dcc-4b47-b6dc-2a1ca501021f"/>
Nov 08 04:27:39 user nova-compute[75014]:       <nova:ports>
Nov 08 04:27:39 user nova-compute[75014]:         <nova:port uuid="fa5b0aad-e74d-4325-937d-82ace4686c34">
Nov 08 04:27:39 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 04:27:39 user nova-compute[75014]:         </nova:port>
Nov 08 04:27:39 user nova-compute[75014]:       </nova:ports>
Nov 08 04:27:39 user nova-compute[75014]:     </nova:instance>
Nov 08 04:27:39 user nova-compute[75014]:   </metadata>
Nov 08 04:27:39 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:27:39 user nova-compute[75014]:     <system>
Nov 08 04:27:39 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:27:39 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:27:39 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:27:39 user nova-compute[75014]:       <entry name="serial">01480a73-ec80-48df-8d55-a59669f0e64e</entry>
Nov 08 04:27:39 user nova-compute[75014]:       <entry name="uuid">01480a73-ec80-48df-8d55-a59669f0e64e</entry>
Nov 08 04:27:39 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:27:39 user nova-compute[75014]:     </system>
Nov 08 04:27:39 user nova-compute[75014]:   </sysinfo>
Nov 08 04:27:39 user nova-compute[75014]:   <os>
Nov 08 04:27:39 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:27:39 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:27:39 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:27:39 user nova-compute[75014]:   </os>
Nov 08 04:27:39 user nova-compute[75014]:   <features>
Nov 08 04:27:39 user nova-compute[75014]:     <acpi/>
Nov 08 04:27:39 user nova-compute[75014]:     <apic/>
Nov 08 04:27:39 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:27:39 user nova-compute[75014]:   </features>
Nov 08 04:27:39 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:27:39 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:27:39 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:27:39 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:27:39 user nova-compute[75014]:   </clock>
Nov 08 04:27:39 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:27:39 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:27:39 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:27:39 user nova-compute[75014]:   </cpu>
Nov 08 04:27:39 user nova-compute[75014]:   <devices>
Nov 08 04:27:39 user nova-compute[75014]:     <disk type="block" device="disk">
Nov 08 04:27:39 user nova-compute[75014]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:27:39 user nova-compute[75014]:       <source dev="/dev/sdc"/>
Nov 08 04:27:39 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:27:39 user nova-compute[75014]:       <serial>337ed1bb-add0-4156-9b3b-56fd86328252</serial>
Nov 08 04:27:39 user nova-compute[75014]:     </disk>
Nov 08 04:27:39 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:27:39 user nova-compute[75014]:       <mac address="fa:16:3e:fc:a6:3e"/>
Nov 08 04:27:39 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:27:39 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:27:39 user nova-compute[75014]:       <target dev="tapfa5b0aad-e7"/>
Nov 08 04:27:39 user nova-compute[75014]:     </interface>
Nov 08 04:27:39 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:27:39 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/01480a73-ec80-48df-8d55-a59669f0e64e/console.log" append="off"/>
Nov 08 04:27:39 user nova-compute[75014]:     </serial>
Nov 08 04:27:39 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:27:39 user nova-compute[75014]:     <video>
Nov 08 04:27:39 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:27:39 user nova-compute[75014]:     </video>
Nov 08 04:27:39 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:27:39 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:27:39 user nova-compute[75014]:     </rng>
Nov 08 04:27:39 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:27:39 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:27:39 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:27:39 user nova-compute[75014]:     </memballoon>
Nov 08 04:27:39 user nova-compute[75014]:   </devices>
Nov 08 04:27:39 user nova-compute[75014]: </domain>
Nov 08 04:27:39 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:27:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-12032405',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-12032405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-12032405',id=48,image_ref='b3aa7cdd-3dcc-4b47-b6dc-2a1ca501021f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1NFa2vvJ9OmSjmI5qq36vRl26rd19PxhRPLIzaIZTe57Qwba+f7N7mDM03GYwMhbBFK3zVZpmYaAOxRLvzlR/ie7AxtmPBVkEcBfD/FzB+7hoDS/TiVCQvp+GxbCz0DQ==',key_name='tempest-keypair-21223112',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='504ed2858e78480e9beef5aa5f5d9f1d',ramdisk_id='',reservation_id='r-tbgkcd6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2082374398',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2082374398-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2082374398',owner_user_name='tempest-TestVolumeBootPattern-2082374398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:27:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe1c5af56ab14da7986d64e38597d394',uuid=01480a73-ec80-48df-8d55-a59669f0e64e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa5b0aad-e74d-4325-937d-82ace4686c34", "address": "fa:16:3e:fc:a6:3e", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa5b0aad-e7", "ovs_interfaceid": "fa5b0aad-e74d-4325-937d-82ace4686c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converting VIF {"id": "fa5b0aad-e74d-4325-937d-82ace4686c34", "address": "fa:16:3e:fc:a6:3e", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa5b0aad-e7", "ovs_interfaceid": "fa5b0aad-e74d-4325-937d-82ace4686c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:a6:3e,bridge_name='br-int',has_traffic_filtering=True,id=fa5b0aad-e74d-4325-937d-82ace4686c34,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa5b0aad-e7') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG os_vif [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:a6:3e,bridge_name='br-int',has_traffic_filtering=True,id=fa5b0aad-e74d-4325-937d-82ace4686c34,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa5b0aad-e7') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f0083ec-0c3d-5328-a00c-d53bc3d9f18a', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa5b0aad-e7, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa5b0aad-e7, col_values=(('qos', UUID('303e994c-bc71-43fe-8049-af7c24351726')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa5b0aad-e7, col_values=(('external_ids', {'iface-id': 'fa5b0aad-e74d-4325-937d-82ace4686c34', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:a6:3e', 'vm-uuid': '01480a73-ec80-48df-8d55-a59669f0e64e'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:39 user nova-compute[75014]: INFO os_vif [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:a6:3e,bridge_name='br-int',has_traffic_filtering=True,id=fa5b0aad-e74d-4325-937d-82ace4686c34,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa5b0aad-e7')
Nov 08 04:27:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:27:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] No VIF found with MAC fa:16:3e:fc:a6:3e, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:27:40 user nova-compute[75014]: DEBUG nova.network.neutron [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Updating instance_info_cache with network_info: [{"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:27:40 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Releasing lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:27:40 user nova-compute[75014]: DEBUG os_brick.utils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:27:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:40 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2caf7c7f-abfc-4d05-a036-d21e99b1e655]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:40 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f821a337-ed4b-426f-a5ec-2bb53b74b02d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:27:40 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd321f70-a441-44d3-9b3b-e20190f660b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:40 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[553455dd-590b-4e2a-9b60-6a8ed9fcd777]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:27:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:27:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:27:40 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:27:40 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:27:40 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b683248-4b57-41ed-aa7b-c461d583d3f8]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:27:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:27:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:27:40 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:27:40 user nova-compute[75014]: DEBUG os_brick.utils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:27:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:41 user nova-compute[75014]: DEBUG nova.compute.manager [req-9da6999b-543d-42e6-bad5-9c53ebbab61b req-86001233-6690-4020-b750-d20591d6da2b service nova] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Received event network-vif-plugged-fa5b0aad-e74d-4325-937d-82ace4686c34 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:27:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-9da6999b-543d-42e6-bad5-9c53ebbab61b req-86001233-6690-4020-b750-d20591d6da2b service nova] Acquiring lock "01480a73-ec80-48df-8d55-a59669f0e64e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:27:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-9da6999b-543d-42e6-bad5-9c53ebbab61b req-86001233-6690-4020-b750-d20591d6da2b service nova] Lock "01480a73-ec80-48df-8d55-a59669f0e64e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:27:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-9da6999b-543d-42e6-bad5-9c53ebbab61b req-86001233-6690-4020-b750-d20591d6da2b service nova] Lock "01480a73-ec80-48df-8d55-a59669f0e64e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:27:41 user nova-compute[75014]: DEBUG nova.compute.manager [req-9da6999b-543d-42e6-bad5-9c53ebbab61b req-86001233-6690-4020-b750-d20591d6da2b service nova] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] No waiting events found dispatching network-vif-plugged-fa5b0aad-e74d-4325-937d-82ace4686c34 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:27:41 user nova-compute[75014]: WARNING nova.compute.manager [req-9da6999b-543d-42e6-bad5-9c53ebbab61b req-86001233-6690-4020-b750-d20591d6da2b service nova] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Received unexpected event network-vif-plugged-fa5b0aad-e74d-4325-937d-82ace4686c34 for instance with vm_state building and task_state spawning.
Nov 08 04:27:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:43 user nova-compute[75014]: DEBUG nova.compute.manager [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:27:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 04:27:43 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Instance spawned successfully.
Nov 08 04:27:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 04:27:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:27:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:27:43 user nova-compute[75014]: INFO nova.compute.manager [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Took 4.96 seconds to spawn the instance on the hypervisor.
Nov 08 04:27:43 user nova-compute[75014]: DEBUG nova.compute.manager [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:27:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-6a36a720-d3e0-4a1b-aa2f-4b917b42724a req-33e4d43e-042c-4064-8f5e-3d3705e50641 service nova] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Received event network-vif-plugged-fa5b0aad-e74d-4325-937d-82ace4686c34 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:27:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-6a36a720-d3e0-4a1b-aa2f-4b917b42724a req-33e4d43e-042c-4064-8f5e-3d3705e50641 service nova] Acquiring lock "01480a73-ec80-48df-8d55-a59669f0e64e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:27:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-6a36a720-d3e0-4a1b-aa2f-4b917b42724a req-33e4d43e-042c-4064-8f5e-3d3705e50641 service nova] Lock "01480a73-ec80-48df-8d55-a59669f0e64e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:27:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-6a36a720-d3e0-4a1b-aa2f-4b917b42724a req-33e4d43e-042c-4064-8f5e-3d3705e50641 service nova] Lock "01480a73-ec80-48df-8d55-a59669f0e64e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:27:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-6a36a720-d3e0-4a1b-aa2f-4b917b42724a req-33e4d43e-042c-4064-8f5e-3d3705e50641 service nova] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] No waiting events found dispatching network-vif-plugged-fa5b0aad-e74d-4325-937d-82ace4686c34 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:27:43 user nova-compute[75014]: WARNING nova.compute.manager [req-6a36a720-d3e0-4a1b-aa2f-4b917b42724a req-33e4d43e-042c-4064-8f5e-3d3705e50641 service nova] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Received unexpected event network-vif-plugged-fa5b0aad-e74d-4325-937d-82ace4686c34 for instance with vm_state active and task_state None.
Nov 08 04:27:43 user nova-compute[75014]: INFO nova.compute.manager [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Took 34.06 seconds to build instance.
Nov 08 04:27:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2ce23730-4361-4dd5-8858-9bd3cfa6fd4d tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "01480a73-ec80-48df-8d55-a59669f0e64e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.304s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:27:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "01480a73-ec80-48df-8d55-a59669f0e64e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 16.220s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:27:43 user nova-compute[75014]: INFO nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 08 04:27:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "01480a73-ec80-48df-8d55-a59669f0e64e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:27:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:27:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:27:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:27:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:27:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:27:51 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:27:52 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:27:52 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:27:52 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Rebuilding the list of instances to heal {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 04:27:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:27:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:27:52 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 04:27:52 user nova-compute[75014]: DEBUG nova.objects.instance [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lazy-loading 'info_cache' on Instance uuid 08acc858-dc89-4ae8-9b48-08e6de5db0d0 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:27:52 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Updating instance_info_cache with network_info: [{"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:27:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:27:52 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 04:27:53 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:27:54 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:27:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:27:55 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:27:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:27:58 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:27:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:28:00 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:28:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:28:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:28:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:28:00 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:28:00 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:28:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:28:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:28:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:28:00 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:28:00 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:28:00 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:28:01 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:28:01 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:28:01 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=8756MB free_disk=24.866008758544922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:28:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:28:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:28:01 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Applying migration context for instance 08acc858-dc89-4ae8-9b48-08e6de5db0d0 as it has an incoming, in-progress migration 2e871e6e-023a-4cca-b557-3b7d370fc76c. Migration status is post-migrating {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 04:28:01 user nova-compute[75014]: INFO nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Updating resource usage from migration 2e871e6e-023a-4cca-b557-3b7d370fc76c
Nov 08 04:28:01 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance be882529-f74b-4743-a7a8-0a64e8f6c2c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:28:01 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 01480a73-ec80-48df-8d55-a59669f0e64e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:28:01 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Migration 2e871e6e-023a-4cca-b557-3b7d370fc76c is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 08 04:28:01 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 08acc858-dc89-4ae8-9b48-08e6de5db0d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:28:01 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:28:01 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=21GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:28:01 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:28:01 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:28:01 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:28:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Starting finish_migration {{(pid=75014) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Instance directory exists: not creating {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 04:28:03 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Creating image(s)
Nov 08 04:28:03 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.170s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Checking if we can resize image /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk. size=21474836480 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk 21474836480 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk 21474836480" returned: 0 in 0.070s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Did not create local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Ensure instance console log exists: /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Start _get_guest_xml network_info=[{"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1674551282-network", "vif_mac": "fa:16:3e:42:95:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfaYAQzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '08acc858-dc89-4ae8-9b48-08e6de5db0d0', 'attached_at': '2023-11-08T04:28:03.000000', 'detached_at': '', 'volume_id': '80f82440-69e0-4522-ac18-f17eeec2d76a', 'serial': '80f82440-69e0-4522-ac18-f17eeec2d76a'}, 'device_type': 'disk', 'attachment_id': 'e01b4fb9-52a8-4b49-88a3-332fa2f654cc', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:28:03 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:28:03 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:28:03 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfaYAQzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:28:03 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:28:03 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:28:03 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:28:03 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:28:03 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:28:04 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b00cc3-5463-4f44-8e48-f42987a9b43e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:28:04 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a8f330-4f5a-41ae-a844-0e297409f5a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a] added
Nov 08 04:28:04 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2288ea7-1b0f-4cbe-9af4-fed076511460]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[09537968-8841-4fb4-b0dd-f4ff9ee1a9fa]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wfaYAQzI {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wfaYAQzI" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc13e69-c572-45d0-a34f-82b51e4c3232]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wfaYAQzI'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[863e1513-4ee8-4b67-a241-bc6bfe04c51a]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c6056d-da92-43e4-905e-980912ba8990]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:28:04 user nova-compute[75014]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)
Nov 08 04:28:04 user nova-compute[75014]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 (non-flash)
Nov 08 04:28:04 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:28:04 user nova-compute[75014]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)
Nov 08 04:28:04 user nova-compute[75014]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 (non-flash)
Nov 08 04:28:04 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d32b3f3-ba92-41aa-81bd-538ed953ed52]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a, portal: 172.16.0.220,3260]
Nov 08 04:28:04 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a, portal: 172.16.0.220,3260] successful.
Nov 08 04:28:04 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[040c6c4a-a89c-4cb8-8e6c-72266103e170]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3186ede-7004-4d58-a000-c45ebf2eff79]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:28:04 user nova-compute[75014]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)
Nov 08 04:28:04 user nova-compute[75014]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 (non-flash)
Nov 08 04:28:04 user nova-compute[75014]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a (non-flash)
Nov 08 04:28:04 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:28:04 user nova-compute[75014]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)
Nov 08 04:28:04 user nova-compute[75014]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 (non-flash)
Nov 08 04:28:04 user nova-compute[75014]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a (non-flash)
Nov 08 04:28:04 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4af3df-b7e5-4e7b-9d93-2520a139ee89]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: None {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:28:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:28:05 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:28:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfaYAQzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:28:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:28:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23539353334353163', 'path': '/dev/sdd'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:28:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539353334353163', 'path': '/dev/sdd'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:28:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-809427286',display_name='tempest-ServerActionsTestOtherB-server-809427286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-809427286',id=46,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdfoac/qWiSELcxtzUkuk+o8acjsOIEGrFVZM627fy7ovi3OfsfBH6nUCuIfY7BK2ldXdAqxdoVU6c1JyFZHm23ngkkF9j7Yy2b+7zJu1QcSK4PuxDPCnQBF7ZI6NxBlg==',key_name='tempest-keypair-1823743126',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:23:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7ec7bf4b5935436792895f9a522431c4',ramdisk_id='',reservation_id='r-o63p9ir8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1064545051',owner_user_name='tempest-ServerActionsTestOtherB-1064545051-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:27:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b0c5324a67d4137b0ac20c505d28251',uuid=08acc858-dc89-4ae8-9b48-08e6de5db0d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1674551282-network", "vif_mac": "fa:16:3e:42:95:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:28:05 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Converting VIF {"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1674551282-network", "vif_mac": "fa:16:3e:42:95:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:28:05 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:95:35,bridge_name='br-int',has_traffic_filtering=True,id=3137db93-bf8f-4d21-a1df-f9b6014d46bf,network=Network(5dbeed84-c2af-4e98-b511-a7500ba483e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3137db93-bf') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:28:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:28:05 user nova-compute[75014]:   <uuid>08acc858-dc89-4ae8-9b48-08e6de5db0d0</uuid>
Nov 08 04:28:05 user nova-compute[75014]:   <name>instance-0000002e</name>
Nov 08 04:28:05 user nova-compute[75014]:   <memory>2097152</memory>
Nov 08 04:28:05 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:28:05 user nova-compute[75014]:   <metadata>
Nov 08 04:28:05 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:28:05 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:28:05 user nova-compute[75014]:       <nova:name>tempest-ServerActionsTestOtherB-server-809427286</nova:name>
Nov 08 04:28:05 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:28:03</nova:creationTime>
Nov 08 04:28:05 user nova-compute[75014]:       <nova:flavor name="m1.small">
Nov 08 04:28:05 user nova-compute[75014]:         <nova:memory>2048</nova:memory>
Nov 08 04:28:05 user nova-compute[75014]:         <nova:disk>20</nova:disk>
Nov 08 04:28:05 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:28:05 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:28:05 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:28:05 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:28:05 user nova-compute[75014]:       <nova:owner>
Nov 08 04:28:05 user nova-compute[75014]:         <nova:user uuid="4b0c5324a67d4137b0ac20c505d28251">tempest-ServerActionsTestOtherB-1064545051-project-member</nova:user>
Nov 08 04:28:05 user nova-compute[75014]:         <nova:project uuid="7ec7bf4b5935436792895f9a522431c4">tempest-ServerActionsTestOtherB-1064545051</nova:project>
Nov 08 04:28:05 user nova-compute[75014]:       </nova:owner>
Nov 08 04:28:05 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:28:05 user nova-compute[75014]:       <nova:ports>
Nov 08 04:28:05 user nova-compute[75014]:         <nova:port uuid="3137db93-bf8f-4d21-a1df-f9b6014d46bf">
Nov 08 04:28:05 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 04:28:05 user nova-compute[75014]:         </nova:port>
Nov 08 04:28:05 user nova-compute[75014]:       </nova:ports>
Nov 08 04:28:05 user nova-compute[75014]:     </nova:instance>
Nov 08 04:28:05 user nova-compute[75014]:   </metadata>
Nov 08 04:28:05 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:28:05 user nova-compute[75014]:     <system>
Nov 08 04:28:05 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:28:05 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:28:05 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:28:05 user nova-compute[75014]:       <entry name="serial">08acc858-dc89-4ae8-9b48-08e6de5db0d0</entry>
Nov 08 04:28:05 user nova-compute[75014]:       <entry name="uuid">08acc858-dc89-4ae8-9b48-08e6de5db0d0</entry>
Nov 08 04:28:05 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:28:05 user nova-compute[75014]:     </system>
Nov 08 04:28:05 user nova-compute[75014]:   </sysinfo>
Nov 08 04:28:05 user nova-compute[75014]:   <os>
Nov 08 04:28:05 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:28:05 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:28:05 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:28:05 user nova-compute[75014]:   </os>
Nov 08 04:28:05 user nova-compute[75014]:   <features>
Nov 08 04:28:05 user nova-compute[75014]:     <acpi/>
Nov 08 04:28:05 user nova-compute[75014]:     <apic/>
Nov 08 04:28:05 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:28:05 user nova-compute[75014]:   </features>
Nov 08 04:28:05 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:28:05 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:28:05 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:28:05 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:28:05 user nova-compute[75014]:   </clock>
Nov 08 04:28:05 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:28:05 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:28:05 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:28:05 user nova-compute[75014]:   </cpu>
Nov 08 04:28:05 user nova-compute[75014]:   <devices>
Nov 08 04:28:05 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 04:28:05 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 04:28:05 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk"/>
Nov 08 04:28:05 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:28:05 user nova-compute[75014]:     </disk>
Nov 08 04:28:05 user nova-compute[75014]:     <disk type="block" device="disk">
Nov 08 04:28:05 user nova-compute[75014]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:28:05 user nova-compute[75014]:       <source dev="/dev/sdd"/>
Nov 08 04:28:05 user nova-compute[75014]:       <target dev="vdb" bus="virtio"/>
Nov 08 04:28:05 user nova-compute[75014]:       <serial>80f82440-69e0-4522-ac18-f17eeec2d76a</serial>
Nov 08 04:28:05 user nova-compute[75014]:     </disk>
Nov 08 04:28:05 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:28:05 user nova-compute[75014]:       <mac address="fa:16:3e:42:95:35"/>
Nov 08 04:28:05 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:28:05 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:28:05 user nova-compute[75014]:       <target dev="tap3137db93-bf"/>
Nov 08 04:28:05 user nova-compute[75014]:     </interface>
Nov 08 04:28:05 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:28:05 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/console.log" append="off"/>
Nov 08 04:28:05 user nova-compute[75014]:     </serial>
Nov 08 04:28:05 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:28:05 user nova-compute[75014]:     <video>
Nov 08 04:28:05 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:28:05 user nova-compute[75014]:     </video>
Nov 08 04:28:05 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:28:05 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:28:05 user nova-compute[75014]:     </rng>
Nov 08 04:28:05 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:28:05 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:28:05 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:28:05 user nova-compute[75014]:     </memballoon>
Nov 08 04:28:05 user nova-compute[75014]:   </devices>
Nov 08 04:28:05 user nova-compute[75014]: </domain>
Nov 08 04:28:05 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:28:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-809427286',display_name='tempest-ServerActionsTestOtherB-server-809427286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-809427286',id=46,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdfoac/qWiSELcxtzUkuk+o8acjsOIEGrFVZM627fy7ovi3OfsfBH6nUCuIfY7BK2ldXdAqxdoVU6c1JyFZHm23ngkkF9j7Yy2b+7zJu1QcSK4PuxDPCnQBF7ZI6NxBlg==',key_name='tempest-keypair-1823743126',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:23:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7ec7bf4b5935436792895f9a522431c4',ramdisk_id='',reservation_id='r-o63p9ir8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1064545051',owner_user_name='tempest-ServerActionsTestOtherB-1064545051-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:27:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b0c5324a67d4137b0ac20c505d28251',uuid=08acc858-dc89-4ae8-9b48-08e6de5db0d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1674551282-network", "vif_mac": "fa:16:3e:42:95:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:28:05 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Converting VIF {"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1674551282-network", "vif_mac": "fa:16:3e:42:95:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:28:05 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:95:35,bridge_name='br-int',has_traffic_filtering=True,id=3137db93-bf8f-4d21-a1df-f9b6014d46bf,network=Network(5dbeed84-c2af-4e98-b511-a7500ba483e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3137db93-bf') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:28:05 user nova-compute[75014]: DEBUG os_vif [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:95:35,bridge_name='br-int',has_traffic_filtering=True,id=3137db93-bf8f-4d21-a1df-f9b6014d46bf,network=Network(5dbeed84-c2af-4e98-b511-a7500ba483e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3137db93-bf') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:28:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:28:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:28:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:28:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:28:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '156a7091-2ddc-5b39-a598-9e4511a43914', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:28:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:28:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:28:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:28:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3137db93-bf, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:28:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3137db93-bf, col_values=(('qos', UUID('51f7c420-302a-4e54-8a77-5c6f9483b131')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:28:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3137db93-bf, col_values=(('external_ids', {'iface-id': '3137db93-bf8f-4d21-a1df-f9b6014d46bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:95:35', 'vm-uuid': '08acc858-dc89-4ae8-9b48-08e6de5db0d0'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:28:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:28:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:28:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:28:05 user nova-compute[75014]: INFO os_vif [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:95:35,bridge_name='br-int',has_traffic_filtering=True,id=3137db93-bf8f-4d21-a1df-f9b6014d46bf,network=Network(5dbeed84-c2af-4e98-b511-a7500ba483e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3137db93-bf')
Nov 08 04:28:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:28:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:28:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] No VIF found with MAC fa:16:3e:42:95:35, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:28:05 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:28:05 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:28:05 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:28:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:28:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:28:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:28:07 user nova-compute[75014]: DEBUG nova.compute.manager [req-4b7fac05-e415-4f82-a31c-661d718dda66 req-9c5ced5a-80f0-4e01-8c7c-6c45c5b2c5ff service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received event network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:28:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4b7fac05-e415-4f82-a31c-661d718dda66 req-9c5ced5a-80f0-4e01-8c7c-6c45c5b2c5ff service nova] Acquiring lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:28:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4b7fac05-e415-4f82-a31c-661d718dda66 req-9c5ced5a-80f0-4e01-8c7c-6c45c5b2c5ff service nova] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:28:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4b7fac05-e415-4f82-a31c-661d718dda66 req-9c5ced5a-80f0-4e01-8c7c-6c45c5b2c5ff service nova] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:28:07 user nova-compute[75014]: DEBUG nova.compute.manager [req-4b7fac05-e415-4f82-a31c-661d718dda66 req-9c5ced5a-80f0-4e01-8c7c-6c45c5b2c5ff service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] No waiting events found dispatching network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:28:07 user nova-compute[75014]: WARNING nova.compute.manager [req-4b7fac05-e415-4f82-a31c-661d718dda66 req-9c5ced5a-80f0-4e01-8c7c-6c45c5b2c5ff service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received unexpected event network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf for instance with vm_state active and task_state resize_finish.
Nov 08 04:28:07 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:28:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:28:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:28:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:28:09 user nova-compute[75014]: DEBUG nova.compute.manager [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:28:09 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Instance running successfully.
Nov 08 04:28:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Failed to set time: agent not configured {{(pid=75014) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 08 04:28:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-d3f9384f-0314-4bb1-a5b6-e88d19b2db25 tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] finish_migration finished successfully. {{(pid=75014) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 08 04:28:09 user nova-compute[75014]: DEBUG nova.compute.manager [req-3b99a392-96f5-4d65-bcb3-5e832c15c7b7 req-5123e48c-4d80-4f37-86f1-19dc591db2dd service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received event network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:28:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3b99a392-96f5-4d65-bcb3-5e832c15c7b7 req-5123e48c-4d80-4f37-86f1-19dc591db2dd service nova] Acquiring lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:28:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3b99a392-96f5-4d65-bcb3-5e832c15c7b7 req-5123e48c-4d80-4f37-86f1-19dc591db2dd service nova] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:28:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-3b99a392-96f5-4d65-bcb3-5e832c15c7b7 req-5123e48c-4d80-4f37-86f1-19dc591db2dd service nova] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:28:09 user nova-compute[75014]: DEBUG nova.compute.manager [req-3b99a392-96f5-4d65-bcb3-5e832c15c7b7 req-5123e48c-4d80-4f37-86f1-19dc591db2dd service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] No waiting events found dispatching network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:28:09 user nova-compute[75014]: WARNING nova.compute.manager [req-3b99a392-96f5-4d65-bcb3-5e832c15c7b7 req-5123e48c-4d80-4f37-86f1-19dc591db2dd service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received unexpected event network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf for instance with vm_state resized and task_state None.
Nov 08 04:28:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:28:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:28:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:28:20 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:28:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:28:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:28:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:28:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:28:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:28:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:28:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:28:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:28:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:28:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:28:51 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:28:53 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:28:53 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:28:53 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:28:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-be882529-f74b-4743-a7a8-0a64e8f6c2c0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:28:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-be882529-f74b-4743-a7a8-0a64e8f6c2c0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:28:53 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 04:28:54 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Updating instance_info_cache with network_info: [{"id": "31de527f-d08b-4b86-8c23-c96c4ebe51f9", "address": "fa:16:3e:36:70:4d", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31de527f-d0", "ovs_interfaceid": "31de527f-d08b-4b86-8c23-c96c4ebe51f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:28:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-be882529-f74b-4743-a7a8-0a64e8f6c2c0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:28:54 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 04:28:55 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:28:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:28:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:28:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:28:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:28:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:28:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:28:56 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:28:59 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:29:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:29:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:29:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:29:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:29:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:00 user nova-compute[75014]: DEBUG nova.compute.manager [req-1c037b47-d1fa-4a1e-a9fe-6d64dd458e7a req-8680b0f2-eda1-4d5a-ad65-6446e547d4b8 service nova] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Received event network-changed-fa5b0aad-e74d-4325-937d-82ace4686c34 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:29:00 user nova-compute[75014]: DEBUG nova.compute.manager [req-1c037b47-d1fa-4a1e-a9fe-6d64dd458e7a req-8680b0f2-eda1-4d5a-ad65-6446e547d4b8 service nova] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Refreshing instance network info cache due to event network-changed-fa5b0aad-e74d-4325-937d-82ace4686c34. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:29:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1c037b47-d1fa-4a1e-a9fe-6d64dd458e7a req-8680b0f2-eda1-4d5a-ad65-6446e547d4b8 service nova] Acquiring lock "refresh_cache-01480a73-ec80-48df-8d55-a59669f0e64e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:29:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1c037b47-d1fa-4a1e-a9fe-6d64dd458e7a req-8680b0f2-eda1-4d5a-ad65-6446e547d4b8 service nova] Acquired lock "refresh_cache-01480a73-ec80-48df-8d55-a59669f0e64e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:29:00 user nova-compute[75014]: DEBUG nova.network.neutron [req-1c037b47-d1fa-4a1e-a9fe-6d64dd458e7a req-8680b0f2-eda1-4d5a-ad65-6446e547d4b8 service nova] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Refreshing network info cache for port fa5b0aad-e74d-4325-937d-82ace4686c34 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:29:00 user nova-compute[75014]: DEBUG nova.network.neutron [req-1c037b47-d1fa-4a1e-a9fe-6d64dd458e7a req-8680b0f2-eda1-4d5a-ad65-6446e547d4b8 service nova] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Updated VIF entry in instance network info cache for port fa5b0aad-e74d-4325-937d-82ace4686c34. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:29:00 user nova-compute[75014]: DEBUG nova.network.neutron [req-1c037b47-d1fa-4a1e-a9fe-6d64dd458e7a req-8680b0f2-eda1-4d5a-ad65-6446e547d4b8 service nova] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Updating instance_info_cache with network_info: [{"id": "fa5b0aad-e74d-4325-937d-82ace4686c34", "address": "fa:16:3e:fc:a6:3e", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa5b0aad-e7", "ovs_interfaceid": "fa5b0aad-e74d-4325-937d-82ace4686c34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:29:00 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1c037b47-d1fa-4a1e-a9fe-6d64dd458e7a req-8680b0f2-eda1-4d5a-ad65-6446e547d4b8 service nova] Releasing lock "refresh_cache-01480a73-ec80-48df-8d55-a59669f0e64e" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "01480a73-ec80-48df-8d55-a59669f0e64e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "01480a73-ec80-48df-8d55-a59669f0e64e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "01480a73-ec80-48df-8d55-a59669f0e64e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "01480a73-ec80-48df-8d55-a59669f0e64e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "01480a73-ec80-48df-8d55-a59669f0e64e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:29:01 user nova-compute[75014]: INFO nova.compute.manager [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Terminating instance
Nov 08 04:29:01 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG nova.compute.manager [req-247810c2-6216-41e0-8d1a-45222b021e53 req-7ac073b9-22cd-402b-bfac-63f501330068 service nova] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Received event network-vif-unplugged-fa5b0aad-e74d-4325-937d-82ace4686c34 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-247810c2-6216-41e0-8d1a-45222b021e53 req-7ac073b9-22cd-402b-bfac-63f501330068 service nova] Acquiring lock "01480a73-ec80-48df-8d55-a59669f0e64e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-247810c2-6216-41e0-8d1a-45222b021e53 req-7ac073b9-22cd-402b-bfac-63f501330068 service nova] Lock "01480a73-ec80-48df-8d55-a59669f0e64e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-247810c2-6216-41e0-8d1a-45222b021e53 req-7ac073b9-22cd-402b-bfac-63f501330068 service nova] Lock "01480a73-ec80-48df-8d55-a59669f0e64e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG nova.compute.manager [req-247810c2-6216-41e0-8d1a-45222b021e53 req-7ac073b9-22cd-402b-bfac-63f501330068 service nova] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] No waiting events found dispatching network-vif-unplugged-fa5b0aad-e74d-4325-937d-82ace4686c34 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG nova.compute.manager [req-247810c2-6216-41e0-8d1a-45222b021e53 req-7ac073b9-22cd-402b-bfac-63f501330068 service nova] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Received event network-vif-unplugged-fa5b0aad-e74d-4325-937d-82ace4686c34 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:01 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Instance destroyed successfully.
Nov 08 04:29:01 user nova-compute[75014]: DEBUG nova.objects.instance [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lazy-loading 'resources' on Instance uuid 01480a73-ec80-48df-8d55-a59669f0e64e {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:27:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-12032405',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-12032405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-12032405',id=48,image_ref='b3aa7cdd-3dcc-4b47-b6dc-2a1ca501021f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1NFa2vvJ9OmSjmI5qq36vRl26rd19PxhRPLIzaIZTe57Qwba+f7N7mDM03GYwMhbBFK3zVZpmYaAOxRLvzlR/ie7AxtmPBVkEcBfD/FzB+7hoDS/TiVCQvp+GxbCz0DQ==',key_name='tempest-keypair-21223112',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:27:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='504ed2858e78480e9beef5aa5f5d9f1d',ramdisk_id='',reservation_id='r-tbgkcd6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2082374398',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2082374398-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-2082374398',owner_user_name='tempest-TestVolumeBootPattern-2082374398-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:27:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe1c5af56ab14da7986d64e38597d394',uuid=01480a73-ec80-48df-8d55-a59669f0e64e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa5b0aad-e74d-4325-937d-82ace4686c34", "address": "fa:16:3e:fc:a6:3e", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa5b0aad-e7", "ovs_interfaceid": "fa5b0aad-e74d-4325-937d-82ace4686c34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converting VIF {"id": "fa5b0aad-e74d-4325-937d-82ace4686c34", "address": "fa:16:3e:fc:a6:3e", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa5b0aad-e7", "ovs_interfaceid": "fa5b0aad-e74d-4325-937d-82ace4686c34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:a6:3e,bridge_name='br-int',has_traffic_filtering=True,id=fa5b0aad-e74d-4325-937d-82ace4686c34,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa5b0aad-e7') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG os_vif [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:a6:3e,bridge_name='br-int',has_traffic_filtering=True,id=fa5b0aad-e74d-4325-937d-82ace4686c34,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa5b0aad-e7') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa5b0aad-e7, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=303e994c-bc71-43fe-8049-af7c24351726) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:01 user nova-compute[75014]: INFO os_vif [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:a6:3e,bridge_name='br-int',has_traffic_filtering=True,id=fa5b0aad-e74d-4325-937d-82ace4686c34,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa5b0aad-e7')
Nov 08 04:29:01 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WrIPlEpf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:29:01 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:29:01 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8259fd-b2a3-4411-a3ed-9b57b132e13f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:29:01 user nova-compute[75014]: No targets found.
Nov 08 04:29:01 user nova-compute[75014]: iSNS:
Nov 08 04:29:01 user nova-compute[75014]: No targets found.
Nov 08 04:29:01 user nova-compute[75014]: STATIC:
Nov 08 04:29:01 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:29:01 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:29:01 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:29:01 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a
Nov 08 04:29:01 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:29:01 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:29:01 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252
Nov 08 04:29:01 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:29:01 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:29:01 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301
Nov 08 04:29:01 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:29:01 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:29:01 user nova-compute[75014]: FIRMWARE:
Nov 08 04:29:01 user nova-compute[75014]: No targets found.
Nov 08 04:29:01 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:29:01 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:29:01 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:29:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[910d52d4-dc68-4dd4-8259-b1e33b857ed6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7d7756-cb14-428a-bfa2-01f8812ff94a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:29:02 user nova-compute[75014]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)
Nov 08 04:29:02 user nova-compute[75014]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 (non-flash)
Nov 08 04:29:02 user nova-compute[75014]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a (non-flash)
Nov 08 04:29:02 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:29:02 user nova-compute[75014]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)
Nov 08 04:29:02 user nova-compute[75014]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 (non-flash)
Nov 08 04:29:02 user nova-compute[75014]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a (non-flash)
Nov 08 04:29:02 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0400784e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252'): ({'sdc'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Removing single pathed devices sdc {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a7f7ee-a50c-45ec-ac45-17e2c6879db2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[70724356-d21c-4888-b22f-0e093c65083e]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Flushing IO for device /dev/sdc {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0434a0-d873-43f9-80ac-e1e571a955cc]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7555c4-5eee-4d43-9511-9a5190b05a25]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] SCSI volumes sdc have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e27fbb5-2fb5-466e-a044-f69e5fe05440]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2f819b-8ec4-4b3b-9062-cbbdef20ba45]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252, portal: 172.16.0.220,3260]
Nov 08 04:29:02 user nova-compute[75014]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252, portal: 172.16.0.220,3260] successful.
Nov 08 04:29:02 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:337ed1bb-add0-4156-9b3b-56fd86328252 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1096c4-8f5f-499d-88ce-3d01bdb32ab6]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] <== disconnect_volume: return (346ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:29:02 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Deleting instance files /opt/stack/data/nova/instances/01480a73-ec80-48df-8d55-a59669f0e64e_del
Nov 08 04:29:02 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Deletion of /opt/stack/data/nova/instances/01480a73-ec80-48df-8d55-a59669f0e64e_del complete
Nov 08 04:29:02 user nova-compute[75014]: INFO nova.compute.manager [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:29:02 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Error from libvirt while getting description of instance-00000030: [Error Code 42] Domain not found: no domain with matching uuid '01480a73-ec80-48df-8d55-a59669f0e64e' (instance-00000030): libvirt.libvirtError: Domain not found: no domain with matching uuid '01480a73-ec80-48df-8d55-a59669f0e64e' (instance-00000030)
Nov 08 04:29:02 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:29:02 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:29:02 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=8770MB free_disk=24.85558319091797GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Applying migration context for instance 08acc858-dc89-4ae8-9b48-08e6de5db0d0 as it has an incoming, in-progress migration 2e871e6e-023a-4cca-b557-3b7d370fc76c. Migration status is finished {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 04:29:02 user nova-compute[75014]: INFO nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Updating resource usage from migration 2e871e6e-023a-4cca-b557-3b7d370fc76c
Nov 08 04:29:02 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance be882529-f74b-4743-a7a8-0a64e8f6c2c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 01480a73-ec80-48df-8d55-a59669f0e64e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Migration 2e871e6e-023a-4cca-b557-3b7d370fc76c is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 08acc858-dc89-4ae8-9b48-08e6de5db0d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:29:02 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=21GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:29:03 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:29:03 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:29:03 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:29:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.381s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:29:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:03 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:29:03 user nova-compute[75014]: DEBUG nova.compute.manager [req-476b743b-a8cf-45a0-b62b-54bd06728398 req-554065cd-b888-413c-aed2-ab4665e871d4 service nova] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Received event network-vif-plugged-fa5b0aad-e74d-4325-937d-82ace4686c34 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:29:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-476b743b-a8cf-45a0-b62b-54bd06728398 req-554065cd-b888-413c-aed2-ab4665e871d4 service nova] Acquiring lock "01480a73-ec80-48df-8d55-a59669f0e64e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:29:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-476b743b-a8cf-45a0-b62b-54bd06728398 req-554065cd-b888-413c-aed2-ab4665e871d4 service nova] Lock "01480a73-ec80-48df-8d55-a59669f0e64e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:29:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-476b743b-a8cf-45a0-b62b-54bd06728398 req-554065cd-b888-413c-aed2-ab4665e871d4 service nova] Lock "01480a73-ec80-48df-8d55-a59669f0e64e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:29:03 user nova-compute[75014]: DEBUG nova.compute.manager [req-476b743b-a8cf-45a0-b62b-54bd06728398 req-554065cd-b888-413c-aed2-ab4665e871d4 service nova] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] No waiting events found dispatching network-vif-plugged-fa5b0aad-e74d-4325-937d-82ace4686c34 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:29:03 user nova-compute[75014]: WARNING nova.compute.manager [req-476b743b-a8cf-45a0-b62b-54bd06728398 req-554065cd-b888-413c-aed2-ab4665e871d4 service nova] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Received unexpected event network-vif-plugged-fa5b0aad-e74d-4325-937d-82ace4686c34 for instance with vm_state active and task_state deleting.
Nov 08 04:29:03 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Took 1.04 seconds to deallocate network for instance.
Nov 08 04:29:03 user nova-compute[75014]: DEBUG nova.compute.manager [req-50df6d0e-7419-426f-983a-e697a4a6db3d req-2014747a-d9f6-4ebe-9e50-9a103374e3ad service nova] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Received event network-vif-deleted-fa5b0aad-e74d-4325-937d-82ace4686c34 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:29:03 user nova-compute[75014]: INFO nova.compute.manager [req-50df6d0e-7419-426f-983a-e697a4a6db3d req-2014747a-d9f6-4ebe-9e50-9a103374e3ad service nova] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Neutron deleted interface fa5b0aad-e74d-4325-937d-82ace4686c34; detaching it from the instance and deleting it from the info cache
Nov 08 04:29:03 user nova-compute[75014]: DEBUG nova.network.neutron [req-50df6d0e-7419-426f-983a-e697a4a6db3d req-2014747a-d9f6-4ebe-9e50-9a103374e3ad service nova] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:29:03 user nova-compute[75014]: DEBUG nova.compute.manager [req-50df6d0e-7419-426f-983a-e697a4a6db3d req-2014747a-d9f6-4ebe-9e50-9a103374e3ad service nova] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Detach interface failed, port_id=fa5b0aad-e74d-4325-937d-82ace4686c34, reason: Instance 01480a73-ec80-48df-8d55-a59669f0e64e could not be found. {{(pid=75014) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 04:29:04 user nova-compute[75014]: INFO nova.compute.manager [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Took 0.89 seconds to detach 1 volumes for instance.
Nov 08 04:29:04 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01480a73-ec80-48df-8d55-a59669f0e64e] Deleting volume: 337ed1bb-add0-4156-9b3b-56fd86328252 {{(pid=75014) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 04:29:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:29:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:29:04 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:29:04 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:29:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:29:04 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Deleted allocations for instance 01480a73-ec80-48df-8d55-a59669f0e64e
Nov 08 04:29:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4a01c2f5-2e06-42cd-9f75-688b10d85c62 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "01480a73-ec80-48df-8d55-a59669f0e64e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.695s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:29:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:07 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:29:07 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:29:07 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:29:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:29:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:29:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:29:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:29:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:21 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:25 user nova-compute[75014]: DEBUG nova.network.neutron [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Port 3137db93-bf8f-4d21-a1df-f9b6014d46bf binding to destination host user is already ACTIVE {{(pid=75014) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 08 04:29:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquiring lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:29:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquired lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:29:25 user nova-compute[75014]: DEBUG nova.network.neutron [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:29:25 user nova-compute[75014]: DEBUG nova.network.neutron [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Updating instance_info_cache with network_info: [{"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:29:25 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Releasing lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:29:25 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Creating tmpfile /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/tmptbayev91 to verify with other compute node that the instance is on the same shared storage. {{(pid=75014) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 08 04:29:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG nova.compute.manager [req-d77028fc-cfb7-440b-8669-05c8d62123ef req-93eed044-4ee7-4493-b4db-e6cee2882dc6 service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received event network-vif-unplugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d77028fc-cfb7-440b-8669-05c8d62123ef req-93eed044-4ee7-4493-b4db-e6cee2882dc6 service nova] Acquiring lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d77028fc-cfb7-440b-8669-05c8d62123ef req-93eed044-4ee7-4493-b4db-e6cee2882dc6 service nova] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-d77028fc-cfb7-440b-8669-05c8d62123ef req-93eed044-4ee7-4493-b4db-e6cee2882dc6 service nova] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG nova.compute.manager [req-d77028fc-cfb7-440b-8669-05c8d62123ef req-93eed044-4ee7-4493-b4db-e6cee2882dc6 service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] No waiting events found dispatching network-vif-unplugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:29:26 user nova-compute[75014]: WARNING nova.compute.manager [req-d77028fc-cfb7-440b-8669-05c8d62123ef req-93eed044-4ee7-4493-b4db-e6cee2882dc6 service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received unexpected event network-vif-unplugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf for instance with vm_state resized and task_state resize_reverting.
Nov 08 04:29:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:26 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Instance destroyed successfully.
Nov 08 04:29:26 user nova-compute[75014]: DEBUG nova.objects.instance [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lazy-loading 'resources' on Instance uuid 08acc858-dc89-4ae8-9b48-08e6de5db0d0 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-809427286',display_name='tempest-ServerActionsTestOtherB-server-809427286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-809427286',id=46,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdfoac/qWiSELcxtzUkuk+o8acjsOIEGrFVZM627fy7ovi3OfsfBH6nUCuIfY7BK2ldXdAqxdoVU6c1JyFZHm23ngkkF9j7Yy2b+7zJu1QcSK4PuxDPCnQBF7ZI6NxBlg==',key_name='tempest-keypair-1823743126',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:28:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ec7bf4b5935436792895f9a522431c4',ramdisk_id='',reservation_id='r-o63p9ir8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1064545051',owner_user_name='tempest-ServerActionsTestOtherB-1064545051-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:28:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b0c5324a67d4137b0ac20c505d28251',uuid=08acc858-dc89-4ae8-9b48-08e6de5db0d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Converting VIF {"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:95:35,bridge_name='br-int',has_traffic_filtering=True,id=3137db93-bf8f-4d21-a1df-f9b6014d46bf,network=Network(5dbeed84-c2af-4e98-b511-a7500ba483e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3137db93-bf') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG os_vif [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:95:35,bridge_name='br-int',has_traffic_filtering=True,id=3137db93-bf8f-4d21-a1df-f9b6014d46bf,network=Network(5dbeed84-c2af-4e98-b511-a7500ba483e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3137db93-bf') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3137db93-bf, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=51f7c420-302a-4e54-8a77-5c6f9483b131) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:29:26 user nova-compute[75014]: INFO os_vif [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:95:35,bridge_name='br-int',has_traffic_filtering=True,id=3137db93-bf8f-4d21-a1df-f9b6014d46bf,network=Network(5dbeed84-c2af-4e98-b511-a7500ba483e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3137db93-bf')
Nov 08 04:29:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfaYAQzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:29:26 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:29:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cedc4f-42eb-4800-a21d-03cec2114c6c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:29:26 user nova-compute[75014]: No targets found.
Nov 08 04:29:26 user nova-compute[75014]: iSNS:
Nov 08 04:29:26 user nova-compute[75014]: No targets found.
Nov 08 04:29:26 user nova-compute[75014]: STATIC:
Nov 08 04:29:26 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:29:26 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:29:26 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:29:26 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a
Nov 08 04:29:26 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:29:26 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:29:26 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301
Nov 08 04:29:26 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:29:26 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:29:26 user nova-compute[75014]: FIRMWARE:
Nov 08 04:29:26 user nova-compute[75014]: No targets found.
Nov 08 04:29:26 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:29:26 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:29:26 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62c4ddf-1701-4a08-8044-018f256c621b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82f78b4-1e9e-4a0e-9daf-e8fe45bc3463]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:29:26 user nova-compute[75014]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)
Nov 08 04:29:26 user nova-compute[75014]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a (non-flash)
Nov 08 04:29:26 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:29:26 user nova-compute[75014]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)
Nov 08 04:29:26 user nova-compute[75014]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a (non-flash)
Nov 08 04:29:26 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f042026dc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a'): ({'sdd'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Removing single pathed devices sdd {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[da960811-b540-4814-b572-a44bc05dffa6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[986bf501-0642-421f-826b-7bfa089e42bb]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Flushing IO for device /dev/sdd {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[28da26ac-7f12-4874-b2f4-cbca60a76454]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24edf3a-b0ee-4ca6-b5f3-be256256e996]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] SCSI volumes sdd have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c6b316-01c5-4e66-92d9-0585ce2bd45a]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e9aeba-50b0-487a-bd3f-0c8905f92c34]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a, portal: 172.16.0.220,3260]
Nov 08 04:29:26 user nova-compute[75014]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a, portal: 172.16.0.220,3260] successful.
Nov 08 04:29:26 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[91dd9db7-3880-4bb3-b188-b89c6994a225]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] <== disconnect_volume: return (285ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:29:26 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:29:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:29:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:29:28 user nova-compute[75014]: DEBUG nova.objects.instance [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lazy-loading 'migration_context' on Instance uuid 08acc858-dc89-4ae8-9b48-08e6de5db0d0 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:29:28 user nova-compute[75014]: DEBUG nova.objects.base [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Object Instance<08acc858-dc89-4ae8-9b48-08e6de5db0d0> lazy-loaded attributes: resources,migration_context {{(pid=75014) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 04:29:28 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:29:28 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:29:28 user nova-compute[75014]: DEBUG nova.compute.manager [req-32cb03bd-39ca-430b-bbc7-023c9831c3ea req-0f34fbe8-de5e-402e-ad3e-b754357dedb2 service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received event network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:29:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-32cb03bd-39ca-430b-bbc7-023c9831c3ea req-0f34fbe8-de5e-402e-ad3e-b754357dedb2 service nova] Acquiring lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:29:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-32cb03bd-39ca-430b-bbc7-023c9831c3ea req-0f34fbe8-de5e-402e-ad3e-b754357dedb2 service nova] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:29:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-32cb03bd-39ca-430b-bbc7-023c9831c3ea req-0f34fbe8-de5e-402e-ad3e-b754357dedb2 service nova] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:29:28 user nova-compute[75014]: DEBUG nova.compute.manager [req-32cb03bd-39ca-430b-bbc7-023c9831c3ea req-0f34fbe8-de5e-402e-ad3e-b754357dedb2 service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] No waiting events found dispatching network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:29:28 user nova-compute[75014]: WARNING nova.compute.manager [req-32cb03bd-39ca-430b-bbc7-023c9831c3ea req-0f34fbe8-de5e-402e-ad3e-b754357dedb2 service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received unexpected event network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf for instance with vm_state resized and task_state resize_reverting.
Nov 08 04:29:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.232s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:29:28 user nova-compute[75014]: INFO nova.compute.manager [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Swapping old allocation on dict_keys(['46f4e8be-6fb4-40ac-b067-370499bbfbf0']) held by migration 2e871e6e-023a-4cca-b557-3b7d370fc76c for instance
Nov 08 04:29:28 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Overwriting current allocation {'allocations': {'46f4e8be-6fb4-40ac-b067-370499bbfbf0': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 58}}, 'project_id': '7ec7bf4b5935436792895f9a522431c4', 'user_id': '4b0c5324a67d4137b0ac20c505d28251', 'consumer_generation': 1} on consumer 08acc858-dc89-4ae8-9b48-08e6de5db0d0 {{(pid=75014) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 08 04:29:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquiring lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:29:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquired lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:29:28 user nova-compute[75014]: DEBUG nova.network.neutron [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:29:28 user nova-compute[75014]: DEBUG nova.network.neutron [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Updating instance_info_cache with network_info: [{"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:29:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Releasing lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:29:28 user nova-compute[75014]: DEBUG os_brick.utils [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:29:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:29 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0426ac22-408b-40a5-939b-8f88ce7c6c6e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:29 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f3ff14-e873-43a7-994c-5e6bbeedd9fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:29 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[47423c98-dc51-40ab-b82c-7d676bafca9a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:29 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6b2220-efa4-4c98-bf60-9eb1d9dc43f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:29:29 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:29:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:29 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:29:29 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:29:29 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7e4fd2-12fc-48e4-ab80-74a43a573730]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:29 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:29:29 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:29:29 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:29:29 user nova-compute[75014]: DEBUG os_brick.utils [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:29:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:29:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:29:46 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:29:46 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:46 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:29:46 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:29:46 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:29:46 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Starting finish_revert_migration {{(pid=75014) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Start _get_guest_xml network_info=[{"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfaYAQzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '08acc858-dc89-4ae8-9b48-08e6de5db0d0', 'attached_at': '2023-11-08T04:29:51.000000', 'detached_at': '', 'volume_id': '80f82440-69e0-4522-ac18-f17eeec2d76a', 'serial': '80f82440-69e0-4522-ac18-f17eeec2d76a'}, 'device_type': 'disk', 'attachment_id': '950fe72b-ff4e-4c0d-90c5-d28bb9c02b26', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:29:51 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:29:51 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:29:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG nova.objects.instance [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lazy-loading 'vcpu_model' on Instance uuid 08acc858-dc89-4ae8-9b48-08e6de5db0d0 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfaYAQzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:29:51 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:29:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:29:51 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:29:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:29:51 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dee3d8-3be6-4755-aaeb-c2148e45a071]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:29:51 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5501b3d5-3e27-4691-adc6-a8f7b98c5ae1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a] added
Nov 08 04:29:51 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[063b8290-0df2-4661-a97b-94d08417b18c]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d51545-3dcb-4214-bc2c-0a3efbe4e2bb]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wfaYAQzI {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wfaYAQzI" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a07d0cf-54dc-45b7-9bd7-152cc5cacab4]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wfaYAQzI'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[071f916c-71bc-4f68-a7be-48bcf1bc8687]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2eaa6e-b84e-4501-ae4b-e0cf488956a9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:29:51 user nova-compute[75014]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)
Nov 08 04:29:51 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:29:51 user nova-compute[75014]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)
Nov 08 04:29:51 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6184758-a589-4ea6-9fdf-39282496416e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a, portal: 172.16.0.220,3260]
Nov 08 04:29:51 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a, portal: 172.16.0.220,3260] successful.
Nov 08 04:29:51 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[811be340-0228-4b1d-b64c-c64a3e44132f]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2ccdb0-23be-4e9e-9437-38c8a23c0dad]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:29:51 user nova-compute[75014]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)
Nov 08 04:29:51 user nova-compute[75014]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a (non-flash)
Nov 08 04:29:51 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:29:51 user nova-compute[75014]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)
Nov 08 04:29:51 user nova-compute[75014]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a (non-flash)
Nov 08 04:29:51 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[642b47fe-ae07-4f1f-97ef-0b9d91068950]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:29:51 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfaYAQzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:29:52 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:29:52 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23539353334353163', 'path': '/dev/sdc'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:29:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539353334353163', 'path': '/dev/sdc'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:29:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-809427286',display_name='tempest-ServerActionsTestOtherB-server-809427286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-809427286',id=46,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdfoac/qWiSELcxtzUkuk+o8acjsOIEGrFVZM627fy7ovi3OfsfBH6nUCuIfY7BK2ldXdAqxdoVU6c1JyFZHm23ngkkF9j7Yy2b+7zJu1QcSK4PuxDPCnQBF7ZI6NxBlg==',key_name='tempest-keypair-1823743126',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:28:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7ec7bf4b5935436792895f9a522431c4',ramdisk_id='',reservation_id='r-o63p9ir8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1064545051',owner_user_name='tempest-ServerActionsTestOtherB-1064545051-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:29:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b0c5324a67d4137b0ac20c505d28251',uuid=08acc858-dc89-4ae8-9b48-08e6de5db0d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:29:52 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Converting VIF {"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:29:52 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:95:35,bridge_name='br-int',has_traffic_filtering=True,id=3137db93-bf8f-4d21-a1df-f9b6014d46bf,network=Network(5dbeed84-c2af-4e98-b511-a7500ba483e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3137db93-bf') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:29:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:29:52 user nova-compute[75014]:   <uuid>08acc858-dc89-4ae8-9b48-08e6de5db0d0</uuid>
Nov 08 04:29:52 user nova-compute[75014]:   <name>instance-0000002e</name>
Nov 08 04:29:52 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:29:52 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:29:52 user nova-compute[75014]:   <metadata>
Nov 08 04:29:52 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:29:52 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:29:52 user nova-compute[75014]:       <nova:name>tempest-ServerActionsTestOtherB-server-809427286</nova:name>
Nov 08 04:29:52 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:29:51</nova:creationTime>
Nov 08 04:29:52 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:29:52 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:29:52 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:29:52 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:29:52 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:29:52 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:29:52 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:29:52 user nova-compute[75014]:       <nova:owner>
Nov 08 04:29:52 user nova-compute[75014]:         <nova:user uuid="4b0c5324a67d4137b0ac20c505d28251">tempest-ServerActionsTestOtherB-1064545051-project-member</nova:user>
Nov 08 04:29:52 user nova-compute[75014]:         <nova:project uuid="7ec7bf4b5935436792895f9a522431c4">tempest-ServerActionsTestOtherB-1064545051</nova:project>
Nov 08 04:29:52 user nova-compute[75014]:       </nova:owner>
Nov 08 04:29:52 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:29:52 user nova-compute[75014]:       <nova:ports>
Nov 08 04:29:52 user nova-compute[75014]:         <nova:port uuid="3137db93-bf8f-4d21-a1df-f9b6014d46bf">
Nov 08 04:29:52 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 04:29:52 user nova-compute[75014]:         </nova:port>
Nov 08 04:29:52 user nova-compute[75014]:       </nova:ports>
Nov 08 04:29:52 user nova-compute[75014]:     </nova:instance>
Nov 08 04:29:52 user nova-compute[75014]:   </metadata>
Nov 08 04:29:52 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:29:52 user nova-compute[75014]:     <system>
Nov 08 04:29:52 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:29:52 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:29:52 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:29:52 user nova-compute[75014]:       <entry name="serial">08acc858-dc89-4ae8-9b48-08e6de5db0d0</entry>
Nov 08 04:29:52 user nova-compute[75014]:       <entry name="uuid">08acc858-dc89-4ae8-9b48-08e6de5db0d0</entry>
Nov 08 04:29:52 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:29:52 user nova-compute[75014]:     </system>
Nov 08 04:29:52 user nova-compute[75014]:   </sysinfo>
Nov 08 04:29:52 user nova-compute[75014]:   <os>
Nov 08 04:29:52 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:29:52 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:29:52 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:29:52 user nova-compute[75014]:   </os>
Nov 08 04:29:52 user nova-compute[75014]:   <features>
Nov 08 04:29:52 user nova-compute[75014]:     <acpi/>
Nov 08 04:29:52 user nova-compute[75014]:     <apic/>
Nov 08 04:29:52 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:29:52 user nova-compute[75014]:   </features>
Nov 08 04:29:52 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:29:52 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:29:52 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:29:52 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:29:52 user nova-compute[75014]:   </clock>
Nov 08 04:29:52 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:29:52 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:29:52 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:29:52 user nova-compute[75014]:   </cpu>
Nov 08 04:29:52 user nova-compute[75014]:   <devices>
Nov 08 04:29:52 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 04:29:52 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 04:29:52 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk"/>
Nov 08 04:29:52 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:29:52 user nova-compute[75014]:     </disk>
Nov 08 04:29:52 user nova-compute[75014]:     <disk type="block" device="disk">
Nov 08 04:29:52 user nova-compute[75014]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:29:52 user nova-compute[75014]:       <source dev="/dev/sdc"/>
Nov 08 04:29:52 user nova-compute[75014]:       <target dev="vdb" bus="virtio"/>
Nov 08 04:29:52 user nova-compute[75014]:       <serial>80f82440-69e0-4522-ac18-f17eeec2d76a</serial>
Nov 08 04:29:52 user nova-compute[75014]:     </disk>
Nov 08 04:29:52 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:29:52 user nova-compute[75014]:       <mac address="fa:16:3e:42:95:35"/>
Nov 08 04:29:52 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:29:52 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:29:52 user nova-compute[75014]:       <target dev="tap3137db93-bf"/>
Nov 08 04:29:52 user nova-compute[75014]:     </interface>
Nov 08 04:29:52 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:29:52 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/console.log" append="off"/>
Nov 08 04:29:52 user nova-compute[75014]:     </serial>
Nov 08 04:29:52 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:29:52 user nova-compute[75014]:     <video>
Nov 08 04:29:52 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:29:52 user nova-compute[75014]:     </video>
Nov 08 04:29:52 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:29:52 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:29:52 user nova-compute[75014]:     </rng>
Nov 08 04:29:52 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:29:52 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:29:52 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:29:52 user nova-compute[75014]:     </memballoon>
Nov 08 04:29:52 user nova-compute[75014]:   </devices>
Nov 08 04:29:52 user nova-compute[75014]: </domain>
Nov 08 04:29:52 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:29:52 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-809427286',display_name='tempest-ServerActionsTestOtherB-server-809427286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-809427286',id=46,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdfoac/qWiSELcxtzUkuk+o8acjsOIEGrFVZM627fy7ovi3OfsfBH6nUCuIfY7BK2ldXdAqxdoVU6c1JyFZHm23ngkkF9j7Yy2b+7zJu1QcSK4PuxDPCnQBF7ZI6NxBlg==',key_name='tempest-keypair-1823743126',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:28:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7ec7bf4b5935436792895f9a522431c4',ramdisk_id='',reservation_id='r-o63p9ir8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1064545051',owner_user_name='tempest-ServerActionsTestOtherB-1064545051-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:29:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b0c5324a67d4137b0ac20c505d28251',uuid=08acc858-dc89-4ae8-9b48-08e6de5db0d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:29:52 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Converting VIF {"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:29:52 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:95:35,bridge_name='br-int',has_traffic_filtering=True,id=3137db93-bf8f-4d21-a1df-f9b6014d46bf,network=Network(5dbeed84-c2af-4e98-b511-a7500ba483e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3137db93-bf') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:29:52 user nova-compute[75014]: DEBUG os_vif [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:95:35,bridge_name='br-int',has_traffic_filtering=True,id=3137db93-bf8f-4d21-a1df-f9b6014d46bf,network=Network(5dbeed84-c2af-4e98-b511-a7500ba483e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3137db93-bf') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:29:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:29:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:29:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '156a7091-2ddc-5b39-a598-9e4511a43914', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:29:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:29:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3137db93-bf, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:29:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3137db93-bf, col_values=(('qos', UUID('98b0665e-e896-4d69-b24c-6460be4a7c00')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:29:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3137db93-bf, col_values=(('external_ids', {'iface-id': '3137db93-bf8f-4d21-a1df-f9b6014d46bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:95:35', 'vm-uuid': '08acc858-dc89-4ae8-9b48-08e6de5db0d0'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:29:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:29:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:52 user nova-compute[75014]: INFO os_vif [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:95:35,bridge_name='br-int',has_traffic_filtering=True,id=3137db93-bf8f-4d21-a1df-f9b6014d46bf,network=Network(5dbeed84-c2af-4e98-b511-a7500ba483e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3137db93-bf')
Nov 08 04:29:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:54 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:29:54 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:29:54 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:29:54 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Didn't find any instances for network info cache update. {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 04:29:54 user nova-compute[75014]: DEBUG nova.compute.manager [req-48a97d73-14b4-4269-8d4c-312c9a454535 req-f38acf6a-c2bf-4198-a007-753dc0e22ca4 service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received event network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:29:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-48a97d73-14b4-4269-8d4c-312c9a454535 req-f38acf6a-c2bf-4198-a007-753dc0e22ca4 service nova] Acquiring lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:29:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-48a97d73-14b4-4269-8d4c-312c9a454535 req-f38acf6a-c2bf-4198-a007-753dc0e22ca4 service nova] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:29:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-48a97d73-14b4-4269-8d4c-312c9a454535 req-f38acf6a-c2bf-4198-a007-753dc0e22ca4 service nova] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:29:54 user nova-compute[75014]: DEBUG nova.compute.manager [req-48a97d73-14b4-4269-8d4c-312c9a454535 req-f38acf6a-c2bf-4198-a007-753dc0e22ca4 service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] No waiting events found dispatching network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:29:54 user nova-compute[75014]: WARNING nova.compute.manager [req-48a97d73-14b4-4269-8d4c-312c9a454535 req-f38acf6a-c2bf-4198-a007-753dc0e22ca4 service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received unexpected event network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf for instance with vm_state resized and task_state resize_reverting.
Nov 08 04:29:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:55 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:29:56 user nova-compute[75014]: DEBUG nova.compute.manager [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:29:56 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Instance running successfully.
Nov 08 04:29:56 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] finish_revert_migration finished successfully. {{(pid=75014) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 08 04:29:56 user nova-compute[75014]: DEBUG nova.compute.manager [req-f86d9197-4fe3-4997-934f-ffda7131e246 req-c3167bad-455b-4312-af4d-3b8d681bd618 service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received event network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:29:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f86d9197-4fe3-4997-934f-ffda7131e246 req-c3167bad-455b-4312-af4d-3b8d681bd618 service nova] Acquiring lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:29:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f86d9197-4fe3-4997-934f-ffda7131e246 req-c3167bad-455b-4312-af4d-3b8d681bd618 service nova] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:29:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f86d9197-4fe3-4997-934f-ffda7131e246 req-c3167bad-455b-4312-af4d-3b8d681bd618 service nova] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:29:56 user nova-compute[75014]: DEBUG nova.compute.manager [req-f86d9197-4fe3-4997-934f-ffda7131e246 req-c3167bad-455b-4312-af4d-3b8d681bd618 service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] No waiting events found dispatching network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:29:56 user nova-compute[75014]: WARNING nova.compute.manager [req-f86d9197-4fe3-4997-934f-ffda7131e246 req-c3167bad-455b-4312-af4d-3b8d681bd618 service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received unexpected event network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf for instance with vm_state resized and task_state resize_reverting.
Nov 08 04:29:56 user nova-compute[75014]: INFO nova.compute.manager [None req-03cf46f5-cb5a-4c27-97dd-826e4993b95c tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Updating instance to original state: 'active'
Nov 08 04:29:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:29:58 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:29:59 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:30:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:30:03 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:30:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:30:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:30:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:30:03 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:30:03 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:30:03 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:30:03 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:30:03 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:30:03 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:30:03 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:30:04 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:30:04 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:30:04 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=8833MB free_disk=24.881195068359375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:30:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:30:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:30:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "be882529-f74b-4743-a7a8-0a64e8f6c2c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:30:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "be882529-f74b-4743-a7a8-0a64e8f6c2c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:30:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "be882529-f74b-4743-a7a8-0a64e8f6c2c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:30:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "be882529-f74b-4743-a7a8-0a64e8f6c2c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:30:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "be882529-f74b-4743-a7a8-0a64e8f6c2c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:30:04 user nova-compute[75014]: INFO nova.compute.manager [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Terminating instance
Nov 08 04:30:04 user nova-compute[75014]: DEBUG nova.compute.manager [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:30:04 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance be882529-f74b-4743-a7a8-0a64e8f6c2c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:30:04 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 08acc858-dc89-4ae8-9b48-08e6de5db0d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:30:04 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:30:04 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:30:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:30:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:30:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:30:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:30:04 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:30:04 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:30:04 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:30:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:30:04 user nova-compute[75014]: DEBUG nova.compute.manager [req-21e84928-8f51-4648-a7ed-32679267734d req-6125ebb1-7f17-4e1d-bbd7-0005f2fa86fc service nova] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Received event network-vif-unplugged-31de527f-d08b-4b86-8c23-c96c4ebe51f9 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:30:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-21e84928-8f51-4648-a7ed-32679267734d req-6125ebb1-7f17-4e1d-bbd7-0005f2fa86fc service nova] Acquiring lock "be882529-f74b-4743-a7a8-0a64e8f6c2c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:30:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-21e84928-8f51-4648-a7ed-32679267734d req-6125ebb1-7f17-4e1d-bbd7-0005f2fa86fc service nova] Lock "be882529-f74b-4743-a7a8-0a64e8f6c2c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:30:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-21e84928-8f51-4648-a7ed-32679267734d req-6125ebb1-7f17-4e1d-bbd7-0005f2fa86fc service nova] Lock "be882529-f74b-4743-a7a8-0a64e8f6c2c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:30:04 user nova-compute[75014]: DEBUG nova.compute.manager [req-21e84928-8f51-4648-a7ed-32679267734d req-6125ebb1-7f17-4e1d-bbd7-0005f2fa86fc service nova] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] No waiting events found dispatching network-vif-unplugged-31de527f-d08b-4b86-8c23-c96c4ebe51f9 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:30:04 user nova-compute[75014]: DEBUG nova.compute.manager [req-21e84928-8f51-4648-a7ed-32679267734d req-6125ebb1-7f17-4e1d-bbd7-0005f2fa86fc service nova] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Received event network-vif-unplugged-31de527f-d08b-4b86-8c23-c96c4ebe51f9 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:30:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:30:05 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Instance destroyed successfully.
Nov 08 04:30:05 user nova-compute[75014]: DEBUG nova.objects.instance [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lazy-loading 'resources' on Instance uuid be882529-f74b-4743-a7a8-0a64e8f6c2c0 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1531009516',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1531009516',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1531009516',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvF7c7rllNn/vREGD4u5XUBoBAxMKKfMsFRGKEIs7UzEDu7w8EwScfMWQnWTwnnujJNAuwBdU53agt5ghT8nbH2Bw90VOiMtacRG7342uafjTEXaBKCKmT/3IzOKX1BTQ==',key_name='tempest-keypair-586165679',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:25:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='504ed2858e78480e9beef5aa5f5d9f1d',ramdisk_id='',reservation_id='r-501ql3z4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2082374398',owner_user_name='tempest-TestVolumeBootPattern-2082374398-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:25:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe1c5af56ab14da7986d64e38597d394',uuid=be882529-f74b-4743-a7a8-0a64e8f6c2c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31de527f-d08b-4b86-8c23-c96c4ebe51f9", "address": "fa:16:3e:36:70:4d", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31de527f-d0", "ovs_interfaceid": "31de527f-d08b-4b86-8c23-c96c4ebe51f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converting VIF {"id": "31de527f-d08b-4b86-8c23-c96c4ebe51f9", "address": "fa:16:3e:36:70:4d", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31de527f-d0", "ovs_interfaceid": "31de527f-d08b-4b86-8c23-c96c4ebe51f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:70:4d,bridge_name='br-int',has_traffic_filtering=True,id=31de527f-d08b-4b86-8c23-c96c4ebe51f9,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31de527f-d0') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG os_vif [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:70:4d,bridge_name='br-int',has_traffic_filtering=True,id=31de527f-d08b-4b86-8c23-c96c4ebe51f9,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31de527f-d0') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31de527f-d0, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc00f203-f294-4611-bc9b-6e1c8e68056e) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:30:05 user nova-compute[75014]: INFO os_vif [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:70:4d,bridge_name='br-int',has_traffic_filtering=True,id=31de527f-d08b-4b86-8c23-c96c4ebe51f9,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31de527f-d0')
Nov 08 04:30:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDroSQcz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:30:05 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:30:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ee454c-02b0-4d4c-8fd1-b77769ad3492]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:30:05 user nova-compute[75014]: No targets found.
Nov 08 04:30:05 user nova-compute[75014]: iSNS:
Nov 08 04:30:05 user nova-compute[75014]: No targets found.
Nov 08 04:30:05 user nova-compute[75014]: STATIC:
Nov 08 04:30:05 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:30:05 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:30:05 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:30:05 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a
Nov 08 04:30:05 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:30:05 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:30:05 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301
Nov 08 04:30:05 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:30:05 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:30:05 user nova-compute[75014]: FIRMWARE:
Nov 08 04:30:05 user nova-compute[75014]: No targets found.
Nov 08 04:30:05 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:30:05 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:30:05 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[022960ca-cf77-4b7c-85d1-34dcce6299e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7092138e-a236-40db-afaf-348fe319b709]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:30:05 user nova-compute[75014]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)
Nov 08 04:30:05 user nova-compute[75014]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a (non-flash)
Nov 08 04:30:05 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:30:05 user nova-compute[75014]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 (non-flash)
Nov 08 04:30:05 user nova-compute[75014]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a (non-flash)
Nov 08 04:30:05 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0400777130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301'): ({'sdb'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Removing single pathed devices sdb {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb8f2a0-0140-4faf-919d-100228aa5dcf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[622b00bc-4535-4971-8489-8f33bbfd4cc3]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Flushing IO for device /dev/sdb {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e60d642-8511-4e85-9510-16b9c51a36ca]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[55273bc2-63eb-433b-9f34-b9d987dad457]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] SCSI volumes sdb have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO93b9374b-38a0199325565dc8', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_93b9374b', '/dev/disk/by-id/scsi-23338613031393933') {{(pid=86544) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c0caef-d01a-4dae-9480-675b8da4d5ab]: (4, None) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0471081-303c-4a04-87d1-3e77ebdfc687]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b88e1b-0930-4c00-84b5-4e2ee6ae3df4]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301, portal: 172.16.0.220,3260]
Nov 08 04:30:05 user nova-compute[75014]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301, portal: 172.16.0.220,3260] successful.
Nov 08 04:30:05 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac806863-3815-493b-806d-30a65a7d3301 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[862af4c1-01fc-4097-a6c4-e56564976bb5]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] <== disconnect_volume: return (381ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:30:05 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Deleting instance files /opt/stack/data/nova/instances/be882529-f74b-4743-a7a8-0a64e8f6c2c0_del
Nov 08 04:30:05 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Deletion of /opt/stack/data/nova/instances/be882529-f74b-4743-a7a8-0a64e8f6c2c0_del complete
Nov 08 04:30:05 user nova-compute[75014]: INFO nova.compute.manager [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 08 04:30:05 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:30:05 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:30:06 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:30:06 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Took 0.87 seconds to deallocate network for instance.
Nov 08 04:30:06 user nova-compute[75014]: DEBUG nova.compute.manager [req-53233a3c-6acf-4cf8-968e-c4cf951d4c41 req-be3fa453-f001-424a-bbad-94ac00a4e2d7 service nova] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Received event network-vif-deleted-31de527f-d08b-4b86-8c23-c96c4ebe51f9 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:30:06 user nova-compute[75014]: DEBUG nova.compute.manager [req-bec4e65c-a1a2-4a78-91e5-0f2f8bcd88a3 req-0cc77b4f-0a48-434b-b4b0-56b60e31fecb service nova] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Received event network-vif-plugged-31de527f-d08b-4b86-8c23-c96c4ebe51f9 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:30:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-bec4e65c-a1a2-4a78-91e5-0f2f8bcd88a3 req-0cc77b4f-0a48-434b-b4b0-56b60e31fecb service nova] Acquiring lock "be882529-f74b-4743-a7a8-0a64e8f6c2c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:30:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-bec4e65c-a1a2-4a78-91e5-0f2f8bcd88a3 req-0cc77b4f-0a48-434b-b4b0-56b60e31fecb service nova] Lock "be882529-f74b-4743-a7a8-0a64e8f6c2c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:30:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-bec4e65c-a1a2-4a78-91e5-0f2f8bcd88a3 req-0cc77b4f-0a48-434b-b4b0-56b60e31fecb service nova] Lock "be882529-f74b-4743-a7a8-0a64e8f6c2c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:30:06 user nova-compute[75014]: DEBUG nova.compute.manager [req-bec4e65c-a1a2-4a78-91e5-0f2f8bcd88a3 req-0cc77b4f-0a48-434b-b4b0-56b60e31fecb service nova] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] No waiting events found dispatching network-vif-plugged-31de527f-d08b-4b86-8c23-c96c4ebe51f9 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:30:06 user nova-compute[75014]: WARNING nova.compute.manager [req-bec4e65c-a1a2-4a78-91e5-0f2f8bcd88a3 req-0cc77b4f-0a48-434b-b4b0-56b60e31fecb service nova] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Received unexpected event network-vif-plugged-31de527f-d08b-4b86-8c23-c96c4ebe51f9 for instance with vm_state active and task_state deleting.
Nov 08 04:30:07 user nova-compute[75014]: INFO nova.compute.manager [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Took 0.90 seconds to detach 1 volumes for instance.
Nov 08 04:30:07 user nova-compute[75014]: DEBUG nova.compute.manager [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: be882529-f74b-4743-a7a8-0a64e8f6c2c0] Deleting volume: ac806863-3815-493b-806d-30a65a7d3301 {{(pid=75014) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 04:30:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:30:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:30:07 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:30:07 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:30:07 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:30:07 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:30:07 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:30:07 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:30:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.133s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:30:07 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Deleted allocations for instance be882529-f74b-4743-a7a8-0a64e8f6c2c0
Nov 08 04:30:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-af27454b-436e-480c-a3d6-a886527ec6d9 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "be882529-f74b-4743-a7a8-0a64e8f6c2c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.418s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:30:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:30:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:30:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:30:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:30:20 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:30:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:30:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:30:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:30:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:30:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:30:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:30:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:30:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:30:53 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:30:54 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:30:54 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:30:54 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Rebuilding the list of instances to heal {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 04:30:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:30:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:30:54 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 04:30:54 user nova-compute[75014]: DEBUG nova.objects.instance [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lazy-loading 'info_cache' on Instance uuid 08acc858-dc89-4ae8-9b48-08e6de5db0d0 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:30:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:30:54 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Updating instance_info_cache with network_info: [{"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:30:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:30:55 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 04:30:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:30:55 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:30:55 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:30:57 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:30:59 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:31:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:31:01 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:31:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:31:05 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:31:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:31:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:31:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:31:05 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:31:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:31:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:31:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:31:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:31:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:31:06 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:31:06 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:31:06 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=8972MB free_disk=24.879241943359375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:31:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:31:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:31:06 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 08acc858-dc89-4ae8-9b48-08e6de5db0d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:31:06 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:31:06 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:31:06 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Refreshing inventories for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 04:31:06 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Updating ProviderTree inventory for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 04:31:06 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Updating inventory in ProviderTree for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 04:31:06 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Refreshing aggregate associations for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0, aggregates: None {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 04:31:06 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Refreshing trait associations for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 04:31:06 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:31:06 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:31:06 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:31:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.521s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:31:09 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:31:09 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:31:09 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:31:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:31:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:31:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:31:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:31:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:31:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:31:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:31:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "01dc811c-1fc6-4fb5-8872-e8f58998066a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:31:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "01dc811c-1fc6-4fb5-8872-e8f58998066a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG nova.compute.manager [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 04:31:16 user nova-compute[75014]: INFO nova.compute.claims [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Claim successful on node user
Nov 08 04:31:16 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Cleaning up deleted instances {{(pid=75014) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] There are 0 instances to clean {{(pid=75014) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG nova.compute.manager [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG nova.compute.manager [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG nova.network.neutron [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 04:31:16 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 04:31:16 user nova-compute[75014]: DEBUG nova.compute.manager [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG nova.policy [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe1c5af56ab14da7986d64e38597d394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504ed2858e78480e9beef5aa5f5d9f1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 04:31:16 user nova-compute[75014]: INFO nova.virt.block_device [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Booting with volume 1e113de3-d43d-4e7d-9504-f6e36e86b93b at /dev/vda
Nov 08 04:31:16 user nova-compute[75014]: DEBUG os_brick.utils [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[00081ffa-5797-4065-b12b-68937e528030]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5636da-5d3a-4144-843d-f0b0c40ef7a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0be701-8b84-47a6-8b95-a2ffcc7a7ec2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cbce02-6fbd-4bae-b288-cfc918df6aea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:31:16 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:31:16 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fa228b-e56f-4875-9b0d-c29faae0eaed]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG os_brick.utils [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:31:16 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Updating existing volume attachment record: 787639c5-f185-4c87-bf56-4fd85b78784d {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:31:17 user nova-compute[75014]: DEBUG nova.network.neutron [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Successfully created port: 60aa7b76-153d-4eed-8752-30a252925eb7 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 04:31:17 user nova-compute[75014]: DEBUG nova.network.neutron [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Successfully updated port: 60aa7b76-153d-4eed-8752-30a252925eb7 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 04:31:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "refresh_cache-01dc811c-1fc6-4fb5-8872-e8f58998066a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:31:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquired lock "refresh_cache-01dc811c-1fc6-4fb5-8872-e8f58998066a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:31:17 user nova-compute[75014]: DEBUG nova.network.neutron [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:31:17 user nova-compute[75014]: DEBUG nova.compute.manager [req-82aea99b-27de-4e1e-90c3-a202f42af2af req-3da79864-be86-4ad9-93ab-69aca39869ff service nova] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Received event network-changed-60aa7b76-153d-4eed-8752-30a252925eb7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:31:17 user nova-compute[75014]: DEBUG nova.compute.manager [req-82aea99b-27de-4e1e-90c3-a202f42af2af req-3da79864-be86-4ad9-93ab-69aca39869ff service nova] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Refreshing instance network info cache due to event network-changed-60aa7b76-153d-4eed-8752-30a252925eb7. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:31:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-82aea99b-27de-4e1e-90c3-a202f42af2af req-3da79864-be86-4ad9-93ab-69aca39869ff service nova] Acquiring lock "refresh_cache-01dc811c-1fc6-4fb5-8872-e8f58998066a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:31:17 user nova-compute[75014]: DEBUG nova.network.neutron [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 04:31:18 user nova-compute[75014]: DEBUG nova.network.neutron [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Updating instance_info_cache with network_info: [{"id": "60aa7b76-153d-4eed-8752-30a252925eb7", "address": "fa:16:3e:c0:4a:22", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60aa7b76-15", "ovs_interfaceid": "60aa7b76-153d-4eed-8752-30a252925eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:31:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Releasing lock "refresh_cache-01dc811c-1fc6-4fb5-8872-e8f58998066a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:31:18 user nova-compute[75014]: DEBUG nova.compute.manager [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Instance network_info: |[{"id": "60aa7b76-153d-4eed-8752-30a252925eb7", "address": "fa:16:3e:c0:4a:22", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60aa7b76-15", "ovs_interfaceid": "60aa7b76-153d-4eed-8752-30a252925eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 04:31:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-82aea99b-27de-4e1e-90c3-a202f42af2af req-3da79864-be86-4ad9-93ab-69aca39869ff service nova] Acquired lock "refresh_cache-01dc811c-1fc6-4fb5-8872-e8f58998066a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:31:18 user nova-compute[75014]: DEBUG nova.network.neutron [req-82aea99b-27de-4e1e-90c3-a202f42af2af req-3da79864-be86-4ad9-93ab-69aca39869ff service nova] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Refreshing network info cache for port 60aa7b76-153d-4eed-8752-30a252925eb7 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:31:18 user nova-compute[75014]: DEBUG nova.network.neutron [req-82aea99b-27de-4e1e-90c3-a202f42af2af req-3da79864-be86-4ad9-93ab-69aca39869ff service nova] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Updated VIF entry in instance network info cache for port 60aa7b76-153d-4eed-8752-30a252925eb7. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:31:18 user nova-compute[75014]: DEBUG nova.network.neutron [req-82aea99b-27de-4e1e-90c3-a202f42af2af req-3da79864-be86-4ad9-93ab-69aca39869ff service nova] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Updating instance_info_cache with network_info: [{"id": "60aa7b76-153d-4eed-8752-30a252925eb7", "address": "fa:16:3e:c0:4a:22", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60aa7b76-15", "ovs_interfaceid": "60aa7b76-153d-4eed-8752-30a252925eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:31:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-82aea99b-27de-4e1e-90c3-a202f42af2af req-3da79864-be86-4ad9-93ab-69aca39869ff service nova] Releasing lock "refresh_cache-01dc811c-1fc6-4fb5-8872-e8f58998066a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:31:20 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:31:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:31:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:31:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:31:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:31:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:31:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:31:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:31:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG nova.compute.manager [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 04:31:38 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Creating image(s)
Nov 08 04:31:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Did not create local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Ensure instance console log exists: /opt/stack/data/nova/instances/01dc811c-1fc6-4fb5-8872-e8f58998066a/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Start _get_guest_xml network_info=[{"id": "60aa7b76-153d-4eed-8752-30a252925eb7", "address": "fa:16:3e:c0:4a:22", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60aa7b76-15", "ovs_interfaceid": "60aa7b76-153d-4eed-8752-30a252925eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwosdxTI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '01dc811c-1fc6-4fb5-8872-e8f58998066a', 'attached_at': '', 'detached_at': '', 'volume_id': '1e113de3-d43d-4e7d-9504-f6e36e86b93b', 'serial': '1e113de3-d43d-4e7d-9504-f6e36e86b93b'}, 'device_type': 'disk', 'attachment_id': '787639c5-f185-4c87-bf56-4fd85b78784d', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:31:38 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:31:38 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:31:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwosdxTI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:31:38 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:31:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:31:38 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:31:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:31:38 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[779ed7fb-da7f-420f-af91-d512643a9ef3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:31:38 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[24728409-1577-4dbe-8ea3-43b9210cb07f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b] added
Nov 08 04:31:38 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f22559-5b3b-446d-af62-e6503634adf7]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbb453d-ee44-43ed-a429-8f255e9370ff]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nwosdxTI {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nwosdxTI" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5d5cc7-77c8-40b6-8817-c9a916c23064]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nwosdxTI'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c53b19-688f-4fb6-9e65-b28ef6436cc4]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[467e6356-c2ec-4e11-becd-21f555d94d53]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:31:38 user nova-compute[75014]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a (non-flash)
Nov 08 04:31:38 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:31:38 user nova-compute[75014]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a (non-flash)
Nov 08 04:31:38 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6b0b1b-e3ba-464b-8aef-73c8d6f7c591]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b, portal: 172.16.0.220,3260]
Nov 08 04:31:38 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b, portal: 172.16.0.220,3260] successful.
Nov 08 04:31:38 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[239aaa0c-7eb4-4f6b-8aee-9abd36618334]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71bfc6b-2a9b-42f2-a8e1-ac6e234ede3c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:31:38 user nova-compute[75014]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a (non-flash)
Nov 08 04:31:38 user nova-compute[75014]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)
Nov 08 04:31:38 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:31:38 user nova-compute[75014]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a (non-flash)
Nov 08 04:31:38 user nova-compute[75014]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)
Nov 08 04:31:38 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa51ea5f-c377-40ef-bdec-8d9c35dfffd8]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:31:38 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwosdxTI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:31:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:31:39 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23135396530393035', 'path': '/dev/sdb'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:31:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135396530393035', 'path': '/dev/sdb'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:31:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:31:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1585650391',display_name='tempest-TestVolumeBootPattern-server-1585650391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1585650391',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmCKJe2YKVTcf+XoP5PTLw5G8CWIzWuvlg190P9zWQdP0YW5BGT2gToDF2MbQudSeOvT17m8Vr6JpTpU4CWFLr0k+Sf3aulZ0b8jpBbd3H85eZBlYCQoTRoOdK8wj8DqQ==',key_name='tempest-TestVolumeBootPattern-1541162844',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='504ed2858e78480e9beef5aa5f5d9f1d',ramdisk_id='',reservation_id='r-g2v20nml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2082374398',owner_user_name='tempest-TestVolumeBootPattern-2082374398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:31:17Z,user_data=None,user_id='fe1c5af56ab14da7986d64e38597d394',uuid=01dc811c-1fc6-4fb5-8872-e8f58998066a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60aa7b76-153d-4eed-8752-30a252925eb7", "address": "fa:16:3e:c0:4a:22", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60aa7b76-15", "ovs_interfaceid": "60aa7b76-153d-4eed-8752-30a252925eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:31:39 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converting VIF {"id": "60aa7b76-153d-4eed-8752-30a252925eb7", "address": "fa:16:3e:c0:4a:22", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60aa7b76-15", "ovs_interfaceid": "60aa7b76-153d-4eed-8752-30a252925eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:31:39 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:4a:22,bridge_name='br-int',has_traffic_filtering=True,id=60aa7b76-153d-4eed-8752-30a252925eb7,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60aa7b76-15') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:31:39 user nova-compute[75014]: DEBUG nova.objects.instance [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lazy-loading 'pci_devices' on Instance uuid 01dc811c-1fc6-4fb5-8872-e8f58998066a {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:31:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:31:39 user nova-compute[75014]:   <uuid>01dc811c-1fc6-4fb5-8872-e8f58998066a</uuid>
Nov 08 04:31:39 user nova-compute[75014]:   <name>instance-00000031</name>
Nov 08 04:31:39 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:31:39 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:31:39 user nova-compute[75014]:   <metadata>
Nov 08 04:31:39 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:31:39 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:31:39 user nova-compute[75014]:       <nova:name>tempest-TestVolumeBootPattern-server-1585650391</nova:name>
Nov 08 04:31:39 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:31:38</nova:creationTime>
Nov 08 04:31:39 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:31:39 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:31:39 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:31:39 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:31:39 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:31:39 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:31:39 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:31:39 user nova-compute[75014]:       <nova:owner>
Nov 08 04:31:39 user nova-compute[75014]:         <nova:user uuid="fe1c5af56ab14da7986d64e38597d394">tempest-TestVolumeBootPattern-2082374398-project-member</nova:user>
Nov 08 04:31:39 user nova-compute[75014]:         <nova:project uuid="504ed2858e78480e9beef5aa5f5d9f1d">tempest-TestVolumeBootPattern-2082374398</nova:project>
Nov 08 04:31:39 user nova-compute[75014]:       </nova:owner>
Nov 08 04:31:39 user nova-compute[75014]:       <nova:ports>
Nov 08 04:31:39 user nova-compute[75014]:         <nova:port uuid="60aa7b76-153d-4eed-8752-30a252925eb7">
Nov 08 04:31:39 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 04:31:39 user nova-compute[75014]:         </nova:port>
Nov 08 04:31:39 user nova-compute[75014]:       </nova:ports>
Nov 08 04:31:39 user nova-compute[75014]:     </nova:instance>
Nov 08 04:31:39 user nova-compute[75014]:   </metadata>
Nov 08 04:31:39 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:31:39 user nova-compute[75014]:     <system>
Nov 08 04:31:39 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:31:39 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:31:39 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:31:39 user nova-compute[75014]:       <entry name="serial">01dc811c-1fc6-4fb5-8872-e8f58998066a</entry>
Nov 08 04:31:39 user nova-compute[75014]:       <entry name="uuid">01dc811c-1fc6-4fb5-8872-e8f58998066a</entry>
Nov 08 04:31:39 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:31:39 user nova-compute[75014]:     </system>
Nov 08 04:31:39 user nova-compute[75014]:   </sysinfo>
Nov 08 04:31:39 user nova-compute[75014]:   <os>
Nov 08 04:31:39 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:31:39 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:31:39 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:31:39 user nova-compute[75014]:   </os>
Nov 08 04:31:39 user nova-compute[75014]:   <features>
Nov 08 04:31:39 user nova-compute[75014]:     <acpi/>
Nov 08 04:31:39 user nova-compute[75014]:     <apic/>
Nov 08 04:31:39 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:31:39 user nova-compute[75014]:   </features>
Nov 08 04:31:39 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:31:39 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:31:39 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:31:39 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:31:39 user nova-compute[75014]:   </clock>
Nov 08 04:31:39 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:31:39 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:31:39 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:31:39 user nova-compute[75014]:   </cpu>
Nov 08 04:31:39 user nova-compute[75014]:   <devices>
Nov 08 04:31:39 user nova-compute[75014]:     <disk type="block" device="disk">
Nov 08 04:31:39 user nova-compute[75014]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:31:39 user nova-compute[75014]:       <source dev="/dev/sdb"/>
Nov 08 04:31:39 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:31:39 user nova-compute[75014]:       <serial>1e113de3-d43d-4e7d-9504-f6e36e86b93b</serial>
Nov 08 04:31:39 user nova-compute[75014]:     </disk>
Nov 08 04:31:39 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:31:39 user nova-compute[75014]:       <mac address="fa:16:3e:c0:4a:22"/>
Nov 08 04:31:39 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:31:39 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:31:39 user nova-compute[75014]:       <target dev="tap60aa7b76-15"/>
Nov 08 04:31:39 user nova-compute[75014]:     </interface>
Nov 08 04:31:39 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:31:39 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/01dc811c-1fc6-4fb5-8872-e8f58998066a/console.log" append="off"/>
Nov 08 04:31:39 user nova-compute[75014]:     </serial>
Nov 08 04:31:39 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:31:39 user nova-compute[75014]:     <video>
Nov 08 04:31:39 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:31:39 user nova-compute[75014]:     </video>
Nov 08 04:31:39 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:31:39 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:31:39 user nova-compute[75014]:     </rng>
Nov 08 04:31:39 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:31:39 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:31:39 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:31:39 user nova-compute[75014]:     </memballoon>
Nov 08 04:31:39 user nova-compute[75014]:   </devices>
Nov 08 04:31:39 user nova-compute[75014]: </domain>
Nov 08 04:31:39 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:31:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:31:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1585650391',display_name='tempest-TestVolumeBootPattern-server-1585650391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1585650391',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmCKJe2YKVTcf+XoP5PTLw5G8CWIzWuvlg190P9zWQdP0YW5BGT2gToDF2MbQudSeOvT17m8Vr6JpTpU4CWFLr0k+Sf3aulZ0b8jpBbd3H85eZBlYCQoTRoOdK8wj8DqQ==',key_name='tempest-TestVolumeBootPattern-1541162844',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='504ed2858e78480e9beef5aa5f5d9f1d',ramdisk_id='',reservation_id='r-g2v20nml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2082374398',owner_user_name='tempest-TestVolumeBootPattern-2082374398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:31:17Z,user_data=None,user_id='fe1c5af56ab14da7986d64e38597d394',uuid=01dc811c-1fc6-4fb5-8872-e8f58998066a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60aa7b76-153d-4eed-8752-30a252925eb7", "address": "fa:16:3e:c0:4a:22", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60aa7b76-15", "ovs_interfaceid": "60aa7b76-153d-4eed-8752-30a252925eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:31:39 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converting VIF {"id": "60aa7b76-153d-4eed-8752-30a252925eb7", "address": "fa:16:3e:c0:4a:22", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60aa7b76-15", "ovs_interfaceid": "60aa7b76-153d-4eed-8752-30a252925eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:31:39 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:4a:22,bridge_name='br-int',has_traffic_filtering=True,id=60aa7b76-153d-4eed-8752-30a252925eb7,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60aa7b76-15') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:31:39 user nova-compute[75014]: DEBUG os_vif [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:4a:22,bridge_name='br-int',has_traffic_filtering=True,id=60aa7b76-153d-4eed-8752-30a252925eb7,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60aa7b76-15') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:31:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:31:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:31:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:31:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:31:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e350585-e3e8-5986-a9c1-e08e90f242c5', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:31:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:31:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:31:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60aa7b76-15, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:31:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap60aa7b76-15, col_values=(('qos', UUID('81a7f89d-6a0d-47ed-821a-efedaea4bacf')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:31:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap60aa7b76-15, col_values=(('external_ids', {'iface-id': '60aa7b76-153d-4eed-8752-30a252925eb7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:4a:22', 'vm-uuid': '01dc811c-1fc6-4fb5-8872-e8f58998066a'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:31:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:31:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:31:39 user nova-compute[75014]: INFO os_vif [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:4a:22,bridge_name='br-int',has_traffic_filtering=True,id=60aa7b76-153d-4eed-8752-30a252925eb7,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60aa7b76-15')
Nov 08 04:31:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:31:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] No VIF found with MAC fa:16:3e:c0:4a:22, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:31:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:31:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:31:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:31:41 user nova-compute[75014]: DEBUG nova.compute.manager [req-33a967ce-9f1a-4c29-b839-f6e313d93f86 req-68e1424e-143b-4e5d-a23e-1ff0d77a6726 service nova] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Received event network-vif-plugged-60aa7b76-153d-4eed-8752-30a252925eb7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:31:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-33a967ce-9f1a-4c29-b839-f6e313d93f86 req-68e1424e-143b-4e5d-a23e-1ff0d77a6726 service nova] Acquiring lock "01dc811c-1fc6-4fb5-8872-e8f58998066a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:31:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-33a967ce-9f1a-4c29-b839-f6e313d93f86 req-68e1424e-143b-4e5d-a23e-1ff0d77a6726 service nova] Lock "01dc811c-1fc6-4fb5-8872-e8f58998066a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:31:41 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-33a967ce-9f1a-4c29-b839-f6e313d93f86 req-68e1424e-143b-4e5d-a23e-1ff0d77a6726 service nova] Lock "01dc811c-1fc6-4fb5-8872-e8f58998066a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:31:41 user nova-compute[75014]: DEBUG nova.compute.manager [req-33a967ce-9f1a-4c29-b839-f6e313d93f86 req-68e1424e-143b-4e5d-a23e-1ff0d77a6726 service nova] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] No waiting events found dispatching network-vif-plugged-60aa7b76-153d-4eed-8752-30a252925eb7 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:31:41 user nova-compute[75014]: WARNING nova.compute.manager [req-33a967ce-9f1a-4c29-b839-f6e313d93f86 req-68e1424e-143b-4e5d-a23e-1ff0d77a6726 service nova] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Received unexpected event network-vif-plugged-60aa7b76-153d-4eed-8752-30a252925eb7 for instance with vm_state building and task_state spawning.
Nov 08 04:31:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:31:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:31:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:31:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:31:43 user nova-compute[75014]: DEBUG nova.compute.manager [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:31:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 04:31:43 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Instance spawned successfully.
Nov 08 04:31:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 04:31:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:31:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:31:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:31:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:31:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:31:43 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:31:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-f753223f-33ab-442f-85e3-adee83617081 req-1610913d-a9ed-4e01-abd4-891f3a8502c4 service nova] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Received event network-vif-plugged-60aa7b76-153d-4eed-8752-30a252925eb7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:31:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f753223f-33ab-442f-85e3-adee83617081 req-1610913d-a9ed-4e01-abd4-891f3a8502c4 service nova] Acquiring lock "01dc811c-1fc6-4fb5-8872-e8f58998066a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:31:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f753223f-33ab-442f-85e3-adee83617081 req-1610913d-a9ed-4e01-abd4-891f3a8502c4 service nova] Lock "01dc811c-1fc6-4fb5-8872-e8f58998066a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:31:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f753223f-33ab-442f-85e3-adee83617081 req-1610913d-a9ed-4e01-abd4-891f3a8502c4 service nova] Lock "01dc811c-1fc6-4fb5-8872-e8f58998066a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:31:43 user nova-compute[75014]: DEBUG nova.compute.manager [req-f753223f-33ab-442f-85e3-adee83617081 req-1610913d-a9ed-4e01-abd4-891f3a8502c4 service nova] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] No waiting events found dispatching network-vif-plugged-60aa7b76-153d-4eed-8752-30a252925eb7 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:31:43 user nova-compute[75014]: WARNING nova.compute.manager [req-f753223f-33ab-442f-85e3-adee83617081 req-1610913d-a9ed-4e01-abd4-891f3a8502c4 service nova] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Received unexpected event network-vif-plugged-60aa7b76-153d-4eed-8752-30a252925eb7 for instance with vm_state building and task_state spawning.
Nov 08 04:31:43 user nova-compute[75014]: INFO nova.compute.manager [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Took 5.08 seconds to spawn the instance on the hypervisor.
Nov 08 04:31:43 user nova-compute[75014]: DEBUG nova.compute.manager [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:31:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:31:43 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:31:43 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=75014) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 04:31:43 user nova-compute[75014]: INFO nova.compute.manager [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Took 27.34 seconds to build instance.
Nov 08 04:31:43 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-11b3331e-b51f-4fd9-8828-aec88feefd0e tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "01dc811c-1fc6-4fb5-8872-e8f58998066a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.428s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:31:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:31:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:31:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:31:54 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:31:54 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:31:54 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Rebuilding the list of instances to heal {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 04:31:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:31:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:31:54 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 04:31:54 user nova-compute[75014]: DEBUG nova.objects.instance [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lazy-loading 'info_cache' on Instance uuid 08acc858-dc89-4ae8-9b48-08e6de5db0d0 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:31:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:31:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:31:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:31:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:31:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:31:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:31:55 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Updating instance_info_cache with network_info: [{"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:31:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-08acc858-dc89-4ae8-9b48-08e6de5db0d0" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:31:55 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 04:31:55 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:31:55 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:31:56 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:31:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:31:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:32:00 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:32:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:32:03 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:32:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:32:07 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:32:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:32:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:32:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:32:07 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:32:07 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:32:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:32:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:32:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:32:07 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:32:07 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:32:08 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:32:08 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:32:08 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=8758MB free_disk=24.877399444580078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:32:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:32:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:32:08 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 08acc858-dc89-4ae8-9b48-08e6de5db0d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:32:08 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 01dc811c-1fc6-4fb5-8872-e8f58998066a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:32:08 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:32:08 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:32:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:32:08 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:32:08 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:32:08 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:32:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:32:09 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:32:09 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:32:09 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:32:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:32:10 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:32:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:32:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:32:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquiring lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:32:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:32:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquiring lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:32:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:32:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:32:16 user nova-compute[75014]: INFO nova.compute.manager [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Terminating instance
Nov 08 04:32:16 user nova-compute[75014]: DEBUG nova.compute.manager [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:32:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:32:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:32:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:32:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG nova.compute.manager [req-1171648d-e9f8-46ff-bd63-1f85746b378d req-ba27f499-fbef-4be3-9a8e-d189a9f0ae72 service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received event network-vif-unplugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1171648d-e9f8-46ff-bd63-1f85746b378d req-ba27f499-fbef-4be3-9a8e-d189a9f0ae72 service nova] Acquiring lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1171648d-e9f8-46ff-bd63-1f85746b378d req-ba27f499-fbef-4be3-9a8e-d189a9f0ae72 service nova] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-1171648d-e9f8-46ff-bd63-1f85746b378d req-ba27f499-fbef-4be3-9a8e-d189a9f0ae72 service nova] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG nova.compute.manager [req-1171648d-e9f8-46ff-bd63-1f85746b378d req-ba27f499-fbef-4be3-9a8e-d189a9f0ae72 service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] No waiting events found dispatching network-vif-unplugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG nova.compute.manager [req-1171648d-e9f8-46ff-bd63-1f85746b378d req-ba27f499-fbef-4be3-9a8e-d189a9f0ae72 service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received event network-vif-unplugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:32:17 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Instance destroyed successfully.
Nov 08 04:32:17 user nova-compute[75014]: DEBUG nova.objects.instance [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lazy-loading 'resources' on Instance uuid 08acc858-dc89-4ae8-9b48-08e6de5db0d0 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:23:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-809427286',display_name='tempest-ServerActionsTestOtherB-server-809427286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-809427286',id=46,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdfoac/qWiSELcxtzUkuk+o8acjsOIEGrFVZM627fy7ovi3OfsfBH6nUCuIfY7BK2ldXdAqxdoVU6c1JyFZHm23ngkkF9j7Yy2b+7zJu1QcSK4PuxDPCnQBF7ZI6NxBlg==',key_name='tempest-keypair-1823743126',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:29:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ec7bf4b5935436792895f9a522431c4',ramdisk_id='',reservation_id='r-o63p9ir8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1064545051',owner_user_name='tempest-ServerActionsTestOtherB-1064545051-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:29:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b0c5324a67d4137b0ac20c505d28251',uuid=08acc858-dc89-4ae8-9b48-08e6de5db0d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Converting VIF {"id": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "address": "fa:16:3e:42:95:35", "network": {"id": "5dbeed84-c2af-4e98-b511-a7500ba483e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1674551282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ec7bf4b5935436792895f9a522431c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3137db93-bf", "ovs_interfaceid": "3137db93-bf8f-4d21-a1df-f9b6014d46bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:95:35,bridge_name='br-int',has_traffic_filtering=True,id=3137db93-bf8f-4d21-a1df-f9b6014d46bf,network=Network(5dbeed84-c2af-4e98-b511-a7500ba483e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3137db93-bf') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG os_vif [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:95:35,bridge_name='br-int',has_traffic_filtering=True,id=3137db93-bf8f-4d21-a1df-f9b6014d46bf,network=Network(5dbeed84-c2af-4e98-b511-a7500ba483e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3137db93-bf') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3137db93-bf, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=98b0665e-e896-4d69-b24c-6460be4a7c00) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:32:17 user nova-compute[75014]: INFO os_vif [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:95:35,bridge_name='br-int',has_traffic_filtering=True,id=3137db93-bf8f-4d21-a1df-f9b6014d46bf,network=Network(5dbeed84-c2af-4e98-b511-a7500ba483e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3137db93-bf')
Nov 08 04:32:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfaYAQzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:32:17 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:32:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[148c93d0-f6db-44d9-82da-64e2f29da4ac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:32:17 user nova-compute[75014]: No targets found.
Nov 08 04:32:17 user nova-compute[75014]: iSNS:
Nov 08 04:32:17 user nova-compute[75014]: No targets found.
Nov 08 04:32:17 user nova-compute[75014]: STATIC:
Nov 08 04:32:17 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:32:17 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:32:17 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:32:17 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a
Nov 08 04:32:17 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:32:17 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:32:17 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b
Nov 08 04:32:17 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:32:17 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:32:17 user nova-compute[75014]: FIRMWARE:
Nov 08 04:32:17 user nova-compute[75014]: No targets found.
Nov 08 04:32:17 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:32:17 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:32:17 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[336e7eb2-4384-4103-87bd-1e39880dfe88]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f5b108-ba17-4197-b2b0-c665db5e3691]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:32:17 user nova-compute[75014]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a (non-flash)
Nov 08 04:32:17 user nova-compute[75014]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)
Nov 08 04:32:17 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:32:17 user nova-compute[75014]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a (non-flash)
Nov 08 04:32:17 user nova-compute[75014]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)
Nov 08 04:32:17 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f040046f760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a'): ({'sdc'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Removing single pathed devices sdc {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca247050-057c-4fcb-98aa-651e656a1f7a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae57d04e-5b46-48e0-b868-faf3c2275f85]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Flushing IO for device /dev/sdc {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bad21e-2864-4fc9-820e-8f12b963e14c]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[94917761-00ed-4b69-a87a-2061e924e78e]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] SCSI volumes sdc have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d9f534-b845-4595-9d1b-b45f69a1bcb2]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fafa6f-5a62-478c-b492-d9c10496a765]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a, portal: 172.16.0.220,3260]
Nov 08 04:32:17 user nova-compute[75014]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a, portal: 172.16.0.220,3260] successful.
Nov 08 04:32:17 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80f82440-69e0-4522-ac18-f17eeec2d76a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7cfa7e-3d63-4759-b8fb-78987bfe5b1d]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] <== disconnect_volume: return (357ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:32:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:32:17 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Deleting instance files /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0_del
Nov 08 04:32:18 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Deletion of /opt/stack/data/nova/instances/08acc858-dc89-4ae8-9b48-08e6de5db0d0_del complete
Nov 08 04:32:18 user nova-compute[75014]: INFO nova.compute.manager [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 08 04:32:18 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:32:18 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:32:18 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:32:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:32:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:32:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:32:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:32:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:32:18 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:32:18 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Took 0.82 seconds to deallocate network for instance.
Nov 08 04:32:19 user nova-compute[75014]: DEBUG nova.compute.manager [req-4a723731-424c-41c4-8931-036f049cb835 req-4df189a5-1fd1-48c2-a7eb-d79df1b51c0c service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received event network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:32:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4a723731-424c-41c4-8931-036f049cb835 req-4df189a5-1fd1-48c2-a7eb-d79df1b51c0c service nova] Acquiring lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:32:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4a723731-424c-41c4-8931-036f049cb835 req-4df189a5-1fd1-48c2-a7eb-d79df1b51c0c service nova] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:32:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4a723731-424c-41c4-8931-036f049cb835 req-4df189a5-1fd1-48c2-a7eb-d79df1b51c0c service nova] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:32:19 user nova-compute[75014]: DEBUG nova.compute.manager [req-4a723731-424c-41c4-8931-036f049cb835 req-4df189a5-1fd1-48c2-a7eb-d79df1b51c0c service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] No waiting events found dispatching network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:32:19 user nova-compute[75014]: WARNING nova.compute.manager [req-4a723731-424c-41c4-8931-036f049cb835 req-4df189a5-1fd1-48c2-a7eb-d79df1b51c0c service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received unexpected event network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf for instance with vm_state active and task_state deleting.
Nov 08 04:32:19 user nova-compute[75014]: DEBUG nova.compute.manager [req-4a723731-424c-41c4-8931-036f049cb835 req-4df189a5-1fd1-48c2-a7eb-d79df1b51c0c service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received event network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:32:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4a723731-424c-41c4-8931-036f049cb835 req-4df189a5-1fd1-48c2-a7eb-d79df1b51c0c service nova] Acquiring lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:32:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4a723731-424c-41c4-8931-036f049cb835 req-4df189a5-1fd1-48c2-a7eb-d79df1b51c0c service nova] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:32:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4a723731-424c-41c4-8931-036f049cb835 req-4df189a5-1fd1-48c2-a7eb-d79df1b51c0c service nova] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:32:19 user nova-compute[75014]: DEBUG nova.compute.manager [req-4a723731-424c-41c4-8931-036f049cb835 req-4df189a5-1fd1-48c2-a7eb-d79df1b51c0c service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] No waiting events found dispatching network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:32:19 user nova-compute[75014]: WARNING nova.compute.manager [req-4a723731-424c-41c4-8931-036f049cb835 req-4df189a5-1fd1-48c2-a7eb-d79df1b51c0c service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received unexpected event network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf for instance with vm_state active and task_state deleting.
Nov 08 04:32:19 user nova-compute[75014]: DEBUG nova.compute.manager [req-4a723731-424c-41c4-8931-036f049cb835 req-4df189a5-1fd1-48c2-a7eb-d79df1b51c0c service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received event network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:32:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4a723731-424c-41c4-8931-036f049cb835 req-4df189a5-1fd1-48c2-a7eb-d79df1b51c0c service nova] Acquiring lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:32:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4a723731-424c-41c4-8931-036f049cb835 req-4df189a5-1fd1-48c2-a7eb-d79df1b51c0c service nova] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:32:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4a723731-424c-41c4-8931-036f049cb835 req-4df189a5-1fd1-48c2-a7eb-d79df1b51c0c service nova] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:32:19 user nova-compute[75014]: DEBUG nova.compute.manager [req-4a723731-424c-41c4-8931-036f049cb835 req-4df189a5-1fd1-48c2-a7eb-d79df1b51c0c service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] No waiting events found dispatching network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:32:19 user nova-compute[75014]: WARNING nova.compute.manager [req-4a723731-424c-41c4-8931-036f049cb835 req-4df189a5-1fd1-48c2-a7eb-d79df1b51c0c service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received unexpected event network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf for instance with vm_state active and task_state deleting.
Nov 08 04:32:19 user nova-compute[75014]: DEBUG nova.compute.manager [req-4a723731-424c-41c4-8931-036f049cb835 req-4df189a5-1fd1-48c2-a7eb-d79df1b51c0c service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received event network-vif-unplugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:32:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4a723731-424c-41c4-8931-036f049cb835 req-4df189a5-1fd1-48c2-a7eb-d79df1b51c0c service nova] Acquiring lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:32:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4a723731-424c-41c4-8931-036f049cb835 req-4df189a5-1fd1-48c2-a7eb-d79df1b51c0c service nova] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:32:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4a723731-424c-41c4-8931-036f049cb835 req-4df189a5-1fd1-48c2-a7eb-d79df1b51c0c service nova] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:32:19 user nova-compute[75014]: DEBUG nova.compute.manager [req-4a723731-424c-41c4-8931-036f049cb835 req-4df189a5-1fd1-48c2-a7eb-d79df1b51c0c service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] No waiting events found dispatching network-vif-unplugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:32:19 user nova-compute[75014]: DEBUG nova.compute.manager [req-4a723731-424c-41c4-8931-036f049cb835 req-4df189a5-1fd1-48c2-a7eb-d79df1b51c0c service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received event network-vif-unplugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:32:19 user nova-compute[75014]: DEBUG nova.compute.manager [req-4a723731-424c-41c4-8931-036f049cb835 req-4df189a5-1fd1-48c2-a7eb-d79df1b51c0c service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received event network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:32:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4a723731-424c-41c4-8931-036f049cb835 req-4df189a5-1fd1-48c2-a7eb-d79df1b51c0c service nova] Acquiring lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:32:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4a723731-424c-41c4-8931-036f049cb835 req-4df189a5-1fd1-48c2-a7eb-d79df1b51c0c service nova] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:32:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-4a723731-424c-41c4-8931-036f049cb835 req-4df189a5-1fd1-48c2-a7eb-d79df1b51c0c service nova] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:32:19 user nova-compute[75014]: DEBUG nova.compute.manager [req-4a723731-424c-41c4-8931-036f049cb835 req-4df189a5-1fd1-48c2-a7eb-d79df1b51c0c service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] No waiting events found dispatching network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:32:19 user nova-compute[75014]: WARNING nova.compute.manager [req-4a723731-424c-41c4-8931-036f049cb835 req-4df189a5-1fd1-48c2-a7eb-d79df1b51c0c service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received unexpected event network-vif-plugged-3137db93-bf8f-4d21-a1df-f9b6014d46bf for instance with vm_state active and task_state deleting.
Nov 08 04:32:19 user nova-compute[75014]: DEBUG nova.compute.manager [req-4a723731-424c-41c4-8931-036f049cb835 req-4df189a5-1fd1-48c2-a7eb-d79df1b51c0c service nova] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Received event network-vif-deleted-3137db93-bf8f-4d21-a1df-f9b6014d46bf {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:32:19 user nova-compute[75014]: INFO nova.compute.manager [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] [instance: 08acc858-dc89-4ae8-9b48-08e6de5db0d0] Took 0.88 seconds to detach 1 volumes for instance.
Nov 08 04:32:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:32:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:32:20 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:32:20 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:32:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.452s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:32:20 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Deleted allocations for instance 08acc858-dc89-4ae8-9b48-08e6de5db0d0
Nov 08 04:32:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-79f3d901-a390-4a26-9d9c-0b2d0c0d368f tempest-ServerActionsTestOtherB-1064545051 tempest-ServerActionsTestOtherB-1064545051-project-member] Lock "08acc858-dc89-4ae8-9b48-08e6de5db0d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.609s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:32:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:32:27 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:32:32 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:32:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:32:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:32:47 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:32:52 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:32:54 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:32:54 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:32:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-01dc811c-1fc6-4fb5-8872-e8f58998066a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:32:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-01dc811c-1fc6-4fb5-8872-e8f58998066a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:32:54 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 04:32:54 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Updating instance_info_cache with network_info: [{"id": "60aa7b76-153d-4eed-8752-30a252925eb7", "address": "fa:16:3e:c0:4a:22", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60aa7b76-15", "ovs_interfaceid": "60aa7b76-153d-4eed-8752-30a252925eb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:32:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-01dc811c-1fc6-4fb5-8872-e8f58998066a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:32:54 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 04:32:55 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:32:55 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:32:57 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:32:58 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:33:02 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:33:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:33:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:33:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:33:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:33:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:33:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:33:04 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:33:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:33:07 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:33:08 user nova-compute[75014]: DEBUG nova.compute.manager [req-495fde1e-e9d7-4ed6-99dc-81925f5a1696 req-05f16689-7af2-4116-b3ed-81e5537e495d service nova] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Received event network-changed-60aa7b76-153d-4eed-8752-30a252925eb7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:33:08 user nova-compute[75014]: DEBUG nova.compute.manager [req-495fde1e-e9d7-4ed6-99dc-81925f5a1696 req-05f16689-7af2-4116-b3ed-81e5537e495d service nova] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Refreshing instance network info cache due to event network-changed-60aa7b76-153d-4eed-8752-30a252925eb7. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:33:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-495fde1e-e9d7-4ed6-99dc-81925f5a1696 req-05f16689-7af2-4116-b3ed-81e5537e495d service nova] Acquiring lock "refresh_cache-01dc811c-1fc6-4fb5-8872-e8f58998066a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:33:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-495fde1e-e9d7-4ed6-99dc-81925f5a1696 req-05f16689-7af2-4116-b3ed-81e5537e495d service nova] Acquired lock "refresh_cache-01dc811c-1fc6-4fb5-8872-e8f58998066a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:33:08 user nova-compute[75014]: DEBUG nova.network.neutron [req-495fde1e-e9d7-4ed6-99dc-81925f5a1696 req-05f16689-7af2-4116-b3ed-81e5537e495d service nova] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Refreshing network info cache for port 60aa7b76-153d-4eed-8752-30a252925eb7 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG nova.network.neutron [req-495fde1e-e9d7-4ed6-99dc-81925f5a1696 req-05f16689-7af2-4116-b3ed-81e5537e495d service nova] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Updated VIF entry in instance network info cache for port 60aa7b76-153d-4eed-8752-30a252925eb7. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG nova.network.neutron [req-495fde1e-e9d7-4ed6-99dc-81925f5a1696 req-05f16689-7af2-4116-b3ed-81e5537e495d service nova] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Updating instance_info_cache with network_info: [{"id": "60aa7b76-153d-4eed-8752-30a252925eb7", "address": "fa:16:3e:c0:4a:22", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60aa7b76-15", "ovs_interfaceid": "60aa7b76-153d-4eed-8752-30a252925eb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-495fde1e-e9d7-4ed6-99dc-81925f5a1696 req-05f16689-7af2-4116-b3ed-81e5537e495d service nova] Releasing lock "refresh_cache-01dc811c-1fc6-4fb5-8872-e8f58998066a" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "01dc811c-1fc6-4fb5-8872-e8f58998066a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "01dc811c-1fc6-4fb5-8872-e8f58998066a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "01dc811c-1fc6-4fb5-8872-e8f58998066a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "01dc811c-1fc6-4fb5-8872-e8f58998066a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "01dc811c-1fc6-4fb5-8872-e8f58998066a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:33:09 user nova-compute[75014]: INFO nova.compute.manager [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Terminating instance
Nov 08 04:33:09 user nova-compute[75014]: DEBUG nova.compute.manager [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG nova.compute.manager [req-924585eb-81f1-4b83-b523-fce05ccadc3d req-393a72dd-c21d-4219-a991-5d3999b56cef service nova] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Received event network-vif-unplugged-60aa7b76-153d-4eed-8752-30a252925eb7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-924585eb-81f1-4b83-b523-fce05ccadc3d req-393a72dd-c21d-4219-a991-5d3999b56cef service nova] Acquiring lock "01dc811c-1fc6-4fb5-8872-e8f58998066a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-924585eb-81f1-4b83-b523-fce05ccadc3d req-393a72dd-c21d-4219-a991-5d3999b56cef service nova] Lock "01dc811c-1fc6-4fb5-8872-e8f58998066a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-924585eb-81f1-4b83-b523-fce05ccadc3d req-393a72dd-c21d-4219-a991-5d3999b56cef service nova] Lock "01dc811c-1fc6-4fb5-8872-e8f58998066a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG nova.compute.manager [req-924585eb-81f1-4b83-b523-fce05ccadc3d req-393a72dd-c21d-4219-a991-5d3999b56cef service nova] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] No waiting events found dispatching network-vif-unplugged-60aa7b76-153d-4eed-8752-30a252925eb7 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG nova.compute.manager [req-924585eb-81f1-4b83-b523-fce05ccadc3d req-393a72dd-c21d-4219-a991-5d3999b56cef service nova] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Received event network-vif-unplugged-60aa7b76-153d-4eed-8752-30a252925eb7 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:33:09 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Instance destroyed successfully.
Nov 08 04:33:09 user nova-compute[75014]: DEBUG nova.objects.instance [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lazy-loading 'resources' on Instance uuid 01dc811c-1fc6-4fb5-8872-e8f58998066a {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:31:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1585650391',display_name='tempest-TestVolumeBootPattern-server-1585650391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1585650391',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmCKJe2YKVTcf+XoP5PTLw5G8CWIzWuvlg190P9zWQdP0YW5BGT2gToDF2MbQudSeOvT17m8Vr6JpTpU4CWFLr0k+Sf3aulZ0b8jpBbd3H85eZBlYCQoTRoOdK8wj8DqQ==',key_name='tempest-TestVolumeBootPattern-1541162844',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:31:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='504ed2858e78480e9beef5aa5f5d9f1d',ramdisk_id='',reservation_id='r-g2v20nml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2082374398',owner_user_name='tempest-TestVolumeBootPattern-2082374398-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:31:43Z,user_data=None,user_id='fe1c5af56ab14da7986d64e38597d394',uuid=01dc811c-1fc6-4fb5-8872-e8f58998066a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60aa7b76-153d-4eed-8752-30a252925eb7", "address": "fa:16:3e:c0:4a:22", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60aa7b76-15", "ovs_interfaceid": "60aa7b76-153d-4eed-8752-30a252925eb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converting VIF {"id": "60aa7b76-153d-4eed-8752-30a252925eb7", "address": "fa:16:3e:c0:4a:22", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60aa7b76-15", "ovs_interfaceid": "60aa7b76-153d-4eed-8752-30a252925eb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:4a:22,bridge_name='br-int',has_traffic_filtering=True,id=60aa7b76-153d-4eed-8752-30a252925eb7,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60aa7b76-15') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG os_vif [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:4a:22,bridge_name='br-int',has_traffic_filtering=True,id=60aa7b76-153d-4eed-8752-30a252925eb7,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60aa7b76-15') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60aa7b76-15, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=81a7f89d-6a0d-47ed-821a-efedaea4bacf) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:33:09 user nova-compute[75014]: INFO os_vif [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:4a:22,bridge_name='br-int',has_traffic_filtering=True,id=60aa7b76-153d-4eed-8752-30a252925eb7,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60aa7b76-15')
Nov 08 04:33:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwosdxTI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:33:09 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:33:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2c40a4-ca8e-476d-9f80-50a43c0ad5a8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:33:09 user nova-compute[75014]: No targets found.
Nov 08 04:33:09 user nova-compute[75014]: iSNS:
Nov 08 04:33:09 user nova-compute[75014]: No targets found.
Nov 08 04:33:09 user nova-compute[75014]: STATIC:
Nov 08 04:33:09 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:33:09 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:33:09 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:33:09 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b
Nov 08 04:33:09 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:33:09 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:33:09 user nova-compute[75014]: FIRMWARE:
Nov 08 04:33:09 user nova-compute[75014]: No targets found.
Nov 08 04:33:09 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:33:09 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:33:09 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6605c985-186c-4fad-9e7c-9817703df349]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:33:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba72e1e5-8c31-4b98-bcab-0466908bc41e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:33:10 user nova-compute[75014]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)
Nov 08 04:33:10 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:33:10 user nova-compute[75014]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)
Nov 08 04:33:10 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0400777a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b'): ({'sdb'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Removing single pathed devices sdb {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:33:10 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:33:10 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:33:10 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=9085MB free_disk=24.904285430908203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c317d5c-084c-4773-bb0a-6406c5ab17e9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[547991e8-5251-4d8e-98e3-57e2ae37fb41]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Flushing IO for device /dev/sdb {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdfb91c-b0fb-445f-8bcf-46b6741b3144]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 01dc811c-1fc6-4fb5-8872-e8f58998066a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d830b7c-107c-485b-a720-2bcc09deb6f7]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] SCSI volumes sdb have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4938d1-c530-4498-8f10-98547ce6295c]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7376d9-674a-4540-8983-953966dbaa8b]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b, portal: 172.16.0.220,3260]
Nov 08 04:33:10 user nova-compute[75014]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b, portal: 172.16.0.220,3260] successful.
Nov 08 04:33:10 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ebe2bb-f652-49ed-98d9-17b8858db9fc]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.651s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] <== disconnect_volume: return (652ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:33:10 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Deleting instance files /opt/stack/data/nova/instances/01dc811c-1fc6-4fb5-8872-e8f58998066a_del
Nov 08 04:33:10 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Deletion of /opt/stack/data/nova/instances/01dc811c-1fc6-4fb5-8872-e8f58998066a_del complete
Nov 08 04:33:10 user nova-compute[75014]: INFO nova.compute.manager [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Took 1.50 seconds to destroy the instance on the hypervisor.
Nov 08 04:33:10 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:33:10 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:33:11 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:33:11 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Took 0.72 seconds to deallocate network for instance.
Nov 08 04:33:11 user nova-compute[75014]: DEBUG nova.compute.manager [req-e6fc8162-23bc-4ef7-81d5-160b33f59f7c req-12b749c9-8c5a-40f5-a8f0-0a0f480bb423 service nova] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Received event network-vif-plugged-60aa7b76-153d-4eed-8752-30a252925eb7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:33:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e6fc8162-23bc-4ef7-81d5-160b33f59f7c req-12b749c9-8c5a-40f5-a8f0-0a0f480bb423 service nova] Acquiring lock "01dc811c-1fc6-4fb5-8872-e8f58998066a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:33:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e6fc8162-23bc-4ef7-81d5-160b33f59f7c req-12b749c9-8c5a-40f5-a8f0-0a0f480bb423 service nova] Lock "01dc811c-1fc6-4fb5-8872-e8f58998066a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:33:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e6fc8162-23bc-4ef7-81d5-160b33f59f7c req-12b749c9-8c5a-40f5-a8f0-0a0f480bb423 service nova] Lock "01dc811c-1fc6-4fb5-8872-e8f58998066a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:33:11 user nova-compute[75014]: DEBUG nova.compute.manager [req-e6fc8162-23bc-4ef7-81d5-160b33f59f7c req-12b749c9-8c5a-40f5-a8f0-0a0f480bb423 service nova] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] No waiting events found dispatching network-vif-plugged-60aa7b76-153d-4eed-8752-30a252925eb7 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:33:11 user nova-compute[75014]: WARNING nova.compute.manager [req-e6fc8162-23bc-4ef7-81d5-160b33f59f7c req-12b749c9-8c5a-40f5-a8f0-0a0f480bb423 service nova] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Received unexpected event network-vif-plugged-60aa7b76-153d-4eed-8752-30a252925eb7 for instance with vm_state active and task_state deleting.
Nov 08 04:33:11 user nova-compute[75014]: DEBUG nova.compute.manager [req-e6fc8162-23bc-4ef7-81d5-160b33f59f7c req-12b749c9-8c5a-40f5-a8f0-0a0f480bb423 service nova] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Received event network-vif-deleted-60aa7b76-153d-4eed-8752-30a252925eb7 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:33:11 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:33:11 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:33:11 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:33:12 user nova-compute[75014]: INFO nova.compute.manager [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 01dc811c-1fc6-4fb5-8872-e8f58998066a] Took 0.86 seconds to detach 1 volumes for instance.
Nov 08 04:33:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:33:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:33:12 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:33:12 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:33:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.112s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:33:12 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Deleted allocations for instance 01dc811c-1fc6-4fb5-8872-e8f58998066a
Nov 08 04:33:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-5d7f1463-04c8-413c-b8c5-8e5b0ddd5b06 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "01dc811c-1fc6-4fb5-8872-e8f58998066a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.378s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:33:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:33:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:33:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:33:21 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:33:24 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:33:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:33:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:33:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:33:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:33:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:33:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:33:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:33:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:33:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:33:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:33:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:33:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:33:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:33:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:33:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:33:54 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:33:54 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:33:54 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Rebuilding the list of instances to heal {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 04:33:54 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Didn't find any instances for network info cache update. {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 04:33:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:33:57 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:33:57 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:33:59 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:33:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:34:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:34:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:34:01 user nova-compute[75014]: DEBUG nova.compute.manager [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 04:34:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:34:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:34:01 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 04:34:01 user nova-compute[75014]: INFO nova.compute.claims [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Claim successful on node user
Nov 08 04:34:01 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:34:01 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:34:01 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.197s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:34:01 user nova-compute[75014]: DEBUG nova.compute.manager [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 04:34:01 user nova-compute[75014]: DEBUG nova.compute.manager [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 04:34:01 user nova-compute[75014]: DEBUG nova.network.neutron [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 04:34:01 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 04:34:01 user nova-compute[75014]: DEBUG nova.compute.manager [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 04:34:01 user nova-compute[75014]: DEBUG nova.policy [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe1c5af56ab14da7986d64e38597d394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504ed2858e78480e9beef5aa5f5d9f1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 04:34:01 user nova-compute[75014]: INFO nova.virt.block_device [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Booting with volume 1e113de3-d43d-4e7d-9504-f6e36e86b93b at /dev/vda
Nov 08 04:34:01 user nova-compute[75014]: DEBUG os_brick.utils [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:34:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:34:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:34:01 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2a83c4-1981-4777-82cd-07876bc43798]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:34:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:34:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:34:01 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[65db1c9c-6cf7-4f5b-abe4-5b1f6de313ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:34:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:34:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:34:01 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[088003bb-06d3-467b-a101-e6f21c79ee37]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:34:01 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe1b971-2718-42f4-8c60-b369cd41b0de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:34:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:34:01 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:34:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:34:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:34:02 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:34:02 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:34:02 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d54c02-5445-4b24-a6a1-9df2741a4087]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:34:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:34:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:34:02 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:34:02 user nova-compute[75014]: DEBUG os_brick.utils [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:34:02 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Updating existing volume attachment record: 9a0cc609-ce67-4ddb-af6d-1c4cc041c332 {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:34:02 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:34:02 user nova-compute[75014]: DEBUG nova.network.neutron [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Successfully created port: 1caab5fb-eb55-48f9-8ede-4cc4f90546ae {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 04:34:02 user nova-compute[75014]: DEBUG nova.network.neutron [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Successfully updated port: 1caab5fb-eb55-48f9-8ede-4cc4f90546ae {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 04:34:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "refresh_cache-fed0b54e-44cc-4f01-9511-e1993dcd4cec" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:34:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquired lock "refresh_cache-fed0b54e-44cc-4f01-9511-e1993dcd4cec" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:34:03 user nova-compute[75014]: DEBUG nova.network.neutron [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:34:03 user nova-compute[75014]: DEBUG nova.compute.manager [req-fdcf4417-bd4c-45a6-b92c-31350283bc61 req-81bd03cf-8bb4-4ab4-9719-8e8b38e9d04a service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Received event network-changed-1caab5fb-eb55-48f9-8ede-4cc4f90546ae {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:34:03 user nova-compute[75014]: DEBUG nova.compute.manager [req-fdcf4417-bd4c-45a6-b92c-31350283bc61 req-81bd03cf-8bb4-4ab4-9719-8e8b38e9d04a service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Refreshing instance network info cache due to event network-changed-1caab5fb-eb55-48f9-8ede-4cc4f90546ae. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:34:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-fdcf4417-bd4c-45a6-b92c-31350283bc61 req-81bd03cf-8bb4-4ab4-9719-8e8b38e9d04a service nova] Acquiring lock "refresh_cache-fed0b54e-44cc-4f01-9511-e1993dcd4cec" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:34:03 user nova-compute[75014]: DEBUG nova.network.neutron [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 04:34:03 user nova-compute[75014]: DEBUG nova.network.neutron [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Updating instance_info_cache with network_info: [{"id": "1caab5fb-eb55-48f9-8ede-4cc4f90546ae", "address": "fa:16:3e:ae:c8:4f", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1caab5fb-eb", "ovs_interfaceid": "1caab5fb-eb55-48f9-8ede-4cc4f90546ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:34:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Releasing lock "refresh_cache-fed0b54e-44cc-4f01-9511-e1993dcd4cec" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:34:03 user nova-compute[75014]: DEBUG nova.compute.manager [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Instance network_info: |[{"id": "1caab5fb-eb55-48f9-8ede-4cc4f90546ae", "address": "fa:16:3e:ae:c8:4f", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1caab5fb-eb", "ovs_interfaceid": "1caab5fb-eb55-48f9-8ede-4cc4f90546ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 04:34:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-fdcf4417-bd4c-45a6-b92c-31350283bc61 req-81bd03cf-8bb4-4ab4-9719-8e8b38e9d04a service nova] Acquired lock "refresh_cache-fed0b54e-44cc-4f01-9511-e1993dcd4cec" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:34:03 user nova-compute[75014]: DEBUG nova.network.neutron [req-fdcf4417-bd4c-45a6-b92c-31350283bc61 req-81bd03cf-8bb4-4ab4-9719-8e8b38e9d04a service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Refreshing network info cache for port 1caab5fb-eb55-48f9-8ede-4cc4f90546ae {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:34:03 user nova-compute[75014]: DEBUG nova.network.neutron [req-fdcf4417-bd4c-45a6-b92c-31350283bc61 req-81bd03cf-8bb4-4ab4-9719-8e8b38e9d04a service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Updated VIF entry in instance network info cache for port 1caab5fb-eb55-48f9-8ede-4cc4f90546ae. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:34:03 user nova-compute[75014]: DEBUG nova.network.neutron [req-fdcf4417-bd4c-45a6-b92c-31350283bc61 req-81bd03cf-8bb4-4ab4-9719-8e8b38e9d04a service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Updating instance_info_cache with network_info: [{"id": "1caab5fb-eb55-48f9-8ede-4cc4f90546ae", "address": "fa:16:3e:ae:c8:4f", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1caab5fb-eb", "ovs_interfaceid": "1caab5fb-eb55-48f9-8ede-4cc4f90546ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:34:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-fdcf4417-bd4c-45a6-b92c-31350283bc61 req-81bd03cf-8bb4-4ab4-9719-8e8b38e9d04a service nova] Releasing lock "refresh_cache-fed0b54e-44cc-4f01-9511-e1993dcd4cec" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:34:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:34:06 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:34:08 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:34:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:34:11 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:34:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:34:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:34:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:34:11 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:34:11 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:34:11 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:34:11 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=9084MB free_disk=24.893993377685547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:34:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:34:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:34:11 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance fed0b54e-44cc-4f01-9511-e1993dcd4cec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:34:11 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:34:11 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:34:11 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:34:11 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:34:12 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:34:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:34:13 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:34:13 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:34:13 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:34:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:34:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:34:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:34:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:34:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:34:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:34:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:34:24 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG nova.compute.manager [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 04:34:28 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Creating image(s)
Nov 08 04:34:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Did not create local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Ensure instance console log exists: /opt/stack/data/nova/instances/fed0b54e-44cc-4f01-9511-e1993dcd4cec/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Start _get_guest_xml network_info=[{"id": "1caab5fb-eb55-48f9-8ede-4cc4f90546ae", "address": "fa:16:3e:ae:c8:4f", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1caab5fb-eb", "ovs_interfaceid": "1caab5fb-eb55-48f9-8ede-4cc4f90546ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwosdxTI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fed0b54e-44cc-4f01-9511-e1993dcd4cec', 'attached_at': '', 'detached_at': '', 'volume_id': '1e113de3-d43d-4e7d-9504-f6e36e86b93b', 'serial': '1e113de3-d43d-4e7d-9504-f6e36e86b93b'}, 'device_type': 'disk', 'attachment_id': '9a0cc609-ce67-4ddb-af6d-1c4cc041c332', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:34:28 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:34:28 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:34:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwosdxTI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:34:28 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:34:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:34:28 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:34:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:34:28 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[776e304f-015a-43d1-8402-37b4960cec3d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:34:28 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0b3f84-15d3-436e-bf81-0964fe869378]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b] added
Nov 08 04:34:28 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e71149b-bafd-4d9d-b588-7765a2ef0cdf]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e6b9cc-e673-41b7-aa9c-4df92633b7a5]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nwosdxTI {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nwosdxTI" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[25baaf40-5f9e-4617-9e17-afbd4a24d7de]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nwosdxTI'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a12f474-ca53-400e-8df1-1f7a206457eb]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[96043842-c3dc-46c3-8d70-2a58e6902503]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:34:28 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:34:28 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[05857563-c98b-484b-8cd8-b592a746eae0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b, portal: 172.16.0.220,3260]
Nov 08 04:34:28 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b, portal: 172.16.0.220,3260] successful.
Nov 08 04:34:28 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8baeec-3b22-461f-9240-97f13e39050b]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[544e0040-2c81-4670-97cc-670da9d4cdab]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:34:28 user nova-compute[75014]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)
Nov 08 04:34:28 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:34:28 user nova-compute[75014]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)
Nov 08 04:34:28 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[50768250-fc82-440a-bcdc-acc4b6374a4d]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:34:28 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwosdxTI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:34:29 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:34:29 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23135396530393035', 'path': '/dev/sdb'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:34:29 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135396530393035', 'path': '/dev/sdb'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:34:29 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:34:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-439402672',display_name='tempest-TestVolumeBootPattern-server-439402672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-439402672',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmCKJe2YKVTcf+XoP5PTLw5G8CWIzWuvlg190P9zWQdP0YW5BGT2gToDF2MbQudSeOvT17m8Vr6JpTpU4CWFLr0k+Sf3aulZ0b8jpBbd3H85eZBlYCQoTRoOdK8wj8DqQ==',key_name='tempest-TestVolumeBootPattern-1541162844',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='504ed2858e78480e9beef5aa5f5d9f1d',ramdisk_id='',reservation_id='r-ru4udg3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2082374398',owner_user_name='tempest-TestVolumeBootPattern-2082374398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:34:02Z,user_data=None,user_id='fe1c5af56ab14da7986d64e38597d394',uuid=fed0b54e-44cc-4f01-9511-e1993dcd4cec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1caab5fb-eb55-48f9-8ede-4cc4f90546ae", "address": "fa:16:3e:ae:c8:4f", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1caab5fb-eb", "ovs_interfaceid": "1caab5fb-eb55-48f9-8ede-4cc4f90546ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:34:29 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converting VIF {"id": "1caab5fb-eb55-48f9-8ede-4cc4f90546ae", "address": "fa:16:3e:ae:c8:4f", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1caab5fb-eb", "ovs_interfaceid": "1caab5fb-eb55-48f9-8ede-4cc4f90546ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:34:29 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:c8:4f,bridge_name='br-int',has_traffic_filtering=True,id=1caab5fb-eb55-48f9-8ede-4cc4f90546ae,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1caab5fb-eb') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:34:29 user nova-compute[75014]: DEBUG nova.objects.instance [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lazy-loading 'pci_devices' on Instance uuid fed0b54e-44cc-4f01-9511-e1993dcd4cec {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:34:29 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:34:29 user nova-compute[75014]:   <uuid>fed0b54e-44cc-4f01-9511-e1993dcd4cec</uuid>
Nov 08 04:34:29 user nova-compute[75014]:   <name>instance-00000032</name>
Nov 08 04:34:29 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:34:29 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:34:29 user nova-compute[75014]:   <metadata>
Nov 08 04:34:29 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:34:29 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:34:29 user nova-compute[75014]:       <nova:name>tempest-TestVolumeBootPattern-server-439402672</nova:name>
Nov 08 04:34:29 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:34:28</nova:creationTime>
Nov 08 04:34:29 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:34:29 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:34:29 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:34:29 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:34:29 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:34:29 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:34:29 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:34:29 user nova-compute[75014]:       <nova:owner>
Nov 08 04:34:29 user nova-compute[75014]:         <nova:user uuid="fe1c5af56ab14da7986d64e38597d394">tempest-TestVolumeBootPattern-2082374398-project-member</nova:user>
Nov 08 04:34:29 user nova-compute[75014]:         <nova:project uuid="504ed2858e78480e9beef5aa5f5d9f1d">tempest-TestVolumeBootPattern-2082374398</nova:project>
Nov 08 04:34:29 user nova-compute[75014]:       </nova:owner>
Nov 08 04:34:29 user nova-compute[75014]:       <nova:ports>
Nov 08 04:34:29 user nova-compute[75014]:         <nova:port uuid="1caab5fb-eb55-48f9-8ede-4cc4f90546ae">
Nov 08 04:34:29 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 04:34:29 user nova-compute[75014]:         </nova:port>
Nov 08 04:34:29 user nova-compute[75014]:       </nova:ports>
Nov 08 04:34:29 user nova-compute[75014]:     </nova:instance>
Nov 08 04:34:29 user nova-compute[75014]:   </metadata>
Nov 08 04:34:29 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:34:29 user nova-compute[75014]:     <system>
Nov 08 04:34:29 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:34:29 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:34:29 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:34:29 user nova-compute[75014]:       <entry name="serial">fed0b54e-44cc-4f01-9511-e1993dcd4cec</entry>
Nov 08 04:34:29 user nova-compute[75014]:       <entry name="uuid">fed0b54e-44cc-4f01-9511-e1993dcd4cec</entry>
Nov 08 04:34:29 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:34:29 user nova-compute[75014]:     </system>
Nov 08 04:34:29 user nova-compute[75014]:   </sysinfo>
Nov 08 04:34:29 user nova-compute[75014]:   <os>
Nov 08 04:34:29 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:34:29 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:34:29 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:34:29 user nova-compute[75014]:   </os>
Nov 08 04:34:29 user nova-compute[75014]:   <features>
Nov 08 04:34:29 user nova-compute[75014]:     <acpi/>
Nov 08 04:34:29 user nova-compute[75014]:     <apic/>
Nov 08 04:34:29 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:34:29 user nova-compute[75014]:   </features>
Nov 08 04:34:29 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:34:29 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:34:29 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:34:29 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:34:29 user nova-compute[75014]:   </clock>
Nov 08 04:34:29 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:34:29 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:34:29 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:34:29 user nova-compute[75014]:   </cpu>
Nov 08 04:34:29 user nova-compute[75014]:   <devices>
Nov 08 04:34:29 user nova-compute[75014]:     <disk type="block" device="disk">
Nov 08 04:34:29 user nova-compute[75014]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:34:29 user nova-compute[75014]:       <source dev="/dev/sdb"/>
Nov 08 04:34:29 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:34:29 user nova-compute[75014]:       <serial>1e113de3-d43d-4e7d-9504-f6e36e86b93b</serial>
Nov 08 04:34:29 user nova-compute[75014]:     </disk>
Nov 08 04:34:29 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:34:29 user nova-compute[75014]:       <mac address="fa:16:3e:ae:c8:4f"/>
Nov 08 04:34:29 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:34:29 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:34:29 user nova-compute[75014]:       <target dev="tap1caab5fb-eb"/>
Nov 08 04:34:29 user nova-compute[75014]:     </interface>
Nov 08 04:34:29 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:34:29 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/fed0b54e-44cc-4f01-9511-e1993dcd4cec/console.log" append="off"/>
Nov 08 04:34:29 user nova-compute[75014]:     </serial>
Nov 08 04:34:29 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:34:29 user nova-compute[75014]:     <video>
Nov 08 04:34:29 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:34:29 user nova-compute[75014]:     </video>
Nov 08 04:34:29 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:34:29 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:34:29 user nova-compute[75014]:     </rng>
Nov 08 04:34:29 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:34:29 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:34:29 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:34:29 user nova-compute[75014]:     </memballoon>
Nov 08 04:34:29 user nova-compute[75014]:   </devices>
Nov 08 04:34:29 user nova-compute[75014]: </domain>
Nov 08 04:34:29 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:34:29 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:34:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-439402672',display_name='tempest-TestVolumeBootPattern-server-439402672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-439402672',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmCKJe2YKVTcf+XoP5PTLw5G8CWIzWuvlg190P9zWQdP0YW5BGT2gToDF2MbQudSeOvT17m8Vr6JpTpU4CWFLr0k+Sf3aulZ0b8jpBbd3H85eZBlYCQoTRoOdK8wj8DqQ==',key_name='tempest-TestVolumeBootPattern-1541162844',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='504ed2858e78480e9beef5aa5f5d9f1d',ramdisk_id='',reservation_id='r-ru4udg3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2082374398',owner_user_name='tempest-TestVolumeBootPattern-2082374398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:34:02Z,user_data=None,user_id='fe1c5af56ab14da7986d64e38597d394',uuid=fed0b54e-44cc-4f01-9511-e1993dcd4cec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1caab5fb-eb55-48f9-8ede-4cc4f90546ae", "address": "fa:16:3e:ae:c8:4f", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1caab5fb-eb", "ovs_interfaceid": "1caab5fb-eb55-48f9-8ede-4cc4f90546ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:34:29 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converting VIF {"id": "1caab5fb-eb55-48f9-8ede-4cc4f90546ae", "address": "fa:16:3e:ae:c8:4f", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1caab5fb-eb", "ovs_interfaceid": "1caab5fb-eb55-48f9-8ede-4cc4f90546ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:34:29 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:c8:4f,bridge_name='br-int',has_traffic_filtering=True,id=1caab5fb-eb55-48f9-8ede-4cc4f90546ae,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1caab5fb-eb') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:34:29 user nova-compute[75014]: DEBUG os_vif [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:c8:4f,bridge_name='br-int',has_traffic_filtering=True,id=1caab5fb-eb55-48f9-8ede-4cc4f90546ae,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1caab5fb-eb') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:34:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:34:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:34:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:34:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:34:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3d76e1b6-03b9-52c6-8fb2-f5d684ffac52', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:34:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:34:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:34:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:34:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1caab5fb-eb, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:34:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1caab5fb-eb, col_values=(('qos', UUID('92f2deb7-2e42-4e95-b288-a499e2bb3a21')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:34:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1caab5fb-eb, col_values=(('external_ids', {'iface-id': '1caab5fb-eb55-48f9-8ede-4cc4f90546ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:c8:4f', 'vm-uuid': 'fed0b54e-44cc-4f01-9511-e1993dcd4cec'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:34:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:34:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:34:29 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:34:29 user nova-compute[75014]: INFO os_vif [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:c8:4f,bridge_name='br-int',has_traffic_filtering=True,id=1caab5fb-eb55-48f9-8ede-4cc4f90546ae,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1caab5fb-eb')
Nov 08 04:34:29 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:34:29 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] No VIF found with MAC fa:16:3e:ae:c8:4f, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:34:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:34:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:34:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:34:31 user nova-compute[75014]: DEBUG nova.compute.manager [req-e4b74900-9b59-4cae-b01c-a91bbaf9dec0 req-5e256be1-7292-4de0-b5b6-419c7b9a8241 service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Received event network-vif-plugged-1caab5fb-eb55-48f9-8ede-4cc4f90546ae {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:34:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e4b74900-9b59-4cae-b01c-a91bbaf9dec0 req-5e256be1-7292-4de0-b5b6-419c7b9a8241 service nova] Acquiring lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:34:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e4b74900-9b59-4cae-b01c-a91bbaf9dec0 req-5e256be1-7292-4de0-b5b6-419c7b9a8241 service nova] Lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:34:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-e4b74900-9b59-4cae-b01c-a91bbaf9dec0 req-5e256be1-7292-4de0-b5b6-419c7b9a8241 service nova] Lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:34:31 user nova-compute[75014]: DEBUG nova.compute.manager [req-e4b74900-9b59-4cae-b01c-a91bbaf9dec0 req-5e256be1-7292-4de0-b5b6-419c7b9a8241 service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] No waiting events found dispatching network-vif-plugged-1caab5fb-eb55-48f9-8ede-4cc4f90546ae {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:34:31 user nova-compute[75014]: WARNING nova.compute.manager [req-e4b74900-9b59-4cae-b01c-a91bbaf9dec0 req-5e256be1-7292-4de0-b5b6-419c7b9a8241 service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Received unexpected event network-vif-plugged-1caab5fb-eb55-48f9-8ede-4cc4f90546ae for instance with vm_state building and task_state spawning.
Nov 08 04:34:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:34:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:34:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:34:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:34:32 user nova-compute[75014]: DEBUG nova.compute.manager [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:34:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 04:34:32 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Instance spawned successfully.
Nov 08 04:34:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 04:34:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:34:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:34:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:34:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:34:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:34:32 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:34:33 user nova-compute[75014]: INFO nova.compute.manager [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Took 4.99 seconds to spawn the instance on the hypervisor.
Nov 08 04:34:33 user nova-compute[75014]: DEBUG nova.compute.manager [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:34:33 user nova-compute[75014]: INFO nova.compute.manager [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Took 31.68 seconds to build instance.
Nov 08 04:34:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-c9e81f54-8a0e-47b8-998a-2126edfff5c1 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.773s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:34:33 user nova-compute[75014]: DEBUG nova.compute.manager [req-77f07ce3-5f90-4981-ad8c-5711993068c8 req-adb293a7-10c3-4559-ba3b-e1b1ebaaa5b4 service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Received event network-vif-plugged-1caab5fb-eb55-48f9-8ede-4cc4f90546ae {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:34:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-77f07ce3-5f90-4981-ad8c-5711993068c8 req-adb293a7-10c3-4559-ba3b-e1b1ebaaa5b4 service nova] Acquiring lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:34:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-77f07ce3-5f90-4981-ad8c-5711993068c8 req-adb293a7-10c3-4559-ba3b-e1b1ebaaa5b4 service nova] Lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:34:33 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-77f07ce3-5f90-4981-ad8c-5711993068c8 req-adb293a7-10c3-4559-ba3b-e1b1ebaaa5b4 service nova] Lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:34:33 user nova-compute[75014]: DEBUG nova.compute.manager [req-77f07ce3-5f90-4981-ad8c-5711993068c8 req-adb293a7-10c3-4559-ba3b-e1b1ebaaa5b4 service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] No waiting events found dispatching network-vif-plugged-1caab5fb-eb55-48f9-8ede-4cc4f90546ae {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:34:33 user nova-compute[75014]: WARNING nova.compute.manager [req-77f07ce3-5f90-4981-ad8c-5711993068c8 req-adb293a7-10c3-4559-ba3b-e1b1ebaaa5b4 service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Received unexpected event network-vif-plugged-1caab5fb-eb55-48f9-8ede-4cc4f90546ae for instance with vm_state active and task_state None.
Nov 08 04:34:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:34:34 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:34:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:34:39 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:34:44 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:34:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:34:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:34:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:34:54 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:34:54 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:34:54 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Rebuilding the list of instances to heal {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 04:34:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-fed0b54e-44cc-4f01-9511-e1993dcd4cec" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:34:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-fed0b54e-44cc-4f01-9511-e1993dcd4cec" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:34:54 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 04:34:54 user nova-compute[75014]: DEBUG nova.objects.instance [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lazy-loading 'info_cache' on Instance uuid fed0b54e-44cc-4f01-9511-e1993dcd4cec {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:34:54 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:34:54 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Updating instance_info_cache with network_info: [{"id": "1caab5fb-eb55-48f9-8ede-4cc4f90546ae", "address": "fa:16:3e:ae:c8:4f", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1caab5fb-eb", "ovs_interfaceid": "1caab5fb-eb55-48f9-8ede-4cc4f90546ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:34:54 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-fed0b54e-44cc-4f01-9511-e1993dcd4cec" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:34:54 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 04:34:57 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:34:58 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:34:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:34:59 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:01 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:35:03 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:35:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:07 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:35:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:09 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:12 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:35:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:35:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:35:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:35:12 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:35:12 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:35:12 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:35:12 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:35:12 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=8963MB free_disk=24.890892028808594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:35:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:35:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:35:12 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance fed0b54e-44cc-4f01-9511-e1993dcd4cec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:35:12 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:35:12 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:35:12 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:35:12 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:35:13 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:35:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:35:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:14 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:35:14 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Acquiring lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:35:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:35:14 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 04:35:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:35:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:35:14 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 04:35:14 user nova-compute[75014]: INFO nova.compute.claims [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Claim successful on node user
Nov 08 04:35:15 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:35:15 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:35:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.212s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:35:15 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 04:35:15 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 04:35:15 user nova-compute[75014]: DEBUG nova.network.neutron [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 04:35:15 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 04:35:15 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 04:35:15 user nova-compute[75014]: DEBUG nova.policy [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6c6fe73b52d4f72b92036c131288422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c156c92af64200879b568edc1eb84b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 04:35:15 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 04:35:15 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 04:35:15 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Creating image(s)
Nov 08 04:35:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:35:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lock "/opt/stack/data/nova/instances/0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:35:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lock "/opt/stack/data/nova/instances/0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:35:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:35:15 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:35:15 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:35:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.171s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:35:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Acquiring lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:35:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:35:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:35:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.175s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:35:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07/disk 1073741824 {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:35:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9,backing_fmt=raw /opt/stack/data/nova/instances/0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07/disk 1073741824" returned: 0 in 0.052s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:35:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lock "eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:35:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:35:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb8dd9b2e593e6f7b70aa7dc80ecf07a3b10c5b9 --force-share --output=json" returned: 0 in 0.172s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:35:15 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07/disk. size=1073741824 {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 04:35:15 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:35:15 user nova-compute[75014]: DEBUG nova.network.neutron [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Successfully created port: 2e81125e-06f2-4011-a714-6b34ce099a10 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.virt.disk.api [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Cannot resize image /opt/stack/data/nova/instances/0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07/disk to a smaller size. {{(pid=75014) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Created local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Ensure instance console log exists: /opt/stack/data/nova/instances/0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.network.neutron [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Successfully updated port: 2e81125e-06f2-4011-a714-6b34ce099a10 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Acquiring lock "refresh_cache-0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Acquired lock "refresh_cache-0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.network.neutron [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.compute.manager [req-a97d5865-b5f0-47e3-a063-933704efd2ae req-339d8758-a733-4a79-ac82-3df0944f736a service nova] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Received event network-changed-2e81125e-06f2-4011-a714-6b34ce099a10 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.compute.manager [req-a97d5865-b5f0-47e3-a063-933704efd2ae req-339d8758-a733-4a79-ac82-3df0944f736a service nova] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Refreshing instance network info cache due to event network-changed-2e81125e-06f2-4011-a714-6b34ce099a10. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a97d5865-b5f0-47e3-a063-933704efd2ae req-339d8758-a733-4a79-ac82-3df0944f736a service nova] Acquiring lock "refresh_cache-0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.network.neutron [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.network.neutron [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Updating instance_info_cache with network_info: [{"id": "2e81125e-06f2-4011-a714-6b34ce099a10", "address": "fa:16:3e:6b:75:31", "network": {"id": "f501c5fe-ea0d-4a7f-bf09-20ea559e620f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-715561519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c156c92af64200879b568edc1eb84b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e81125e-06", "ovs_interfaceid": "2e81125e-06f2-4011-a714-6b34ce099a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Releasing lock "refresh_cache-0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Instance network_info: |[{"id": "2e81125e-06f2-4011-a714-6b34ce099a10", "address": "fa:16:3e:6b:75:31", "network": {"id": "f501c5fe-ea0d-4a7f-bf09-20ea559e620f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-715561519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c156c92af64200879b568edc1eb84b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e81125e-06", "ovs_interfaceid": "2e81125e-06f2-4011-a714-6b34ce099a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a97d5865-b5f0-47e3-a063-933704efd2ae req-339d8758-a733-4a79-ac82-3df0944f736a service nova] Acquired lock "refresh_cache-0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.network.neutron [req-a97d5865-b5f0-47e3-a063-933704efd2ae req-339d8758-a733-4a79-ac82-3df0944f736a service nova] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Refreshing network info cache for port 2e81125e-06f2-4011-a714-6b34ce099a10 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Start _get_guest_xml network_info=[{"id": "2e81125e-06f2-4011-a714-6b34ce099a10", "address": "fa:16:3e:6b:75:31", "network": {"id": "f501c5fe-ea0d-4a7f-bf09-20ea559e620f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-715561519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c156c92af64200879b568edc1eb84b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e81125e-06", "ovs_interfaceid": "2e81125e-06f2-4011-a714-6b34ce099a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '877f8699-2084-427a-babd-cf4f98c3b417'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:35:16 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:35:16 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T03:45:43Z,direct_url=<?>,disk_format='qcow2',id=877f8699-2084-427a-babd-cf4f98c3b417,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c9ddfe8ede87470cacd18a271f68e9dc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T03:45:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1789059580',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1789059580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1789059',id=51,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgLGanremm00ChZu/k1iiX8r8HpcG9nR1ezfm8vxs7CsjTdD23nGKBkkh/RQQmZf6kRBwQQGnSOKL9fEi3VH4P52BXPFHz9+7OMbGe7NvuMSHnoZ0i3ju8XvzwQGtzGCA==',key_name='tempest-keypair-1217157374',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4c156c92af64200879b568edc1eb84b',ramdisk_id='',reservation_id='r-7kdpgh7f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1619007514',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:35:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6c6fe73b52d4f72b92036c131288422',uuid=0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e81125e-06f2-4011-a714-6b34ce099a10", "address": "fa:16:3e:6b:75:31", "network": {"id": "f501c5fe-ea0d-4a7f-bf09-20ea559e620f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-715561519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c156c92af64200879b568edc1eb84b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e81125e-06", "ovs_interfaceid": "2e81125e-06f2-4011-a714-6b34ce099a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Converting VIF {"id": "2e81125e-06f2-4011-a714-6b34ce099a10", "address": "fa:16:3e:6b:75:31", "network": {"id": "f501c5fe-ea0d-4a7f-bf09-20ea559e620f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-715561519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c156c92af64200879b568edc1eb84b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e81125e-06", "ovs_interfaceid": "2e81125e-06f2-4011-a714-6b34ce099a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:75:31,bridge_name='br-int',has_traffic_filtering=True,id=2e81125e-06f2-4011-a714-6b34ce099a10,network=Network(f501c5fe-ea0d-4a7f-bf09-20ea559e620f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e81125e-06') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.objects.instance [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:35:16 user nova-compute[75014]:   <uuid>0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07</uuid>
Nov 08 04:35:16 user nova-compute[75014]:   <name>instance-00000033</name>
Nov 08 04:35:16 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:35:16 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:35:16 user nova-compute[75014]:   <metadata>
Nov 08 04:35:16 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:35:16 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:35:16 user nova-compute[75014]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1789059580</nova:name>
Nov 08 04:35:16 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:35:16</nova:creationTime>
Nov 08 04:35:16 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:35:16 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:35:16 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:35:16 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:35:16 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:35:16 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:35:16 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:35:16 user nova-compute[75014]:       <nova:owner>
Nov 08 04:35:16 user nova-compute[75014]:         <nova:user uuid="c6c6fe73b52d4f72b92036c131288422">tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member</nova:user>
Nov 08 04:35:16 user nova-compute[75014]:         <nova:project uuid="f4c156c92af64200879b568edc1eb84b">tempest-TestServerVolumeAttachScenarioOldVersion-1619007514</nova:project>
Nov 08 04:35:16 user nova-compute[75014]:       </nova:owner>
Nov 08 04:35:16 user nova-compute[75014]:       <nova:root type="image" uuid="877f8699-2084-427a-babd-cf4f98c3b417"/>
Nov 08 04:35:16 user nova-compute[75014]:       <nova:ports>
Nov 08 04:35:16 user nova-compute[75014]:         <nova:port uuid="2e81125e-06f2-4011-a714-6b34ce099a10">
Nov 08 04:35:16 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 04:35:16 user nova-compute[75014]:         </nova:port>
Nov 08 04:35:16 user nova-compute[75014]:       </nova:ports>
Nov 08 04:35:16 user nova-compute[75014]:     </nova:instance>
Nov 08 04:35:16 user nova-compute[75014]:   </metadata>
Nov 08 04:35:16 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:35:16 user nova-compute[75014]:     <system>
Nov 08 04:35:16 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:35:16 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:35:16 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:35:16 user nova-compute[75014]:       <entry name="serial">0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07</entry>
Nov 08 04:35:16 user nova-compute[75014]:       <entry name="uuid">0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07</entry>
Nov 08 04:35:16 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:35:16 user nova-compute[75014]:     </system>
Nov 08 04:35:16 user nova-compute[75014]:   </sysinfo>
Nov 08 04:35:16 user nova-compute[75014]:   <os>
Nov 08 04:35:16 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:35:16 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:35:16 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:35:16 user nova-compute[75014]:   </os>
Nov 08 04:35:16 user nova-compute[75014]:   <features>
Nov 08 04:35:16 user nova-compute[75014]:     <acpi/>
Nov 08 04:35:16 user nova-compute[75014]:     <apic/>
Nov 08 04:35:16 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:35:16 user nova-compute[75014]:   </features>
Nov 08 04:35:16 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:35:16 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:35:16 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:35:16 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:35:16 user nova-compute[75014]:   </clock>
Nov 08 04:35:16 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:35:16 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:35:16 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:35:16 user nova-compute[75014]:   </cpu>
Nov 08 04:35:16 user nova-compute[75014]:   <devices>
Nov 08 04:35:16 user nova-compute[75014]:     <disk type="file" device="disk">
Nov 08 04:35:16 user nova-compute[75014]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 04:35:16 user nova-compute[75014]:       <source file="/opt/stack/data/nova/instances/0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07/disk"/>
Nov 08 04:35:16 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:35:16 user nova-compute[75014]:     </disk>
Nov 08 04:35:16 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:35:16 user nova-compute[75014]:       <mac address="fa:16:3e:6b:75:31"/>
Nov 08 04:35:16 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:35:16 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:35:16 user nova-compute[75014]:       <target dev="tap2e81125e-06"/>
Nov 08 04:35:16 user nova-compute[75014]:     </interface>
Nov 08 04:35:16 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:35:16 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07/console.log" append="off"/>
Nov 08 04:35:16 user nova-compute[75014]:     </serial>
Nov 08 04:35:16 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:35:16 user nova-compute[75014]:     <video>
Nov 08 04:35:16 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:35:16 user nova-compute[75014]:     </video>
Nov 08 04:35:16 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:35:16 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:35:16 user nova-compute[75014]:     </rng>
Nov 08 04:35:16 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:35:16 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:35:16 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:35:16 user nova-compute[75014]:     </memballoon>
Nov 08 04:35:16 user nova-compute[75014]:   </devices>
Nov 08 04:35:16 user nova-compute[75014]: </domain>
Nov 08 04:35:16 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1789059580',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1789059580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1789059',id=51,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgLGanremm00ChZu/k1iiX8r8HpcG9nR1ezfm8vxs7CsjTdD23nGKBkkh/RQQmZf6kRBwQQGnSOKL9fEi3VH4P52BXPFHz9+7OMbGe7NvuMSHnoZ0i3ju8XvzwQGtzGCA==',key_name='tempest-keypair-1217157374',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4c156c92af64200879b568edc1eb84b',ramdisk_id='',reservation_id='r-7kdpgh7f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1619007514',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:35:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6c6fe73b52d4f72b92036c131288422',uuid=0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e81125e-06f2-4011-a714-6b34ce099a10", "address": "fa:16:3e:6b:75:31", "network": {"id": "f501c5fe-ea0d-4a7f-bf09-20ea559e620f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-715561519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c156c92af64200879b568edc1eb84b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e81125e-06", "ovs_interfaceid": "2e81125e-06f2-4011-a714-6b34ce099a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Converting VIF {"id": "2e81125e-06f2-4011-a714-6b34ce099a10", "address": "fa:16:3e:6b:75:31", "network": {"id": "f501c5fe-ea0d-4a7f-bf09-20ea559e620f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-715561519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c156c92af64200879b568edc1eb84b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e81125e-06", "ovs_interfaceid": "2e81125e-06f2-4011-a714-6b34ce099a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:75:31,bridge_name='br-int',has_traffic_filtering=True,id=2e81125e-06f2-4011-a714-6b34ce099a10,network=Network(f501c5fe-ea0d-4a7f-bf09-20ea559e620f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e81125e-06') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG os_vif [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:75:31,bridge_name='br-int',has_traffic_filtering=True,id=2e81125e-06f2-4011-a714-6b34ce099a10,network=Network(f501c5fe-ea0d-4a7f-bf09-20ea559e620f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e81125e-06') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '823eedf2-becb-5cac-8110-416f8755bb80', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e81125e-06, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e81125e-06, col_values=(('qos', UUID('3d20a53a-178b-42d0-9327-05fac830ecbd')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e81125e-06, col_values=(('external_ids', {'iface-id': '2e81125e-06f2-4011-a714-6b34ce099a10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:75:31', 'vm-uuid': '0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:35:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:16 user nova-compute[75014]: INFO os_vif [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:75:31,bridge_name='br-int',has_traffic_filtering=True,id=2e81125e-06f2-4011-a714-6b34ce099a10,network=Network(f501c5fe-ea0d-4a7f-bf09-20ea559e620f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e81125e-06')
Nov 08 04:35:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:35:17 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] No VIF found with MAC fa:16:3e:6b:75:31, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:35:17 user nova-compute[75014]: DEBUG nova.network.neutron [req-a97d5865-b5f0-47e3-a063-933704efd2ae req-339d8758-a733-4a79-ac82-3df0944f736a service nova] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Updated VIF entry in instance network info cache for port 2e81125e-06f2-4011-a714-6b34ce099a10. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:35:17 user nova-compute[75014]: DEBUG nova.network.neutron [req-a97d5865-b5f0-47e3-a063-933704efd2ae req-339d8758-a733-4a79-ac82-3df0944f736a service nova] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Updating instance_info_cache with network_info: [{"id": "2e81125e-06f2-4011-a714-6b34ce099a10", "address": "fa:16:3e:6b:75:31", "network": {"id": "f501c5fe-ea0d-4a7f-bf09-20ea559e620f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-715561519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c156c92af64200879b568edc1eb84b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e81125e-06", "ovs_interfaceid": "2e81125e-06f2-4011-a714-6b34ce099a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:35:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a97d5865-b5f0-47e3-a063-933704efd2ae req-339d8758-a733-4a79-ac82-3df0944f736a service nova] Releasing lock "refresh_cache-0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:35:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:18 user nova-compute[75014]: DEBUG nova.compute.manager [req-7c41d135-6635-4120-9364-6db97090bb24 req-72d8c7e0-e8b0-4bdc-aba3-ac2bacf165cd service nova] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Received event network-vif-plugged-2e81125e-06f2-4011-a714-6b34ce099a10 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:35:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-7c41d135-6635-4120-9364-6db97090bb24 req-72d8c7e0-e8b0-4bdc-aba3-ac2bacf165cd service nova] Acquiring lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:35:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-7c41d135-6635-4120-9364-6db97090bb24 req-72d8c7e0-e8b0-4bdc-aba3-ac2bacf165cd service nova] Lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:35:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-7c41d135-6635-4120-9364-6db97090bb24 req-72d8c7e0-e8b0-4bdc-aba3-ac2bacf165cd service nova] Lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:35:18 user nova-compute[75014]: DEBUG nova.compute.manager [req-7c41d135-6635-4120-9364-6db97090bb24 req-72d8c7e0-e8b0-4bdc-aba3-ac2bacf165cd service nova] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] No waiting events found dispatching network-vif-plugged-2e81125e-06f2-4011-a714-6b34ce099a10 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:35:18 user nova-compute[75014]: WARNING nova.compute.manager [req-7c41d135-6635-4120-9364-6db97090bb24 req-72d8c7e0-e8b0-4bdc-aba3-ac2bacf165cd service nova] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Received unexpected event network-vif-plugged-2e81125e-06f2-4011-a714-6b34ce099a10 for instance with vm_state building and task_state spawning.
Nov 08 04:35:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:20 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:35:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 04:35:20 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Instance spawned successfully.
Nov 08 04:35:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 04:35:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:35:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:35:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:35:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:35:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:35:20 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:35:20 user nova-compute[75014]: INFO nova.compute.manager [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Took 5.42 seconds to spawn the instance on the hypervisor.
Nov 08 04:35:20 user nova-compute[75014]: DEBUG nova.compute.manager [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:35:20 user nova-compute[75014]: INFO nova.compute.manager [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Took 5.94 seconds to build instance.
Nov 08 04:35:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-8cdb0b4a-f52d-4c81-9176-16edef948d89 req-b36b38af-c05d-407e-9099-a51d4674f6e6 service nova] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Received event network-vif-plugged-2e81125e-06f2-4011-a714-6b34ce099a10 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:35:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8cdb0b4a-f52d-4c81-9176-16edef948d89 req-b36b38af-c05d-407e-9099-a51d4674f6e6 service nova] Acquiring lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:35:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8cdb0b4a-f52d-4c81-9176-16edef948d89 req-b36b38af-c05d-407e-9099-a51d4674f6e6 service nova] Lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:35:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-8cdb0b4a-f52d-4c81-9176-16edef948d89 req-b36b38af-c05d-407e-9099-a51d4674f6e6 service nova] Lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:35:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-8cdb0b4a-f52d-4c81-9176-16edef948d89 req-b36b38af-c05d-407e-9099-a51d4674f6e6 service nova] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] No waiting events found dispatching network-vif-plugged-2e81125e-06f2-4011-a714-6b34ce099a10 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:35:20 user nova-compute[75014]: WARNING nova.compute.manager [req-8cdb0b4a-f52d-4c81-9176-16edef948d89 req-b36b38af-c05d-407e-9099-a51d4674f6e6 service nova] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Received unexpected event network-vif-plugged-2e81125e-06f2-4011-a714-6b34ce099a10 for instance with vm_state active and task_state None.
Nov 08 04:35:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f80eb21c-d140-46a9-b541-1e34a3a12949 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.029s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:35:21 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:36 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:41 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:46 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:51 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:53 user nova-compute[75014]: DEBUG nova.compute.manager [req-217a2c13-8af8-40f0-9098-d8d92aa70b91 req-8f667425-96da-404a-a427-aa325cb41820 service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Received event network-changed-1caab5fb-eb55-48f9-8ede-4cc4f90546ae {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:35:53 user nova-compute[75014]: DEBUG nova.compute.manager [req-217a2c13-8af8-40f0-9098-d8d92aa70b91 req-8f667425-96da-404a-a427-aa325cb41820 service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Refreshing instance network info cache due to event network-changed-1caab5fb-eb55-48f9-8ede-4cc4f90546ae. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:35:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-217a2c13-8af8-40f0-9098-d8d92aa70b91 req-8f667425-96da-404a-a427-aa325cb41820 service nova] Acquiring lock "refresh_cache-fed0b54e-44cc-4f01-9511-e1993dcd4cec" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:35:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-217a2c13-8af8-40f0-9098-d8d92aa70b91 req-8f667425-96da-404a-a427-aa325cb41820 service nova] Acquired lock "refresh_cache-fed0b54e-44cc-4f01-9511-e1993dcd4cec" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:35:53 user nova-compute[75014]: DEBUG nova.network.neutron [req-217a2c13-8af8-40f0-9098-d8d92aa70b91 req-8f667425-96da-404a-a427-aa325cb41820 service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Refreshing network info cache for port 1caab5fb-eb55-48f9-8ede-4cc4f90546ae {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:35:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:53 user nova-compute[75014]: DEBUG nova.network.neutron [req-217a2c13-8af8-40f0-9098-d8d92aa70b91 req-8f667425-96da-404a-a427-aa325cb41820 service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Updated VIF entry in instance network info cache for port 1caab5fb-eb55-48f9-8ede-4cc4f90546ae. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:35:53 user nova-compute[75014]: DEBUG nova.network.neutron [req-217a2c13-8af8-40f0-9098-d8d92aa70b91 req-8f667425-96da-404a-a427-aa325cb41820 service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Updating instance_info_cache with network_info: [{"id": "1caab5fb-eb55-48f9-8ede-4cc4f90546ae", "address": "fa:16:3e:ae:c8:4f", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1caab5fb-eb", "ovs_interfaceid": "1caab5fb-eb55-48f9-8ede-4cc4f90546ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:35:53 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-217a2c13-8af8-40f0-9098-d8d92aa70b91 req-8f667425-96da-404a-a427-aa325cb41820 service nova] Releasing lock "refresh_cache-fed0b54e-44cc-4f01-9511-e1993dcd4cec" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:35:55 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:35:55 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:35:55 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Rebuilding the list of instances to heal {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 04:35:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-fed0b54e-44cc-4f01-9511-e1993dcd4cec" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:35:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-fed0b54e-44cc-4f01-9511-e1993dcd4cec" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:35:55 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 04:35:55 user nova-compute[75014]: DEBUG nova.objects.instance [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lazy-loading 'info_cache' on Instance uuid fed0b54e-44cc-4f01-9511-e1993dcd4cec {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:35:55 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Updating instance_info_cache with network_info: [{"id": "1caab5fb-eb55-48f9-8ede-4cc4f90546ae", "address": "fa:16:3e:ae:c8:4f", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1caab5fb-eb", "ovs_interfaceid": "1caab5fb-eb55-48f9-8ede-4cc4f90546ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:35:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-fed0b54e-44cc-4f01-9511-e1993dcd4cec" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:35:55 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 04:35:56 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:57 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:35:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:35:59 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:36:01 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:36:02 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:36:03 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:36:03 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:36:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:36:06 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:36:07 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:36:08 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:36:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:36:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "6b195315-c96d-44db-841f-916230b2863f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:36:11 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "6b195315-c96d-44db-841f-916230b2863f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:36:11 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Starting instance... {{(pid=75014) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 04:36:11 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75014) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 04:36:12 user nova-compute[75014]: INFO nova.compute.claims [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Claim successful on node user
Nov 08 04:36:12 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Refreshing inventories for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Updating ProviderTree inventory for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Updating inventory in ProviderTree for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Refreshing aggregate associations for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0, aggregates: None {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Refreshing trait associations for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Start building networks asynchronously for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Allocating IP information in the background. {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG nova.network.neutron [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] allocate_for_instance() {{(pid=75014) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 04:36:12 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 04:36:12 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Start building block device mappings for instance. {{(pid=75014) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG nova.policy [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe1c5af56ab14da7986d64e38597d394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504ed2858e78480e9beef5aa5f5d9f1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75014) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 04:36:12 user nova-compute[75014]: INFO nova.virt.block_device [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Booting with volume afd9ba1c-3745-4256-815f-1fb9bba5dcd3 at /dev/vda
Nov 08 04:36:12 user nova-compute[75014]: DEBUG os_brick.utils [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9d0437-70aa-43f9-b3b3-b95b2e1769ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c0ebb9-69db-4e21-ac39-e81a78378451]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79a2e80-896e-4ef5-8fa8-3a4059b3db34]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74b2f7a-a958-4f61-ad8e-a9a1ffa86d10]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:36:12 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:36:12 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[359e9e35-9f72-4ba6-a184-8b2e75f2c013]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG os_brick.utils [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:36:12 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Updating existing volume attachment record: 5e94d844-2fce-42b5-8144-8a85cdcc068c {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:36:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:36:13 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:36:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:36:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:36:13 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:36:13 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:36:13 user nova-compute[75014]: DEBUG nova.network.neutron [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Successfully created port: 5a3942f0-4e0f-4ae1-949e-f752c6cfe776 {{(pid=75014) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 04:36:13 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:36:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:36:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:36:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:36:13 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:36:14 user nova-compute[75014]: DEBUG nova.network.neutron [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Successfully updated port: 5a3942f0-4e0f-4ae1-949e-f752c6cfe776 {{(pid=75014) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 04:36:14 user nova-compute[75014]: DEBUG nova.compute.manager [req-b1e39dbb-ad97-4c46-a71b-c4fcca4a039b req-f38887c2-f048-4a47-a887-0c5cc9470c68 service nova] [instance: 6b195315-c96d-44db-841f-916230b2863f] Received event network-changed-5a3942f0-4e0f-4ae1-949e-f752c6cfe776 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:36:14 user nova-compute[75014]: DEBUG nova.compute.manager [req-b1e39dbb-ad97-4c46-a71b-c4fcca4a039b req-f38887c2-f048-4a47-a887-0c5cc9470c68 service nova] [instance: 6b195315-c96d-44db-841f-916230b2863f] Refreshing instance network info cache due to event network-changed-5a3942f0-4e0f-4ae1-949e-f752c6cfe776. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:36:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b1e39dbb-ad97-4c46-a71b-c4fcca4a039b req-f38887c2-f048-4a47-a887-0c5cc9470c68 service nova] Acquiring lock "refresh_cache-6b195315-c96d-44db-841f-916230b2863f" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:36:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b1e39dbb-ad97-4c46-a71b-c4fcca4a039b req-f38887c2-f048-4a47-a887-0c5cc9470c68 service nova] Acquired lock "refresh_cache-6b195315-c96d-44db-841f-916230b2863f" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:36:14 user nova-compute[75014]: DEBUG nova.network.neutron [req-b1e39dbb-ad97-4c46-a71b-c4fcca4a039b req-f38887c2-f048-4a47-a887-0c5cc9470c68 service nova] [instance: 6b195315-c96d-44db-841f-916230b2863f] Refreshing network info cache for port 5a3942f0-4e0f-4ae1-949e-f752c6cfe776 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:36:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "refresh_cache-6b195315-c96d-44db-841f-916230b2863f" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:36:14 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:36:14 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:36:14 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=8808MB free_disk=24.860755920410156GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:36:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:36:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:36:14 user nova-compute[75014]: DEBUG nova.network.neutron [req-b1e39dbb-ad97-4c46-a71b-c4fcca4a039b req-f38887c2-f048-4a47-a887-0c5cc9470c68 service nova] [instance: 6b195315-c96d-44db-841f-916230b2863f] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 04:36:14 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance fed0b54e-44cc-4f01-9511-e1993dcd4cec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:36:14 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:36:14 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 6b195315-c96d-44db-841f-916230b2863f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:36:14 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:36:14 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:36:14 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:36:14 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:36:14 user nova-compute[75014]: DEBUG nova.network.neutron [req-b1e39dbb-ad97-4c46-a71b-c4fcca4a039b req-f38887c2-f048-4a47-a887-0c5cc9470c68 service nova] [instance: 6b195315-c96d-44db-841f-916230b2863f] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:36:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-b1e39dbb-ad97-4c46-a71b-c4fcca4a039b req-f38887c2-f048-4a47-a887-0c5cc9470c68 service nova] Releasing lock "refresh_cache-6b195315-c96d-44db-841f-916230b2863f" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:36:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquired lock "refresh_cache-6b195315-c96d-44db-841f-916230b2863f" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:36:14 user nova-compute[75014]: DEBUG nova.network.neutron [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Building network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 04:36:14 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:36:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:36:14 user nova-compute[75014]: DEBUG nova.network.neutron [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Instance cache missing network info. {{(pid=75014) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 04:36:14 user nova-compute[75014]: DEBUG nova.network.neutron [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Updating instance_info_cache with network_info: [{"id": "5a3942f0-4e0f-4ae1-949e-f752c6cfe776", "address": "fa:16:3e:c8:94:ff", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3942f0-4e", "ovs_interfaceid": "5a3942f0-4e0f-4ae1-949e-f752c6cfe776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:36:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Releasing lock "refresh_cache-6b195315-c96d-44db-841f-916230b2863f" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:36:14 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Instance network_info: |[{"id": "5a3942f0-4e0f-4ae1-949e-f752c6cfe776", "address": "fa:16:3e:c8:94:ff", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3942f0-4e", "ovs_interfaceid": "5a3942f0-4e0f-4ae1-949e-f752c6cfe776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75014) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 04:36:16 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:36:16 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:36:16 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:36:16 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:36:21 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:36:23 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:36:23 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Cleaning up deleted instances {{(pid=75014) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 04:36:23 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] There are 0 instances to clean {{(pid=75014) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 04:36:26 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:36:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:36:31 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Start spawning the instance on the hypervisor. {{(pid=75014) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Creating instance directory {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 04:36:34 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Creating image(s)
Nov 08 04:36:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Did not create local disks {{(pid=75014) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Ensure instance console log exists: /opt/stack/data/nova/instances/6b195315-c96d-44db-841f-916230b2863f/console.log {{(pid=75014) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Start _get_guest_xml network_info=[{"id": "5a3942f0-4e0f-4ae1-949e-f752c6cfe776", "address": "fa:16:3e:c8:94:ff", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3942f0-4e", "ovs_interfaceid": "5a3942f0-4e0f-4ae1-949e-f752c6cfe776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SYCvcmED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6b195315-c96d-44db-841f-916230b2863f', 'attached_at': '', 'detached_at': '', 'volume_id': 'afd9ba1c-3745-4256-815f-1fb9bba5dcd3', 'serial': 'afd9ba1c-3745-4256-815f-1fb9bba5dcd3'}, 'device_type': 'disk', 'attachment_id': '5e94d844-2fce-42b5-8144-8a85cdcc068c', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 04:36:34 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:36:34 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:36:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] CPU controller missing on host. {{(pid=75014) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.host [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] CPU controller found on host. {{(pid=75014) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75014) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T03:45:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Flavor limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Image limits 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Flavor pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Image pref 0:0:0 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75014) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Got 1 possible topologies {{(pid=75014) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG nova.virt.hardware [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75014) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SYCvcmED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:36:34 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:36:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:36:34 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:36:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:36:34 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebd42d8-70b2-4094-954c-406675cb294b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:36:34 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e391f3b2-7098-4adb-8f7b-321fa3cf053b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3] added
Nov 08 04:36:34 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d2909b-146c-4757-a2e0-3b60683a46de]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d842a9d-d755-4a8a-b560-9cba9ffcbd1e]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SYCvcmED {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SYCvcmED" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f0b93a-3eb1-435c-a392-ac6bda589f62]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SYCvcmED'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be32ca3-3b39-48f1-90a2-985c89f29cf6]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b1423a-7375-429f-be0c-d9ac7065a32e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:36:34 user nova-compute[75014]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)
Nov 08 04:36:34 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:36:34 user nova-compute[75014]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)
Nov 08 04:36:34 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3919f998-edd6-47fd-89f3-86ccf3316efb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3, portal: 172.16.0.220,3260]
Nov 08 04:36:34 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3, portal: 172.16.0.220,3260] successful.
Nov 08 04:36:34 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d206fc20-6696-4d3b-b3ca-bf00cd8b9ccc]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d748a974-51e6-4473-87df-bb358c68b0e9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:36:34 user nova-compute[75014]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)
Nov 08 04:36:34 user nova-compute[75014]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 (non-flash)
Nov 08 04:36:34 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:36:34 user nova-compute[75014]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)
Nov 08 04:36:34 user nova-compute[75014]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 (non-flash)
Nov 08 04:36:34 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39d6bdd-0c94-4c9b-ba06-6fad66c16190]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:36:34 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SYCvcmED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:36:35 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:36:35 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26162663765393333', 'path': '/dev/sdc'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:36:35 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162663765393333', 'path': '/dev/sdc'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:36:35 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:36:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1351103690',display_name='tempest-TestVolumeBootPattern-server-1351103690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1351103690',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmCKJe2YKVTcf+XoP5PTLw5G8CWIzWuvlg190P9zWQdP0YW5BGT2gToDF2MbQudSeOvT17m8Vr6JpTpU4CWFLr0k+Sf3aulZ0b8jpBbd3H85eZBlYCQoTRoOdK8wj8DqQ==',key_name='tempest-TestVolumeBootPattern-1541162844',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='504ed2858e78480e9beef5aa5f5d9f1d',ramdisk_id='',reservation_id='r-vwcf380q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2082374398',owner_user_name='tempest-TestVolumeBootPattern-2082374398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:36:13Z,user_data=None,user_id='fe1c5af56ab14da7986d64e38597d394',uuid=6b195315-c96d-44db-841f-916230b2863f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a3942f0-4e0f-4ae1-949e-f752c6cfe776", "address": "fa:16:3e:c8:94:ff", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3942f0-4e", "ovs_interfaceid": "5a3942f0-4e0f-4ae1-949e-f752c6cfe776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75014) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 04:36:35 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converting VIF {"id": "5a3942f0-4e0f-4ae1-949e-f752c6cfe776", "address": "fa:16:3e:c8:94:ff", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3942f0-4e", "ovs_interfaceid": "5a3942f0-4e0f-4ae1-949e-f752c6cfe776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:36:35 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:94:ff,bridge_name='br-int',has_traffic_filtering=True,id=5a3942f0-4e0f-4ae1-949e-f752c6cfe776,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a3942f0-4e') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:36:35 user nova-compute[75014]: DEBUG nova.objects.instance [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b195315-c96d-44db-841f-916230b2863f {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:36:35 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] End _get_guest_xml xml=<domain type="kvm">
Nov 08 04:36:35 user nova-compute[75014]:   <uuid>6b195315-c96d-44db-841f-916230b2863f</uuid>
Nov 08 04:36:35 user nova-compute[75014]:   <name>instance-00000034</name>
Nov 08 04:36:35 user nova-compute[75014]:   <memory>524288</memory>
Nov 08 04:36:35 user nova-compute[75014]:   <vcpu>1</vcpu>
Nov 08 04:36:35 user nova-compute[75014]:   <metadata>
Nov 08 04:36:35 user nova-compute[75014]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 04:36:35 user nova-compute[75014]:       <nova:package version="0.0.0"/>
Nov 08 04:36:35 user nova-compute[75014]:       <nova:name>tempest-TestVolumeBootPattern-server-1351103690</nova:name>
Nov 08 04:36:35 user nova-compute[75014]:       <nova:creationTime>2023-11-08 04:36:34</nova:creationTime>
Nov 08 04:36:35 user nova-compute[75014]:       <nova:flavor name="m1.tiny">
Nov 08 04:36:35 user nova-compute[75014]:         <nova:memory>512</nova:memory>
Nov 08 04:36:35 user nova-compute[75014]:         <nova:disk>1</nova:disk>
Nov 08 04:36:35 user nova-compute[75014]:         <nova:swap>0</nova:swap>
Nov 08 04:36:35 user nova-compute[75014]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 04:36:35 user nova-compute[75014]:         <nova:vcpus>1</nova:vcpus>
Nov 08 04:36:35 user nova-compute[75014]:       </nova:flavor>
Nov 08 04:36:35 user nova-compute[75014]:       <nova:owner>
Nov 08 04:36:35 user nova-compute[75014]:         <nova:user uuid="fe1c5af56ab14da7986d64e38597d394">tempest-TestVolumeBootPattern-2082374398-project-member</nova:user>
Nov 08 04:36:35 user nova-compute[75014]:         <nova:project uuid="504ed2858e78480e9beef5aa5f5d9f1d">tempest-TestVolumeBootPattern-2082374398</nova:project>
Nov 08 04:36:35 user nova-compute[75014]:       </nova:owner>
Nov 08 04:36:35 user nova-compute[75014]:       <nova:ports>
Nov 08 04:36:35 user nova-compute[75014]:         <nova:port uuid="5a3942f0-4e0f-4ae1-949e-f752c6cfe776">
Nov 08 04:36:35 user nova-compute[75014]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 04:36:35 user nova-compute[75014]:         </nova:port>
Nov 08 04:36:35 user nova-compute[75014]:       </nova:ports>
Nov 08 04:36:35 user nova-compute[75014]:     </nova:instance>
Nov 08 04:36:35 user nova-compute[75014]:   </metadata>
Nov 08 04:36:35 user nova-compute[75014]:   <sysinfo type="smbios">
Nov 08 04:36:35 user nova-compute[75014]:     <system>
Nov 08 04:36:35 user nova-compute[75014]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 04:36:35 user nova-compute[75014]:       <entry name="product">OpenStack Nova</entry>
Nov 08 04:36:35 user nova-compute[75014]:       <entry name="version">0.0.0</entry>
Nov 08 04:36:35 user nova-compute[75014]:       <entry name="serial">6b195315-c96d-44db-841f-916230b2863f</entry>
Nov 08 04:36:35 user nova-compute[75014]:       <entry name="uuid">6b195315-c96d-44db-841f-916230b2863f</entry>
Nov 08 04:36:35 user nova-compute[75014]:       <entry name="family">Virtual Machine</entry>
Nov 08 04:36:35 user nova-compute[75014]:     </system>
Nov 08 04:36:35 user nova-compute[75014]:   </sysinfo>
Nov 08 04:36:35 user nova-compute[75014]:   <os>
Nov 08 04:36:35 user nova-compute[75014]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 04:36:35 user nova-compute[75014]:     <boot dev="hd"/>
Nov 08 04:36:35 user nova-compute[75014]:     <smbios mode="sysinfo"/>
Nov 08 04:36:35 user nova-compute[75014]:   </os>
Nov 08 04:36:35 user nova-compute[75014]:   <features>
Nov 08 04:36:35 user nova-compute[75014]:     <acpi/>
Nov 08 04:36:35 user nova-compute[75014]:     <apic/>
Nov 08 04:36:35 user nova-compute[75014]:     <vmcoreinfo/>
Nov 08 04:36:35 user nova-compute[75014]:   </features>
Nov 08 04:36:35 user nova-compute[75014]:   <clock offset="utc">
Nov 08 04:36:35 user nova-compute[75014]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 04:36:35 user nova-compute[75014]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 04:36:35 user nova-compute[75014]:     <timer name="hpet" present="no"/>
Nov 08 04:36:35 user nova-compute[75014]:   </clock>
Nov 08 04:36:35 user nova-compute[75014]:   <cpu mode="custom" match="exact">
Nov 08 04:36:35 user nova-compute[75014]:     <model>Nehalem</model>
Nov 08 04:36:35 user nova-compute[75014]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 04:36:35 user nova-compute[75014]:   </cpu>
Nov 08 04:36:35 user nova-compute[75014]:   <devices>
Nov 08 04:36:35 user nova-compute[75014]:     <disk type="block" device="disk">
Nov 08 04:36:35 user nova-compute[75014]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:36:35 user nova-compute[75014]:       <source dev="/dev/sdc"/>
Nov 08 04:36:35 user nova-compute[75014]:       <target dev="vda" bus="virtio"/>
Nov 08 04:36:35 user nova-compute[75014]:       <serial>afd9ba1c-3745-4256-815f-1fb9bba5dcd3</serial>
Nov 08 04:36:35 user nova-compute[75014]:     </disk>
Nov 08 04:36:35 user nova-compute[75014]:     <interface type="ethernet">
Nov 08 04:36:35 user nova-compute[75014]:       <mac address="fa:16:3e:c8:94:ff"/>
Nov 08 04:36:35 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:36:35 user nova-compute[75014]:       <mtu size="1442"/>
Nov 08 04:36:35 user nova-compute[75014]:       <target dev="tap5a3942f0-4e"/>
Nov 08 04:36:35 user nova-compute[75014]:     </interface>
Nov 08 04:36:35 user nova-compute[75014]:     <serial type="pty">
Nov 08 04:36:35 user nova-compute[75014]:       <log file="/opt/stack/data/nova/instances/6b195315-c96d-44db-841f-916230b2863f/console.log" append="off"/>
Nov 08 04:36:35 user nova-compute[75014]:     </serial>
Nov 08 04:36:35 user nova-compute[75014]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 04:36:35 user nova-compute[75014]:     <video>
Nov 08 04:36:35 user nova-compute[75014]:       <model type="virtio"/>
Nov 08 04:36:35 user nova-compute[75014]:     </video>
Nov 08 04:36:35 user nova-compute[75014]:     <rng model="virtio">
Nov 08 04:36:35 user nova-compute[75014]:       <backend model="random">/dev/urandom</backend>
Nov 08 04:36:35 user nova-compute[75014]:     </rng>
Nov 08 04:36:35 user nova-compute[75014]:     <controller type="usb" index="0" model="none"/>
Nov 08 04:36:35 user nova-compute[75014]:     <memballoon model="virtio">
Nov 08 04:36:35 user nova-compute[75014]:       <stats period="10"/>
Nov 08 04:36:35 user nova-compute[75014]:     </memballoon>
Nov 08 04:36:35 user nova-compute[75014]:   </devices>
Nov 08 04:36:35 user nova-compute[75014]: </domain>
Nov 08 04:36:35 user nova-compute[75014]:  {{(pid=75014) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 04:36:35 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:36:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1351103690',display_name='tempest-TestVolumeBootPattern-server-1351103690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1351103690',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmCKJe2YKVTcf+XoP5PTLw5G8CWIzWuvlg190P9zWQdP0YW5BGT2gToDF2MbQudSeOvT17m8Vr6JpTpU4CWFLr0k+Sf3aulZ0b8jpBbd3H85eZBlYCQoTRoOdK8wj8DqQ==',key_name='tempest-TestVolumeBootPattern-1541162844',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='504ed2858e78480e9beef5aa5f5d9f1d',ramdisk_id='',reservation_id='r-vwcf380q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2082374398',owner_user_name='tempest-TestVolumeBootPattern-2082374398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T04:36:13Z,user_data=None,user_id='fe1c5af56ab14da7986d64e38597d394',uuid=6b195315-c96d-44db-841f-916230b2863f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a3942f0-4e0f-4ae1-949e-f752c6cfe776", "address": "fa:16:3e:c8:94:ff", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3942f0-4e", "ovs_interfaceid": "5a3942f0-4e0f-4ae1-949e-f752c6cfe776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 04:36:35 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converting VIF {"id": "5a3942f0-4e0f-4ae1-949e-f752c6cfe776", "address": "fa:16:3e:c8:94:ff", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3942f0-4e", "ovs_interfaceid": "5a3942f0-4e0f-4ae1-949e-f752c6cfe776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:36:35 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:94:ff,bridge_name='br-int',has_traffic_filtering=True,id=5a3942f0-4e0f-4ae1-949e-f752c6cfe776,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a3942f0-4e') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:36:35 user nova-compute[75014]: DEBUG os_vif [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:94:ff,bridge_name='br-int',has_traffic_filtering=True,id=5a3942f0-4e0f-4ae1-949e-f752c6cfe776,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a3942f0-4e') {{(pid=75014) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 04:36:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:36:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:36:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 04:36:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:36:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd3ba4879-42d6-5849-bb3f-4640c4185109', '_type': 'linux-noop'}}, row=False) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:36:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:36:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:36:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:36:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a3942f0-4e, may_exist=True, interface_attrs={}) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:36:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a3942f0-4e, col_values=(('qos', UUID('51f31acd-5099-41a1-9a08-8fb61aff4b7a')),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:36:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a3942f0-4e, col_values=(('external_ids', {'iface-id': '5a3942f0-4e0f-4ae1-949e-f752c6cfe776', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:94:ff', 'vm-uuid': '6b195315-c96d-44db-841f-916230b2863f'}),), if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:36:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:36:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:36:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:36:35 user nova-compute[75014]: INFO os_vif [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:94:ff,bridge_name='br-int',has_traffic_filtering=True,id=5a3942f0-4e0f-4ae1-949e-f752c6cfe776,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a3942f0-4e')
Nov 08 04:36:35 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:36:35 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] No VIF found with MAC fa:16:3e:c8:94:ff, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:36:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:36:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:36:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:36:37 user nova-compute[75014]: DEBUG nova.compute.manager [req-ecf8272e-b044-47fd-bfb2-d8a855428eb1 req-1e5ca425-a1f0-4dd8-9e24-6428eac2564f service nova] [instance: 6b195315-c96d-44db-841f-916230b2863f] Received event network-vif-plugged-5a3942f0-4e0f-4ae1-949e-f752c6cfe776 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:36:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ecf8272e-b044-47fd-bfb2-d8a855428eb1 req-1e5ca425-a1f0-4dd8-9e24-6428eac2564f service nova] Acquiring lock "6b195315-c96d-44db-841f-916230b2863f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:36:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ecf8272e-b044-47fd-bfb2-d8a855428eb1 req-1e5ca425-a1f0-4dd8-9e24-6428eac2564f service nova] Lock "6b195315-c96d-44db-841f-916230b2863f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:36:37 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-ecf8272e-b044-47fd-bfb2-d8a855428eb1 req-1e5ca425-a1f0-4dd8-9e24-6428eac2564f service nova] Lock "6b195315-c96d-44db-841f-916230b2863f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:36:37 user nova-compute[75014]: DEBUG nova.compute.manager [req-ecf8272e-b044-47fd-bfb2-d8a855428eb1 req-1e5ca425-a1f0-4dd8-9e24-6428eac2564f service nova] [instance: 6b195315-c96d-44db-841f-916230b2863f] No waiting events found dispatching network-vif-plugged-5a3942f0-4e0f-4ae1-949e-f752c6cfe776 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:36:37 user nova-compute[75014]: WARNING nova.compute.manager [req-ecf8272e-b044-47fd-bfb2-d8a855428eb1 req-1e5ca425-a1f0-4dd8-9e24-6428eac2564f service nova] [instance: 6b195315-c96d-44db-841f-916230b2863f] Received unexpected event network-vif-plugged-5a3942f0-4e0f-4ae1-949e-f752c6cfe776 for instance with vm_state building and task_state spawning.
Nov 08 04:36:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:36:37 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:36:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:36:39 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Instance event wait completed in 0 seconds for  {{(pid=75014) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 04:36:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Guest created on hypervisor {{(pid=75014) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 04:36:39 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 6b195315-c96d-44db-841f-916230b2863f] Instance spawned successfully.
Nov 08 04:36:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 04:36:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Found default for hw_cdrom_bus of ide {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:36:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Found default for hw_disk_bus of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:36:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Found default for hw_input_bus of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:36:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Found default for hw_pointer_model of None {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:36:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Found default for hw_video_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:36:39 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Found default for hw_vif_model of virtio {{(pid=75014) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 04:36:39 user nova-compute[75014]: INFO nova.compute.manager [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Took 4.86 seconds to spawn the instance on the hypervisor.
Nov 08 04:36:39 user nova-compute[75014]: DEBUG nova.compute.manager [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Checking state {{(pid=75014) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 04:36:39 user nova-compute[75014]: DEBUG nova.compute.manager [req-767a3da0-b9a1-421f-8302-d063c560bc30 req-c1129500-0e27-4e2c-b0e2-aa408e1c4e7a service nova] [instance: 6b195315-c96d-44db-841f-916230b2863f] Received event network-vif-plugged-5a3942f0-4e0f-4ae1-949e-f752c6cfe776 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:36:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-767a3da0-b9a1-421f-8302-d063c560bc30 req-c1129500-0e27-4e2c-b0e2-aa408e1c4e7a service nova] Acquiring lock "6b195315-c96d-44db-841f-916230b2863f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:36:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-767a3da0-b9a1-421f-8302-d063c560bc30 req-c1129500-0e27-4e2c-b0e2-aa408e1c4e7a service nova] Lock "6b195315-c96d-44db-841f-916230b2863f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:36:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-767a3da0-b9a1-421f-8302-d063c560bc30 req-c1129500-0e27-4e2c-b0e2-aa408e1c4e7a service nova] Lock "6b195315-c96d-44db-841f-916230b2863f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:36:39 user nova-compute[75014]: DEBUG nova.compute.manager [req-767a3da0-b9a1-421f-8302-d063c560bc30 req-c1129500-0e27-4e2c-b0e2-aa408e1c4e7a service nova] [instance: 6b195315-c96d-44db-841f-916230b2863f] No waiting events found dispatching network-vif-plugged-5a3942f0-4e0f-4ae1-949e-f752c6cfe776 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:36:39 user nova-compute[75014]: WARNING nova.compute.manager [req-767a3da0-b9a1-421f-8302-d063c560bc30 req-c1129500-0e27-4e2c-b0e2-aa408e1c4e7a service nova] [instance: 6b195315-c96d-44db-841f-916230b2863f] Received unexpected event network-vif-plugged-5a3942f0-4e0f-4ae1-949e-f752c6cfe776 for instance with vm_state building and task_state spawning.
Nov 08 04:36:39 user nova-compute[75014]: INFO nova.compute.manager [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Took 27.46 seconds to build instance.
Nov 08 04:36:39 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-7f7be652-a7fd-4240-8683-d5d53f530075 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "6b195315-c96d-44db-841f-916230b2863f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.562s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:36:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:36:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:36:47 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:36:47 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=75014) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 04:36:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:36:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:36:55 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:36:55 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:36:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:36:55 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:36:55 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 04:36:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:36:56 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Updating instance_info_cache with network_info: [{"id": "2e81125e-06f2-4011-a714-6b34ce099a10", "address": "fa:16:3e:6b:75:31", "network": {"id": "f501c5fe-ea0d-4a7f-bf09-20ea559e620f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-715561519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c156c92af64200879b568edc1eb84b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e81125e-06", "ovs_interfaceid": "2e81125e-06f2-4011-a714-6b34ce099a10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:36:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:36:56 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 04:36:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:36:59 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:36:59 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:37:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:37:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:37:04 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:37:05 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:37:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:37:05 user nova-compute[75014]: DEBUG nova.compute.manager [req-a49c6058-da66-4b42-8d00-65f871dd99bc req-f3f3070f-2418-4088-a50e-dff720abf700 service nova] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Received event network-changed-2e81125e-06f2-4011-a714-6b34ce099a10 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:37:05 user nova-compute[75014]: DEBUG nova.compute.manager [req-a49c6058-da66-4b42-8d00-65f871dd99bc req-f3f3070f-2418-4088-a50e-dff720abf700 service nova] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Refreshing instance network info cache due to event network-changed-2e81125e-06f2-4011-a714-6b34ce099a10. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:37:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a49c6058-da66-4b42-8d00-65f871dd99bc req-f3f3070f-2418-4088-a50e-dff720abf700 service nova] Acquiring lock "refresh_cache-0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:37:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a49c6058-da66-4b42-8d00-65f871dd99bc req-f3f3070f-2418-4088-a50e-dff720abf700 service nova] Acquired lock "refresh_cache-0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:37:05 user nova-compute[75014]: DEBUG nova.network.neutron [req-a49c6058-da66-4b42-8d00-65f871dd99bc req-f3f3070f-2418-4088-a50e-dff720abf700 service nova] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Refreshing network info cache for port 2e81125e-06f2-4011-a714-6b34ce099a10 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:37:06 user nova-compute[75014]: DEBUG nova.network.neutron [req-a49c6058-da66-4b42-8d00-65f871dd99bc req-f3f3070f-2418-4088-a50e-dff720abf700 service nova] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Updated VIF entry in instance network info cache for port 2e81125e-06f2-4011-a714-6b34ce099a10. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:37:06 user nova-compute[75014]: DEBUG nova.network.neutron [req-a49c6058-da66-4b42-8d00-65f871dd99bc req-f3f3070f-2418-4088-a50e-dff720abf700 service nova] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Updating instance_info_cache with network_info: [{"id": "2e81125e-06f2-4011-a714-6b34ce099a10", "address": "fa:16:3e:6b:75:31", "network": {"id": "f501c5fe-ea0d-4a7f-bf09-20ea559e620f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-715561519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c156c92af64200879b568edc1eb84b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e81125e-06", "ovs_interfaceid": "2e81125e-06f2-4011-a714-6b34ce099a10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:37:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-a49c6058-da66-4b42-8d00-65f871dd99bc req-f3f3070f-2418-4088-a50e-dff720abf700 service nova] Releasing lock "refresh_cache-0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:37:07 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:37:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:37:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:37:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Acquiring lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:37:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:37:12 user nova-compute[75014]: DEBUG nova.objects.instance [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lazy-loading 'flavor' on Instance uuid 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:37:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:37:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Acquiring lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:37:12 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:37:12 user nova-compute[75014]: INFO nova.compute.manager [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Attaching volume 157664c7-9978-4b66-843b-d636e68467d1 to /dev/vdb
Nov 08 04:37:12 user nova-compute[75014]: DEBUG os_brick.utils [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:37:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:37:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:37:12 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efad801-5f1e-473b-bb35-ee3394145f9b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f828f99cf7c\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:37:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:37:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:37:12 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b737d20-6be2-45f7-9fd2-be28442d4646]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:37:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:37:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:37:12 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6782bc4-bfd2-4a4d-b2cb-d7a91b6ef7e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:37:12 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[40116718-9a27-4b98-a66f-7f038536a4ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:37:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Running cmd (subprocess): nvme version {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:37:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] 'nvme version' failed. Not Retrying. {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:37:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] nvme not present on system {{(pid=75014) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 04:37:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:37:12 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 04:37:12 user nova-compute[75014]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 04:37:12 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f321c6-af8d-4dd4-8754-ed73c19f0349]: (4, '') {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:37:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75014) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 04:37:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 04:37:12 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.lightos [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] LIGHTOS: no hostnqn found. {{(pid=75014) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 04:37:12 user nova-compute[75014]: DEBUG os_brick.utils [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f828f99cf7c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:37:12 user nova-compute[75014]: DEBUG nova.virt.block_device [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Updating existing volume attachment record: 449e1e2b-9d95-4d0a-952f-c3fb49d6eac3 {{(pid=75014) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 04:37:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:37:14 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:37:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:37:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:37:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:37:14 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:37:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:37:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:37:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:37:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:37:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:37:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:37:15 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:37:15 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:37:15 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=8742MB free_disk=24.859046936035156GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:37:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:37:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:37:15 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance fed0b54e-44cc-4f01-9511-e1993dcd4cec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:37:15 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:37:15 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 6b195315-c96d-44db-841f-916230b2863f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:37:15 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:37:15 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:37:15 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:37:15 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:37:15 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:37:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.253s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:37:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:37:16 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:37:16 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:37:16 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:37:20 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:37:20 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:37:20 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:37:20 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:37:20 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:37:20 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:37:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:37:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:37:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:37:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:37:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:37:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:37:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:37:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:37:31 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_power_states {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:37:31 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid fed0b54e-44cc-4f01-9511-e1993dcd4cec {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 04:37:31 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07 {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 04:37:31 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Triggering sync for uuid 6b195315-c96d-44db-841f-916230b2863f {{(pid=75014) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 04:37:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:37:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:37:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:37:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "6b195315-c96d-44db-841f-916230b2863f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:37:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "6b195315-c96d-44db-841f-916230b2863f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:37:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:37:31 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "6b195315-c96d-44db-841f-916230b2863f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:37:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:37:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:37:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Calling os-brick to attach iSCSI Volume {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjtXpbLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:37:45 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:37:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:37:45 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:37:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:37:45 user nova-compute[75014]: INFO os_brick.initiator.connectors.iscsi [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1 -p 172.16.0.220:3260 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[94825575-735f-47bc-a28f-b11fd62c1702]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 04:37:45 user nova-compute[75014]:  {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfb401d-52c6-4f61-95bb-4520b30d2169]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1] added\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1] added
Nov 08 04:37:45 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[699d578f-362a-412d-8156-78c6b53c7519]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5955b81-4dc1-43ea-91de-001ef867e0f3]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zjtXpbLn {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zjtXpbLn" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2aa0ab-4870-488f-8f0d-ea2641ccdfcf]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zjtXpbLn'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72cef57-9245-4cbc-ba17-0d3fe011a63f]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b759b9-ddbb-493c-ba4c-5473d7f8805d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:37:45 user nova-compute[75014]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)
Nov 08 04:37:45 user nova-compute[75014]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 (non-flash)
Nov 08 04:37:45 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:37:45 user nova-compute[75014]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)
Nov 08 04:37:45 user nova-compute[75014]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 (non-flash)
Nov 08 04:37:45 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1 -p 172.16.0.220:3260 --login {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1361d547-3118-4f91-ab92-ed1978a3cc84]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1, portal: 172.16.0.220,3260]
Nov 08 04:37:45 user nova-compute[75014]: Login to [iface: default, target: iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1, portal: 172.16.0.220,3260] successful.
Nov 08 04:37:45 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bd633c-7513-49b5-a7f0-30c0af3b82f5]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bc18db-8e5f-4a51-9e0b-9fd9638075dd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:37:45 user nova-compute[75014]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)
Nov 08 04:37:45 user nova-compute[75014]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 (non-flash)
Nov 08 04:37:45 user nova-compute[75014]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1 (non-flash)
Nov 08 04:37:45 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:37:45 user nova-compute[75014]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)
Nov 08 04:37:45 user nova-compute[75014]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 (non-flash)
Nov 08 04:37:45 user nova-compute[75014]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1 (non-flash)
Nov 08 04:37:45 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Connected to 172.16.0.220:3260 {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] HCTL ('35', '-', '-', 0) found on session 54 with lun 0 {{(pid=75014) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75014) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bd4012-2a31-440e-a65b-74c33a198852]: (4, ('- - 0', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: None {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:37:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:37:46 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75014) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 04:37:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjtXpbLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75014) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 04:37:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:37:46 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23261366630323336', 'path': '/dev/sdd'} {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:37:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261366630323336', 'path': '/dev/sdd'} {{(pid=75014) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 04:37:46 user nova-compute[75014]: DEBUG nova.objects.instance [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lazy-loading 'flavor' on Instance uuid 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:37:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 04:37:46 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:37:46 user nova-compute[75014]:   <source dev="/dev/sdd"/>
Nov 08 04:37:46 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:37:46 user nova-compute[75014]:   <serial>157664c7-9978-4b66-843b-d636e68467d1</serial>
Nov 08 04:37:46 user nova-compute[75014]: </disk>
Nov 08 04:37:46 user nova-compute[75014]:  {{(pid=75014) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 04:37:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] No BDM found with device name vda, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:37:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75014) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 04:37:46 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] No VIF found with MAC fa:16:3e:6b:75:31, not building metadata {{(pid=75014) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 04:37:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2ef9e7f3-d02b-4005-98d8-f3ab756fbd22 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 34.405s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:37:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 15.504s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:37:47 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:37:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Acquiring lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:37:48 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:37:48 user nova-compute[75014]: INFO nova.compute.manager [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Detaching volume 157664c7-9978-4b66-843b-d636e68467d1
Nov 08 04:37:48 user nova-compute[75014]: INFO nova.virt.block_device [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Attempting to driver detach volume 157664c7-9978-4b66-843b-d636e68467d1 from mountpoint /dev/vdb
Nov 08 04:37:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Attempting to detach device vdb from instance 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07 from the persistent domain config. {{(pid=75014) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 04:37:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:37:48 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:37:48 user nova-compute[75014]:   <source dev="/dev/sdd"/>
Nov 08 04:37:48 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:37:48 user nova-compute[75014]:   <serial>157664c7-9978-4b66-843b-d636e68467d1</serial>
Nov 08 04:37:48 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:37:48 user nova-compute[75014]: </disk>
Nov 08 04:37:48 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:37:48 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Successfully detached device vdb from instance 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07 from the persistent domain config.
Nov 08 04:37:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07 from the live domain config. {{(pid=75014) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 04:37:48 user nova-compute[75014]: DEBUG nova.virt.libvirt.guest [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 04:37:48 user nova-compute[75014]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 04:37:48 user nova-compute[75014]:   <source dev="/dev/sdd"/>
Nov 08 04:37:48 user nova-compute[75014]:   <target dev="vdb" bus="virtio"/>
Nov 08 04:37:48 user nova-compute[75014]:   <serial>157664c7-9978-4b66-843b-d636e68467d1</serial>
Nov 08 04:37:48 user nova-compute[75014]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 04:37:48 user nova-compute[75014]: </disk>
Nov 08 04:37:48 user nova-compute[75014]:  {{(pid=75014) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 04:37:49 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07 {{(pid=75014) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 04:37:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:37:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:37:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:37:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:37:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:37:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:37:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:37:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:37:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:37:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:37:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:37:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:37:56 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:37:56 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:37:56 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Rebuilding the list of instances to heal {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 04:37:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "refresh_cache-fed0b54e-44cc-4f01-9511-e1993dcd4cec" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:37:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquired lock "refresh_cache-fed0b54e-44cc-4f01-9511-e1993dcd4cec" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:37:56 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Forcefully refreshing network info cache for instance {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 04:37:56 user nova-compute[75014]: DEBUG nova.objects.instance [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lazy-loading 'info_cache' on Instance uuid fed0b54e-44cc-4f01-9511-e1993dcd4cec {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:37:56 user nova-compute[75014]: DEBUG nova.network.neutron [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Updating instance_info_cache with network_info: [{"id": "1caab5fb-eb55-48f9-8ede-4cc4f90546ae", "address": "fa:16:3e:ae:c8:4f", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1caab5fb-eb", "ovs_interfaceid": "1caab5fb-eb55-48f9-8ede-4cc4f90546ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:37:56 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Releasing lock "refresh_cache-fed0b54e-44cc-4f01-9511-e1993dcd4cec" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:37:56 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Updated the network info_cache for instance {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 04:37:59 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:38:00 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:38:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:38:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:38:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:38:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:38:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:38:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:38:02 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:38:03 user nova-compute[75014]: DEBUG nova.compute.manager [req-867de8dd-fbe2-44a3-aed1-61d91d3383c0 req-a09ffd16-d030-4550-bc96-bff09cf0cfb9 service nova] [instance: 6b195315-c96d-44db-841f-916230b2863f] Received event network-changed-5a3942f0-4e0f-4ae1-949e-f752c6cfe776 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:38:03 user nova-compute[75014]: DEBUG nova.compute.manager [req-867de8dd-fbe2-44a3-aed1-61d91d3383c0 req-a09ffd16-d030-4550-bc96-bff09cf0cfb9 service nova] [instance: 6b195315-c96d-44db-841f-916230b2863f] Refreshing instance network info cache due to event network-changed-5a3942f0-4e0f-4ae1-949e-f752c6cfe776. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:38:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-867de8dd-fbe2-44a3-aed1-61d91d3383c0 req-a09ffd16-d030-4550-bc96-bff09cf0cfb9 service nova] Acquiring lock "refresh_cache-6b195315-c96d-44db-841f-916230b2863f" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:38:03 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-867de8dd-fbe2-44a3-aed1-61d91d3383c0 req-a09ffd16-d030-4550-bc96-bff09cf0cfb9 service nova] Acquired lock "refresh_cache-6b195315-c96d-44db-841f-916230b2863f" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:38:03 user nova-compute[75014]: DEBUG nova.network.neutron [req-867de8dd-fbe2-44a3-aed1-61d91d3383c0 req-a09ffd16-d030-4550-bc96-bff09cf0cfb9 service nova] [instance: 6b195315-c96d-44db-841f-916230b2863f] Refreshing network info cache for port 5a3942f0-4e0f-4ae1-949e-f752c6cfe776 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:38:04 user nova-compute[75014]: DEBUG nova.network.neutron [req-867de8dd-fbe2-44a3-aed1-61d91d3383c0 req-a09ffd16-d030-4550-bc96-bff09cf0cfb9 service nova] [instance: 6b195315-c96d-44db-841f-916230b2863f] Updated VIF entry in instance network info cache for port 5a3942f0-4e0f-4ae1-949e-f752c6cfe776. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:38:04 user nova-compute[75014]: DEBUG nova.network.neutron [req-867de8dd-fbe2-44a3-aed1-61d91d3383c0 req-a09ffd16-d030-4550-bc96-bff09cf0cfb9 service nova] [instance: 6b195315-c96d-44db-841f-916230b2863f] Updating instance_info_cache with network_info: [{"id": "5a3942f0-4e0f-4ae1-949e-f752c6cfe776", "address": "fa:16:3e:c8:94:ff", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3942f0-4e", "ovs_interfaceid": "5a3942f0-4e0f-4ae1-949e-f752c6cfe776", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:38:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-867de8dd-fbe2-44a3-aed1-61d91d3383c0 req-a09ffd16-d030-4550-bc96-bff09cf0cfb9 service nova] Releasing lock "refresh_cache-6b195315-c96d-44db-841f-916230b2863f" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:38:04 user nova-compute[75014]: DEBUG nova.compute.manager [req-de6ead79-a1b5-4e54-abec-35c67ec83d8b req-efa2dd5e-7130-43b5-bce9-6bcfb55c7416 service nova] [instance: 6b195315-c96d-44db-841f-916230b2863f] Received event network-changed-5a3942f0-4e0f-4ae1-949e-f752c6cfe776 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:38:04 user nova-compute[75014]: DEBUG nova.compute.manager [req-de6ead79-a1b5-4e54-abec-35c67ec83d8b req-efa2dd5e-7130-43b5-bce9-6bcfb55c7416 service nova] [instance: 6b195315-c96d-44db-841f-916230b2863f] Refreshing instance network info cache due to event network-changed-5a3942f0-4e0f-4ae1-949e-f752c6cfe776. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:38:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-de6ead79-a1b5-4e54-abec-35c67ec83d8b req-efa2dd5e-7130-43b5-bce9-6bcfb55c7416 service nova] Acquiring lock "refresh_cache-6b195315-c96d-44db-841f-916230b2863f" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:38:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-de6ead79-a1b5-4e54-abec-35c67ec83d8b req-efa2dd5e-7130-43b5-bce9-6bcfb55c7416 service nova] Acquired lock "refresh_cache-6b195315-c96d-44db-841f-916230b2863f" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:38:04 user nova-compute[75014]: DEBUG nova.network.neutron [req-de6ead79-a1b5-4e54-abec-35c67ec83d8b req-efa2dd5e-7130-43b5-bce9-6bcfb55c7416 service nova] [instance: 6b195315-c96d-44db-841f-916230b2863f] Refreshing network info cache for port 5a3942f0-4e0f-4ae1-949e-f752c6cfe776 {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:38:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "6b195315-c96d-44db-841f-916230b2863f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:38:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "6b195315-c96d-44db-841f-916230b2863f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:38:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "6b195315-c96d-44db-841f-916230b2863f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:38:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "6b195315-c96d-44db-841f-916230b2863f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:38:04 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "6b195315-c96d-44db-841f-916230b2863f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:38:04 user nova-compute[75014]: INFO nova.compute.manager [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Terminating instance
Nov 08 04:38:04 user nova-compute[75014]: DEBUG nova.compute.manager [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:38:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:38:04 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG nova.network.neutron [req-de6ead79-a1b5-4e54-abec-35c67ec83d8b req-efa2dd5e-7130-43b5-bce9-6bcfb55c7416 service nova] [instance: 6b195315-c96d-44db-841f-916230b2863f] Updated VIF entry in instance network info cache for port 5a3942f0-4e0f-4ae1-949e-f752c6cfe776. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG nova.network.neutron [req-de6ead79-a1b5-4e54-abec-35c67ec83d8b req-efa2dd5e-7130-43b5-bce9-6bcfb55c7416 service nova] [instance: 6b195315-c96d-44db-841f-916230b2863f] Updating instance_info_cache with network_info: [{"id": "5a3942f0-4e0f-4ae1-949e-f752c6cfe776", "address": "fa:16:3e:c8:94:ff", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3942f0-4e", "ovs_interfaceid": "5a3942f0-4e0f-4ae1-949e-f752c6cfe776", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-de6ead79-a1b5-4e54-abec-35c67ec83d8b req-efa2dd5e-7130-43b5-bce9-6bcfb55c7416 service nova] Releasing lock "refresh_cache-6b195315-c96d-44db-841f-916230b2863f" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:38:05 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 6b195315-c96d-44db-841f-916230b2863f] Instance destroyed successfully.
Nov 08 04:38:05 user nova-compute[75014]: DEBUG nova.objects.instance [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lazy-loading 'resources' on Instance uuid 6b195315-c96d-44db-841f-916230b2863f {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:36:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1351103690',display_name='tempest-TestVolumeBootPattern-server-1351103690',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1351103690',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmCKJe2YKVTcf+XoP5PTLw5G8CWIzWuvlg190P9zWQdP0YW5BGT2gToDF2MbQudSeOvT17m8Vr6JpTpU4CWFLr0k+Sf3aulZ0b8jpBbd3H85eZBlYCQoTRoOdK8wj8DqQ==',key_name='tempest-TestVolumeBootPattern-1541162844',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:36:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='504ed2858e78480e9beef5aa5f5d9f1d',ramdisk_id='',reservation_id='r-vwcf380q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2082374398',owner_user_name='tempest-TestVolumeBootPattern-2082374398-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:36:39Z,user_data=None,user_id='fe1c5af56ab14da7986d64e38597d394',uuid=6b195315-c96d-44db-841f-916230b2863f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a3942f0-4e0f-4ae1-949e-f752c6cfe776", "address": "fa:16:3e:c8:94:ff", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3942f0-4e", "ovs_interfaceid": "5a3942f0-4e0f-4ae1-949e-f752c6cfe776", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converting VIF {"id": "5a3942f0-4e0f-4ae1-949e-f752c6cfe776", "address": "fa:16:3e:c8:94:ff", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3942f0-4e", "ovs_interfaceid": "5a3942f0-4e0f-4ae1-949e-f752c6cfe776", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:94:ff,bridge_name='br-int',has_traffic_filtering=True,id=5a3942f0-4e0f-4ae1-949e-f752c6cfe776,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a3942f0-4e') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG os_vif [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:94:ff,bridge_name='br-int',has_traffic_filtering=True,id=5a3942f0-4e0f-4ae1-949e-f752c6cfe776,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a3942f0-4e') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a3942f0-4e, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=51f31acd-5099-41a1-9a08-8fb61aff4b7a) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:38:05 user nova-compute[75014]: INFO os_vif [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:94:ff,bridge_name='br-int',has_traffic_filtering=True,id=5a3942f0-4e0f-4ae1-949e-f752c6cfe776,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a3942f0-4e')
Nov 08 04:38:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SYCvcmED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:38:05 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:38:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[23de6197-3fa7-48d2-bb58-e740120a4c0f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:38:05 user nova-compute[75014]: No targets found.
Nov 08 04:38:05 user nova-compute[75014]: iSNS:
Nov 08 04:38:05 user nova-compute[75014]: No targets found.
Nov 08 04:38:05 user nova-compute[75014]: STATIC:
Nov 08 04:38:05 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:38:05 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:38:05 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:38:05 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3
Nov 08 04:38:05 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:38:05 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:38:05 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1
Nov 08 04:38:05 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:38:05 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:38:05 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b
Nov 08 04:38:05 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:38:05 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:38:05 user nova-compute[75014]: FIRMWARE:
Nov 08 04:38:05 user nova-compute[75014]: No targets found.
Nov 08 04:38:05 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:38:05 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:38:05 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2addbb6-c8e8-42f2-ad67-8acaa582b5b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c80e655-5d62-4372-bbf1-9b70932118fc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:38:05 user nova-compute[75014]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)
Nov 08 04:38:05 user nova-compute[75014]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 (non-flash)
Nov 08 04:38:05 user nova-compute[75014]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1 (non-flash)
Nov 08 04:38:05 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:38:05 user nova-compute[75014]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)
Nov 08 04:38:05 user nova-compute[75014]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 (non-flash)
Nov 08 04:38:05 user nova-compute[75014]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1 (non-flash)
Nov 08 04:38:05 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f03dc7c9900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3'): ({'sdc'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Removing single pathed devices sdc {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98003cd-504d-49a7-ae02-00884d4cd400]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a539bffd-60c0-4a2a-8d6f-c3fa5e58495e]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Flushing IO for device /dev/sdc {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[db501687-eeba-4538-8d93-5584213b33f4]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7653bffb-353d-42ef-9148-9739057261f0]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] SCSI volumes sdc have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[70620ace-5799-4be9-8e49-83ecabc1eb0c]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a090c9-998f-419a-afc7-6626d5e2bd91]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3, portal: 172.16.0.220,3260]
Nov 08 04:38:05 user nova-compute[75014]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3, portal: 172.16.0.220,3260] successful.
Nov 08 04:38:05 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afd9ba1c-3745-4256-815f-1fb9bba5dcd3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0198adf8-1c4a-4cfa-8f54-9cd0165e3061]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] <== disconnect_volume: return (345ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:38:05 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Deleting instance files /opt/stack/data/nova/instances/6b195315-c96d-44db-841f-916230b2863f_del
Nov 08 04:38:05 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Deletion of /opt/stack/data/nova/instances/6b195315-c96d-44db-841f-916230b2863f_del complete
Nov 08 04:38:05 user nova-compute[75014]: INFO nova.compute.manager [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 08 04:38:05 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 6b195315-c96d-44db-841f-916230b2863f] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:38:05 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 6b195315-c96d-44db-841f-916230b2863f] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:38:06 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:38:06 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 6b195315-c96d-44db-841f-916230b2863f] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:38:06 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 6b195315-c96d-44db-841f-916230b2863f] Took 0.78 seconds to deallocate network for instance.
Nov 08 04:38:06 user nova-compute[75014]: DEBUG nova.compute.manager [req-aef8aa51-ca47-4545-90d7-aa2dfee6bf20 req-71d21611-a843-4be7-bdf5-ea8aeda6c077 service nova] [instance: 6b195315-c96d-44db-841f-916230b2863f] Received event network-vif-unplugged-5a3942f0-4e0f-4ae1-949e-f752c6cfe776 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:38:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-aef8aa51-ca47-4545-90d7-aa2dfee6bf20 req-71d21611-a843-4be7-bdf5-ea8aeda6c077 service nova] Acquiring lock "6b195315-c96d-44db-841f-916230b2863f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:38:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-aef8aa51-ca47-4545-90d7-aa2dfee6bf20 req-71d21611-a843-4be7-bdf5-ea8aeda6c077 service nova] Lock "6b195315-c96d-44db-841f-916230b2863f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:38:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-aef8aa51-ca47-4545-90d7-aa2dfee6bf20 req-71d21611-a843-4be7-bdf5-ea8aeda6c077 service nova] Lock "6b195315-c96d-44db-841f-916230b2863f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:38:06 user nova-compute[75014]: DEBUG nova.compute.manager [req-aef8aa51-ca47-4545-90d7-aa2dfee6bf20 req-71d21611-a843-4be7-bdf5-ea8aeda6c077 service nova] [instance: 6b195315-c96d-44db-841f-916230b2863f] No waiting events found dispatching network-vif-unplugged-5a3942f0-4e0f-4ae1-949e-f752c6cfe776 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:38:06 user nova-compute[75014]: DEBUG nova.compute.manager [req-aef8aa51-ca47-4545-90d7-aa2dfee6bf20 req-71d21611-a843-4be7-bdf5-ea8aeda6c077 service nova] [instance: 6b195315-c96d-44db-841f-916230b2863f] Received event network-vif-unplugged-5a3942f0-4e0f-4ae1-949e-f752c6cfe776 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:38:06 user nova-compute[75014]: DEBUG nova.compute.manager [req-aef8aa51-ca47-4545-90d7-aa2dfee6bf20 req-71d21611-a843-4be7-bdf5-ea8aeda6c077 service nova] [instance: 6b195315-c96d-44db-841f-916230b2863f] Received event network-vif-plugged-5a3942f0-4e0f-4ae1-949e-f752c6cfe776 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:38:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-aef8aa51-ca47-4545-90d7-aa2dfee6bf20 req-71d21611-a843-4be7-bdf5-ea8aeda6c077 service nova] Acquiring lock "6b195315-c96d-44db-841f-916230b2863f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:38:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-aef8aa51-ca47-4545-90d7-aa2dfee6bf20 req-71d21611-a843-4be7-bdf5-ea8aeda6c077 service nova] Lock "6b195315-c96d-44db-841f-916230b2863f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:38:06 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-aef8aa51-ca47-4545-90d7-aa2dfee6bf20 req-71d21611-a843-4be7-bdf5-ea8aeda6c077 service nova] Lock "6b195315-c96d-44db-841f-916230b2863f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:38:06 user nova-compute[75014]: DEBUG nova.compute.manager [req-aef8aa51-ca47-4545-90d7-aa2dfee6bf20 req-71d21611-a843-4be7-bdf5-ea8aeda6c077 service nova] [instance: 6b195315-c96d-44db-841f-916230b2863f] No waiting events found dispatching network-vif-plugged-5a3942f0-4e0f-4ae1-949e-f752c6cfe776 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:38:06 user nova-compute[75014]: WARNING nova.compute.manager [req-aef8aa51-ca47-4545-90d7-aa2dfee6bf20 req-71d21611-a843-4be7-bdf5-ea8aeda6c077 service nova] [instance: 6b195315-c96d-44db-841f-916230b2863f] Received unexpected event network-vif-plugged-5a3942f0-4e0f-4ae1-949e-f752c6cfe776 for instance with vm_state active and task_state deleting.
Nov 08 04:38:06 user nova-compute[75014]: DEBUG nova.compute.manager [req-36a0d929-923d-42af-868b-df00313ca030 req-244e3185-e33a-4bad-865c-910781872736 service nova] [instance: 6b195315-c96d-44db-841f-916230b2863f] Received event network-vif-deleted-5a3942f0-4e0f-4ae1-949e-f752c6cfe776 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:38:07 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:38:07 user nova-compute[75014]: INFO nova.compute.manager [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: 6b195315-c96d-44db-841f-916230b2863f] Took 1.17 seconds to detach 1 volumes for instance.
Nov 08 04:38:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:38:07 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:38:08 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:38:08 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:38:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.191s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:38:08 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Deleted allocations for instance 6b195315-c96d-44db-841f-916230b2863f
Nov 08 04:38:08 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-2a9dec7b-846b-4cfd-8034-0c9ae0d48993 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "6b195315-c96d-44db-841f-916230b2863f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.503s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:38:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:38:09 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07 is timed out.
Nov 08 04:38:09 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Successfully detached device vdb from instance 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07 from the live domain config.
Nov 08 04:38:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjtXpbLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:38:09 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:38:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[232c4d78-75dc-4d22-adbe-c55d3d870b49]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:38:09 user nova-compute[75014]: No targets found.
Nov 08 04:38:09 user nova-compute[75014]: iSNS:
Nov 08 04:38:09 user nova-compute[75014]: No targets found.
Nov 08 04:38:09 user nova-compute[75014]: STATIC:
Nov 08 04:38:09 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:38:09 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:38:09 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:38:09 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1
Nov 08 04:38:09 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:38:09 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:38:09 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b
Nov 08 04:38:09 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:38:09 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:38:09 user nova-compute[75014]: FIRMWARE:
Nov 08 04:38:09 user nova-compute[75014]: No targets found.
Nov 08 04:38:09 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:38:09 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:38:09 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd59c80-0dec-4773-8841-aa2c174db994]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d769b2f-9fe2-46f9-b939-e937e884c4ac]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1 (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:38:09 user nova-compute[75014]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)
Nov 08 04:38:09 user nova-compute[75014]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1 (non-flash)
Nov 08 04:38:09 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:38:09 user nova-compute[75014]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)
Nov 08 04:38:09 user nova-compute[75014]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1 (non-flash)
Nov 08 04:38:09 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0400745e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1'): ({'sdd'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Removing single pathed devices sdd {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca23a8d8-d876-4f64-8c2f-fad7fe50725d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c2cb1e-0bda-42f4-bd39-85c6a48e40b5]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Flushing IO for device /dev/sdd {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d202cb2-0466-42bd-8f01-6a6084c0d4cd]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[78268b4b-7698-42de-a21c-e841630a9232]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] SCSI volumes sdd have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fc5fb5-1177-4375-9a2e-2f8aa0e2b71f]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1 -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[116f4796-5ca0-42bc-b82d-e5ce656d8362]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1, portal: 172.16.0.220,3260]
Nov 08 04:38:09 user nova-compute[75014]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1, portal: 172.16.0.220,3260] successful.
Nov 08 04:38:09 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1 -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:157664c7-9978-4b66-843b-d636e68467d1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb50ebf-5902-49b4-ac15-1734d42fe57f]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] <== disconnect_volume: return (306ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:38:09 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:38:10 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:38:10 user nova-compute[75014]: DEBUG nova.objects.instance [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lazy-loading 'flavor' on Instance uuid 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:38:10 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-f5ceaba3-5704-438e-9c45-572d7f8866f5 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.800s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:38:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:38:14 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:38:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:38:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:38:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:38:14 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:38:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:38:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:38:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:38:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07/disk --force-share --output=json {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:38:14 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:38:15 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:38:15 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:38:15 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=8827MB free_disk=24.857624053955078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:38:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:38:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:38:15 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance fed0b54e-44cc-4f01-9511-e1993dcd4cec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:38:15 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:38:15 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:38:15 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:38:15 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:38:15 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:38:15 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:38:15 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:38:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:38:16 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:38:17 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:38:17 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:38:20 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:38:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:38:30 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:38:35 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:38:40 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:38:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:38:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-836b4757-c474-4d9d-95ef-c6d32821fb23 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Acquiring lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:38:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-836b4757-c474-4d9d-95ef-c6d32821fb23 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:38:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-836b4757-c474-4d9d-95ef-c6d32821fb23 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Acquiring lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:38:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-836b4757-c474-4d9d-95ef-c6d32821fb23 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:38:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-836b4757-c474-4d9d-95ef-c6d32821fb23 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:38:49 user nova-compute[75014]: INFO nova.compute.manager [None req-836b4757-c474-4d9d-95ef-c6d32821fb23 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Terminating instance
Nov 08 04:38:49 user nova-compute[75014]: DEBUG nova.compute.manager [None req-836b4757-c474-4d9d-95ef-c6d32821fb23 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:38:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:38:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:38:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:38:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:38:49 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:38:49 user nova-compute[75014]: DEBUG nova.compute.manager [req-bc19f36b-0431-4b82-9a06-d98ecbf2811b req-75a604f5-2e55-4f19-8e9f-05878fde2220 service nova] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Received event network-vif-unplugged-2e81125e-06f2-4011-a714-6b34ce099a10 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:38:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-bc19f36b-0431-4b82-9a06-d98ecbf2811b req-75a604f5-2e55-4f19-8e9f-05878fde2220 service nova] Acquiring lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:38:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-bc19f36b-0431-4b82-9a06-d98ecbf2811b req-75a604f5-2e55-4f19-8e9f-05878fde2220 service nova] Lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:38:49 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-bc19f36b-0431-4b82-9a06-d98ecbf2811b req-75a604f5-2e55-4f19-8e9f-05878fde2220 service nova] Lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:38:49 user nova-compute[75014]: DEBUG nova.compute.manager [req-bc19f36b-0431-4b82-9a06-d98ecbf2811b req-75a604f5-2e55-4f19-8e9f-05878fde2220 service nova] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] No waiting events found dispatching network-vif-unplugged-2e81125e-06f2-4011-a714-6b34ce099a10 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:38:49 user nova-compute[75014]: DEBUG nova.compute.manager [req-bc19f36b-0431-4b82-9a06-d98ecbf2811b req-75a604f5-2e55-4f19-8e9f-05878fde2220 service nova] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Received event network-vif-unplugged-2e81125e-06f2-4011-a714-6b34ce099a10 for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:38:50 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Instance destroyed successfully.
Nov 08 04:38:50 user nova-compute[75014]: DEBUG nova.objects.instance [None req-836b4757-c474-4d9d-95ef-c6d32821fb23 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lazy-loading 'resources' on Instance uuid 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07 {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:38:50 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-836b4757-c474-4d9d-95ef-c6d32821fb23 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1789059580',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1789059580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1789059',id=51,image_ref='877f8699-2084-427a-babd-cf4f98c3b417',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgLGanremm00ChZu/k1iiX8r8HpcG9nR1ezfm8vxs7CsjTdD23nGKBkkh/RQQmZf6kRBwQQGnSOKL9fEi3VH4P52BXPFHz9+7OMbGe7NvuMSHnoZ0i3ju8XvzwQGtzGCA==',key_name='tempest-keypair-1217157374',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:35:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4c156c92af64200879b568edc1eb84b',ramdisk_id='',reservation_id='r-7kdpgh7f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='877f8699-2084-427a-babd-cf4f98c3b417',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1619007514',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:35:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6c6fe73b52d4f72b92036c131288422',uuid=0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e81125e-06f2-4011-a714-6b34ce099a10", "address": "fa:16:3e:6b:75:31", "network": {"id": "f501c5fe-ea0d-4a7f-bf09-20ea559e620f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-715561519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c156c92af64200879b568edc1eb84b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e81125e-06", "ovs_interfaceid": "2e81125e-06f2-4011-a714-6b34ce099a10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:38:50 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-836b4757-c474-4d9d-95ef-c6d32821fb23 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Converting VIF {"id": "2e81125e-06f2-4011-a714-6b34ce099a10", "address": "fa:16:3e:6b:75:31", "network": {"id": "f501c5fe-ea0d-4a7f-bf09-20ea559e620f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-715561519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c156c92af64200879b568edc1eb84b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e81125e-06", "ovs_interfaceid": "2e81125e-06f2-4011-a714-6b34ce099a10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:38:50 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-836b4757-c474-4d9d-95ef-c6d32821fb23 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:75:31,bridge_name='br-int',has_traffic_filtering=True,id=2e81125e-06f2-4011-a714-6b34ce099a10,network=Network(f501c5fe-ea0d-4a7f-bf09-20ea559e620f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e81125e-06') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:38:50 user nova-compute[75014]: DEBUG os_vif [None req-836b4757-c474-4d9d-95ef-c6d32821fb23 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:75:31,bridge_name='br-int',has_traffic_filtering=True,id=2e81125e-06f2-4011-a714-6b34ce099a10,network=Network(f501c5fe-ea0d-4a7f-bf09-20ea559e620f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e81125e-06') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:38:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:38:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e81125e-06, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:38:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:38:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:38:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:38:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d20a53a-178b-42d0-9327-05fac830ecbd) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:38:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:38:50 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:38:50 user nova-compute[75014]: INFO os_vif [None req-836b4757-c474-4d9d-95ef-c6d32821fb23 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:75:31,bridge_name='br-int',has_traffic_filtering=True,id=2e81125e-06f2-4011-a714-6b34ce099a10,network=Network(f501c5fe-ea0d-4a7f-bf09-20ea559e620f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e81125e-06')
Nov 08 04:38:50 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-836b4757-c474-4d9d-95ef-c6d32821fb23 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Deleting instance files /opt/stack/data/nova/instances/0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07_del
Nov 08 04:38:50 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-836b4757-c474-4d9d-95ef-c6d32821fb23 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Deletion of /opt/stack/data/nova/instances/0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07_del complete
Nov 08 04:38:50 user nova-compute[75014]: INFO nova.compute.manager [None req-836b4757-c474-4d9d-95ef-c6d32821fb23 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 08 04:38:50 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-836b4757-c474-4d9d-95ef-c6d32821fb23 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:38:50 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:38:50 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:38:51 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:38:51 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Took 0.98 seconds to deallocate network for instance.
Nov 08 04:38:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-836b4757-c474-4d9d-95ef-c6d32821fb23 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:38:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-836b4757-c474-4d9d-95ef-c6d32821fb23 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:38:51 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-836b4757-c474-4d9d-95ef-c6d32821fb23 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:38:51 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-836b4757-c474-4d9d-95ef-c6d32821fb23 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:38:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-836b4757-c474-4d9d-95ef-c6d32821fb23 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:38:51 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-836b4757-c474-4d9d-95ef-c6d32821fb23 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Deleted allocations for instance 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07
Nov 08 04:38:51 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-836b4757-c474-4d9d-95ef-c6d32821fb23 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514 tempest-TestServerVolumeAttachScenarioOldVersion-1619007514-project-member] Lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.230s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:38:52 user nova-compute[75014]: DEBUG nova.compute.manager [req-dcc5b1b9-de3c-4422-aac1-ef9fad665d5c req-863cf0a5-a5e9-4be5-b0fe-f34ea7f0ee92 service nova] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Received event network-vif-plugged-2e81125e-06f2-4011-a714-6b34ce099a10 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:38:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dcc5b1b9-de3c-4422-aac1-ef9fad665d5c req-863cf0a5-a5e9-4be5-b0fe-f34ea7f0ee92 service nova] Acquiring lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:38:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dcc5b1b9-de3c-4422-aac1-ef9fad665d5c req-863cf0a5-a5e9-4be5-b0fe-f34ea7f0ee92 service nova] Lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:38:52 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-dcc5b1b9-de3c-4422-aac1-ef9fad665d5c req-863cf0a5-a5e9-4be5-b0fe-f34ea7f0ee92 service nova] Lock "0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:38:52 user nova-compute[75014]: DEBUG nova.compute.manager [req-dcc5b1b9-de3c-4422-aac1-ef9fad665d5c req-863cf0a5-a5e9-4be5-b0fe-f34ea7f0ee92 service nova] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] No waiting events found dispatching network-vif-plugged-2e81125e-06f2-4011-a714-6b34ce099a10 {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:38:52 user nova-compute[75014]: WARNING nova.compute.manager [req-dcc5b1b9-de3c-4422-aac1-ef9fad665d5c req-863cf0a5-a5e9-4be5-b0fe-f34ea7f0ee92 service nova] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Received unexpected event network-vif-plugged-2e81125e-06f2-4011-a714-6b34ce099a10 for instance with vm_state deleted and task_state None.
Nov 08 04:38:52 user nova-compute[75014]: DEBUG nova.compute.manager [req-dcc5b1b9-de3c-4422-aac1-ef9fad665d5c req-863cf0a5-a5e9-4be5-b0fe-f34ea7f0ee92 service nova] [instance: 0e343ee3-a0c4-47b0-b61b-a0f1d6c82a07] Received event network-vif-deleted-2e81125e-06f2-4011-a714-6b34ce099a10 {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:38:55 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:38:56 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:38:56 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:38:56 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Didn't find any instances for network info cache update. {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 04:39:00 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:39:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:39:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:39:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:39:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:39:00 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:02 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:39:05 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:07 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:39:09 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:39:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:39:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:39:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:39:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:39:10 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:11 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:39:14 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:39:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:39:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:39:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:39:14 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:39:14 user nova-compute[75014]: DEBUG nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75014) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 04:39:14 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:39:14 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:39:14 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=8961MB free_disk=24.876789093017578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:39:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:39:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:39:14 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Instance fed0b54e-44cc-4f01-9511-e1993dcd4cec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75014) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 04:39:14 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:39:14 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:39:14 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:39:14 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:39:14 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:39:14 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:39:15 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:15 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:39:17 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:39:17 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:39:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:17 user nova-compute[75014]: DEBUG nova.compute.manager [req-69c16212-ffff-4623-a8bd-de99c00cba82 req-159507b9-e08a-4f00-97c0-b422092e4d0f service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Received event network-changed-1caab5fb-eb55-48f9-8ede-4cc4f90546ae {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:39:17 user nova-compute[75014]: DEBUG nova.compute.manager [req-69c16212-ffff-4623-a8bd-de99c00cba82 req-159507b9-e08a-4f00-97c0-b422092e4d0f service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Refreshing instance network info cache due to event network-changed-1caab5fb-eb55-48f9-8ede-4cc4f90546ae. {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 04:39:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-69c16212-ffff-4623-a8bd-de99c00cba82 req-159507b9-e08a-4f00-97c0-b422092e4d0f service nova] Acquiring lock "refresh_cache-fed0b54e-44cc-4f01-9511-e1993dcd4cec" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 04:39:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-69c16212-ffff-4623-a8bd-de99c00cba82 req-159507b9-e08a-4f00-97c0-b422092e4d0f service nova] Acquired lock "refresh_cache-fed0b54e-44cc-4f01-9511-e1993dcd4cec" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 04:39:17 user nova-compute[75014]: DEBUG nova.network.neutron [req-69c16212-ffff-4623-a8bd-de99c00cba82 req-159507b9-e08a-4f00-97c0-b422092e4d0f service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Refreshing network info cache for port 1caab5fb-eb55-48f9-8ede-4cc4f90546ae {{(pid=75014) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 04:39:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:39:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:39:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:39:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:39:17 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:39:17 user nova-compute[75014]: INFO nova.compute.manager [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Terminating instance
Nov 08 04:39:17 user nova-compute[75014]: DEBUG nova.compute.manager [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Start destroying the instance on the hypervisor. {{(pid=75014) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 04:39:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:17 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG nova.compute.manager [req-961898de-587a-4387-b0e3-05f48536fc58 req-04ad0524-6b42-485f-9605-a174faea3e50 service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Received event network-vif-unplugged-1caab5fb-eb55-48f9-8ede-4cc4f90546ae {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-961898de-587a-4387-b0e3-05f48536fc58 req-04ad0524-6b42-485f-9605-a174faea3e50 service nova] Acquiring lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-961898de-587a-4387-b0e3-05f48536fc58 req-04ad0524-6b42-485f-9605-a174faea3e50 service nova] Lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-961898de-587a-4387-b0e3-05f48536fc58 req-04ad0524-6b42-485f-9605-a174faea3e50 service nova] Lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG nova.compute.manager [req-961898de-587a-4387-b0e3-05f48536fc58 req-04ad0524-6b42-485f-9605-a174faea3e50 service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] No waiting events found dispatching network-vif-unplugged-1caab5fb-eb55-48f9-8ede-4cc4f90546ae {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG nova.compute.manager [req-961898de-587a-4387-b0e3-05f48536fc58 req-04ad0524-6b42-485f-9605-a174faea3e50 service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Received event network-vif-unplugged-1caab5fb-eb55-48f9-8ede-4cc4f90546ae for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG nova.network.neutron [req-69c16212-ffff-4623-a8bd-de99c00cba82 req-159507b9-e08a-4f00-97c0-b422092e4d0f service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Updated VIF entry in instance network info cache for port 1caab5fb-eb55-48f9-8ede-4cc4f90546ae. {{(pid=75014) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG nova.network.neutron [req-69c16212-ffff-4623-a8bd-de99c00cba82 req-159507b9-e08a-4f00-97c0-b422092e4d0f service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Updating instance_info_cache with network_info: [{"id": "1caab5fb-eb55-48f9-8ede-4cc4f90546ae", "address": "fa:16:3e:ae:c8:4f", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1caab5fb-eb", "ovs_interfaceid": "1caab5fb-eb55-48f9-8ede-4cc4f90546ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-69c16212-ffff-4623-a8bd-de99c00cba82 req-159507b9-e08a-4f00-97c0-b422092e4d0f service nova] Releasing lock "refresh_cache-fed0b54e-44cc-4f01-9511-e1993dcd4cec" {{(pid=75014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:18 user nova-compute[75014]: INFO nova.virt.libvirt.driver [-] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Instance destroyed successfully.
Nov 08 04:39:18 user nova-compute[75014]: DEBUG nova.objects.instance [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lazy-loading 'resources' on Instance uuid fed0b54e-44cc-4f01-9511-e1993dcd4cec {{(pid=75014) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG nova.virt.libvirt.vif [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T04:34:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-439402672',display_name='tempest-TestVolumeBootPattern-server-439402672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-439402672',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmCKJe2YKVTcf+XoP5PTLw5G8CWIzWuvlg190P9zWQdP0YW5BGT2gToDF2MbQudSeOvT17m8Vr6JpTpU4CWFLr0k+Sf3aulZ0b8jpBbd3H85eZBlYCQoTRoOdK8wj8DqQ==',key_name='tempest-TestVolumeBootPattern-1541162844',keypairs=<?>,launch_index=0,launched_at=2023-11-08T04:34:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='504ed2858e78480e9beef5aa5f5d9f1d',ramdisk_id='',reservation_id='r-ru4udg3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2082374398',owner_user_name='tempest-TestVolumeBootPattern-2082374398-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T04:34:33Z,user_data=None,user_id='fe1c5af56ab14da7986d64e38597d394',uuid=fed0b54e-44cc-4f01-9511-e1993dcd4cec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1caab5fb-eb55-48f9-8ede-4cc4f90546ae", "address": "fa:16:3e:ae:c8:4f", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1caab5fb-eb", "ovs_interfaceid": "1caab5fb-eb55-48f9-8ede-4cc4f90546ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converting VIF {"id": "1caab5fb-eb55-48f9-8ede-4cc4f90546ae", "address": "fa:16:3e:ae:c8:4f", "network": {"id": "0eb9b9db-15e7-48ae-b893-99f432c02213", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1597950762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "504ed2858e78480e9beef5aa5f5d9f1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1caab5fb-eb", "ovs_interfaceid": "1caab5fb-eb55-48f9-8ede-4cc4f90546ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG nova.network.os_vif_util [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:c8:4f,bridge_name='br-int',has_traffic_filtering=True,id=1caab5fb-eb55-48f9-8ede-4cc4f90546ae,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1caab5fb-eb') {{(pid=75014) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG os_vif [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:c8:4f,bridge_name='br-int',has_traffic_filtering=True,id=1caab5fb-eb55-48f9-8ede-4cc4f90546ae,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1caab5fb-eb') {{(pid=75014) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1caab5fb-eb, bridge=br-int, if_exists=True) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=92f2deb7-2e42-4e95-b288-a499e2bb3a21) {{(pid=75014) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:18 user nova-compute[75014]: INFO os_vif [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:c8:4f,bridge_name='br-int',has_traffic_filtering=True,id=1caab5fb-eb55-48f9-8ede-4cc4f90546ae,network=Network(0eb9b9db-15e7-48ae-b893-99f432c02213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1caab5fb-eb')
Nov 08 04:39:18 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] calling os-brick to detach iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f04201338e0>, {'target_iqn': 'iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwosdxTI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 04:39:18 user nova-compute[75014]: WARNING os_brick.initiator.connectors.base [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 04:39:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3913dfa-6eaa-431d-b4d6-209605f1e2f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 04:39:18 user nova-compute[75014]: No targets found.
Nov 08 04:39:18 user nova-compute[75014]: iSNS:
Nov 08 04:39:18 user nova-compute[75014]: No targets found.
Nov 08 04:39:18 user nova-compute[75014]: STATIC:
Nov 08 04:39:18 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06
Nov 08 04:39:18 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:39:18 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:39:18 user nova-compute[75014]: Target: iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b
Nov 08 04:39:18 user nova-compute[75014]:         Portal: 172.16.0.220:3260,-1
Nov 08 04:39:18 user nova-compute[75014]:                 Iface Name: default
Nov 08 04:39:18 user nova-compute[75014]: FIRMWARE:
Nov 08 04:39:18 user nova-compute[75014]: No targets found.
Nov 08 04:39:18 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 04:39:18 user nova-compute[75014]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 04:39:18 user nova-compute[75014]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75014) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b', 0)] {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f44a405-9f70-4bcd-aa83-b3514d35b075]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cb3e5c-380e-47d1-b97f-140f4ad813a2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:39:18 user nova-compute[75014]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)
Nov 08 04:39:18 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735a233b-2c2f-4d50-99ea-9f457c541f06 (non-flash)
Nov 08 04:39:18 user nova-compute[75014]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b (non-flash)
Nov 08 04:39:18 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f03dc7bdab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b'): ({'sdb'}, set())}) {{(pid=75014) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Removing single pathed devices sdb {{(pid=75014) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fae35cc-0321-4305-b7c0-17647a9bf917]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a3e1ac-5ea5-415e-a1f8-f16e86dbac61]: (4, ('ok\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Flushing IO for device /dev/sdb {{(pid=75014) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f9f542-a85a-4a24-b52c-fe3bbc9b63e1]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75014) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ec4e0a-517f-4ba9-b348-1f762740b1c3]: (4, ('1', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG os_brick.initiator.linuxscsi [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] SCSI volumes sdb have been removed. {{(pid=75014) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOcf225f40-159e090576e95c25', '/dev/disk/by-id/scsi-23135396530393035', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_cf225f40') {{(pid=86544) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f918dbcb-de1c-4709-b8b0-684b831e4a54]: (4, None) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b')] {{(pid=75014) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7352a65-15c3-4d6e-8a15-d1c8b3fcb1b6]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --logout {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[107f7bb4-e9a0-4fd1-985c-0b09816a69ce]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b, portal: 172.16.0.220,3260]
Nov 08 04:39:18 user nova-compute[75014]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b, portal: 172.16.0.220,3260] successful.
Nov 08 04:39:18 user nova-compute[75014]:  stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:39:18 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --op delete {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 04:39:19 user nova-compute[75014]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e113de3-d43d-4e7d-9504-f6e36e86b93b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86544) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 04:39:19 user nova-compute[75014]: DEBUG oslo.privsep.daemon [-] privsep: reply[36089e43-412e-46f9-a3f6-4d5c678436ad]: (4, ('', '')) {{(pid=86544) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 04:39:19 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75014) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 04:39:19 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.base [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 04:39:19 user nova-compute[75014]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] <== disconnect_volume: return (330ms) None {{(pid=75014) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 04:39:19 user nova-compute[75014]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Disconnected iSCSI Volume {{(pid=75014) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 04:39:19 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Deleting instance files /opt/stack/data/nova/instances/fed0b54e-44cc-4f01-9511-e1993dcd4cec_del
Nov 08 04:39:19 user nova-compute[75014]: INFO nova.virt.libvirt.driver [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Deletion of /opt/stack/data/nova/instances/fed0b54e-44cc-4f01-9511-e1993dcd4cec_del complete
Nov 08 04:39:19 user nova-compute[75014]: INFO nova.compute.manager [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 08 04:39:19 user nova-compute[75014]: DEBUG oslo.service.loopingcall [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75014) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 04:39:19 user nova-compute[75014]: DEBUG nova.compute.manager [-] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Deallocating network for instance {{(pid=75014) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 04:39:19 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] deallocate_for_instance() {{(pid=75014) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 04:39:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:19 user nova-compute[75014]: DEBUG nova.network.neutron [-] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:39:19 user nova-compute[75014]: INFO nova.compute.manager [-] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Took 0.52 seconds to deallocate network for instance.
Nov 08 04:39:19 user nova-compute[75014]: DEBUG nova.compute.manager [req-5f3986aa-b71f-4f10-8fb5-1671282dd508 req-fe1266ad-2a59-4921-a171-51bbb069846b service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Received event network-vif-deleted-1caab5fb-eb55-48f9-8ede-4cc4f90546ae {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:39:19 user nova-compute[75014]: INFO nova.compute.manager [req-5f3986aa-b71f-4f10-8fb5-1671282dd508 req-fe1266ad-2a59-4921-a171-51bbb069846b service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Neutron deleted interface 1caab5fb-eb55-48f9-8ede-4cc4f90546ae; detaching it from the instance and deleting it from the info cache
Nov 08 04:39:19 user nova-compute[75014]: DEBUG nova.network.neutron [req-5f3986aa-b71f-4f10-8fb5-1671282dd508 req-fe1266ad-2a59-4921-a171-51bbb069846b service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Updating instance_info_cache with network_info: [] {{(pid=75014) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 04:39:19 user nova-compute[75014]: DEBUG nova.compute.manager [req-5f3986aa-b71f-4f10-8fb5-1671282dd508 req-fe1266ad-2a59-4921-a171-51bbb069846b service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Detach interface failed, port_id=1caab5fb-eb55-48f9-8ede-4cc4f90546ae, reason: Instance fed0b54e-44cc-4f01-9511-e1993dcd4cec could not be found. {{(pid=75014) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 04:39:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-f693335c-ce54-48c4-bafa-117f622df750 req-6dfceceb-a932-402d-8369-6bd87375aad5 service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Received event network-vif-plugged-1caab5fb-eb55-48f9-8ede-4cc4f90546ae {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:39:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f693335c-ce54-48c4-bafa-117f622df750 req-6dfceceb-a932-402d-8369-6bd87375aad5 service nova] Acquiring lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:39:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f693335c-ce54-48c4-bafa-117f622df750 req-6dfceceb-a932-402d-8369-6bd87375aad5 service nova] Lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:39:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f693335c-ce54-48c4-bafa-117f622df750 req-6dfceceb-a932-402d-8369-6bd87375aad5 service nova] Lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:39:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-f693335c-ce54-48c4-bafa-117f622df750 req-6dfceceb-a932-402d-8369-6bd87375aad5 service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] No waiting events found dispatching network-vif-plugged-1caab5fb-eb55-48f9-8ede-4cc4f90546ae {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:39:20 user nova-compute[75014]: WARNING nova.compute.manager [req-f693335c-ce54-48c4-bafa-117f622df750 req-6dfceceb-a932-402d-8369-6bd87375aad5 service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Received unexpected event network-vif-plugged-1caab5fb-eb55-48f9-8ede-4cc4f90546ae for instance with vm_state active and task_state deleting.
Nov 08 04:39:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-f693335c-ce54-48c4-bafa-117f622df750 req-6dfceceb-a932-402d-8369-6bd87375aad5 service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Received event network-vif-plugged-1caab5fb-eb55-48f9-8ede-4cc4f90546ae {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:39:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f693335c-ce54-48c4-bafa-117f622df750 req-6dfceceb-a932-402d-8369-6bd87375aad5 service nova] Acquiring lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:39:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f693335c-ce54-48c4-bafa-117f622df750 req-6dfceceb-a932-402d-8369-6bd87375aad5 service nova] Lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:39:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f693335c-ce54-48c4-bafa-117f622df750 req-6dfceceb-a932-402d-8369-6bd87375aad5 service nova] Lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:39:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-f693335c-ce54-48c4-bafa-117f622df750 req-6dfceceb-a932-402d-8369-6bd87375aad5 service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] No waiting events found dispatching network-vif-plugged-1caab5fb-eb55-48f9-8ede-4cc4f90546ae {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:39:20 user nova-compute[75014]: WARNING nova.compute.manager [req-f693335c-ce54-48c4-bafa-117f622df750 req-6dfceceb-a932-402d-8369-6bd87375aad5 service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Received unexpected event network-vif-plugged-1caab5fb-eb55-48f9-8ede-4cc4f90546ae for instance with vm_state active and task_state deleting.
Nov 08 04:39:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-f693335c-ce54-48c4-bafa-117f622df750 req-6dfceceb-a932-402d-8369-6bd87375aad5 service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Received event network-vif-plugged-1caab5fb-eb55-48f9-8ede-4cc4f90546ae {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:39:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f693335c-ce54-48c4-bafa-117f622df750 req-6dfceceb-a932-402d-8369-6bd87375aad5 service nova] Acquiring lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:39:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f693335c-ce54-48c4-bafa-117f622df750 req-6dfceceb-a932-402d-8369-6bd87375aad5 service nova] Lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:39:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f693335c-ce54-48c4-bafa-117f622df750 req-6dfceceb-a932-402d-8369-6bd87375aad5 service nova] Lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:39:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-f693335c-ce54-48c4-bafa-117f622df750 req-6dfceceb-a932-402d-8369-6bd87375aad5 service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] No waiting events found dispatching network-vif-plugged-1caab5fb-eb55-48f9-8ede-4cc4f90546ae {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:39:20 user nova-compute[75014]: WARNING nova.compute.manager [req-f693335c-ce54-48c4-bafa-117f622df750 req-6dfceceb-a932-402d-8369-6bd87375aad5 service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Received unexpected event network-vif-plugged-1caab5fb-eb55-48f9-8ede-4cc4f90546ae for instance with vm_state active and task_state deleting.
Nov 08 04:39:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-f693335c-ce54-48c4-bafa-117f622df750 req-6dfceceb-a932-402d-8369-6bd87375aad5 service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Received event network-vif-unplugged-1caab5fb-eb55-48f9-8ede-4cc4f90546ae {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:39:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f693335c-ce54-48c4-bafa-117f622df750 req-6dfceceb-a932-402d-8369-6bd87375aad5 service nova] Acquiring lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:39:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f693335c-ce54-48c4-bafa-117f622df750 req-6dfceceb-a932-402d-8369-6bd87375aad5 service nova] Lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:39:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f693335c-ce54-48c4-bafa-117f622df750 req-6dfceceb-a932-402d-8369-6bd87375aad5 service nova] Lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:39:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-f693335c-ce54-48c4-bafa-117f622df750 req-6dfceceb-a932-402d-8369-6bd87375aad5 service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] No waiting events found dispatching network-vif-unplugged-1caab5fb-eb55-48f9-8ede-4cc4f90546ae {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:39:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-f693335c-ce54-48c4-bafa-117f622df750 req-6dfceceb-a932-402d-8369-6bd87375aad5 service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Received event network-vif-unplugged-1caab5fb-eb55-48f9-8ede-4cc4f90546ae for instance with task_state deleting. {{(pid=75014) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 04:39:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-f693335c-ce54-48c4-bafa-117f622df750 req-6dfceceb-a932-402d-8369-6bd87375aad5 service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Received event network-vif-plugged-1caab5fb-eb55-48f9-8ede-4cc4f90546ae {{(pid=75014) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 04:39:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f693335c-ce54-48c4-bafa-117f622df750 req-6dfceceb-a932-402d-8369-6bd87375aad5 service nova] Acquiring lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:39:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f693335c-ce54-48c4-bafa-117f622df750 req-6dfceceb-a932-402d-8369-6bd87375aad5 service nova] Lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:39:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [req-f693335c-ce54-48c4-bafa-117f622df750 req-6dfceceb-a932-402d-8369-6bd87375aad5 service nova] Lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:39:20 user nova-compute[75014]: DEBUG nova.compute.manager [req-f693335c-ce54-48c4-bafa-117f622df750 req-6dfceceb-a932-402d-8369-6bd87375aad5 service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] No waiting events found dispatching network-vif-plugged-1caab5fb-eb55-48f9-8ede-4cc4f90546ae {{(pid=75014) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 04:39:20 user nova-compute[75014]: WARNING nova.compute.manager [req-f693335c-ce54-48c4-bafa-117f622df750 req-6dfceceb-a932-402d-8369-6bd87375aad5 service nova] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Received unexpected event network-vif-plugged-1caab5fb-eb55-48f9-8ede-4cc4f90546ae for instance with vm_state active and task_state deleting.
Nov 08 04:39:20 user nova-compute[75014]: INFO nova.compute.manager [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] [instance: fed0b54e-44cc-4f01-9511-e1993dcd4cec] Took 0.85 seconds to detach 1 volumes for instance.
Nov 08 04:39:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:39:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:39:20 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:39:20 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:39:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.106s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:39:20 user nova-compute[75014]: INFO nova.scheduler.client.report [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Deleted allocations for instance fed0b54e-44cc-4f01-9511-e1993dcd4cec
Nov 08 04:39:20 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-cf9ebda0-d771-4953-b6b0-806596c89863 tempest-TestVolumeBootPattern-2082374398 tempest-TestVolumeBootPattern-2082374398-project-member] Lock "fed0b54e-44cc-4f01-9511-e1993dcd4cec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.873s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:39:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:39:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:39:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:39:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:39:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:39:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:39:42 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:45 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:39:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:39:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:39:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:39:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:39:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:57 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:39:57 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:39:57 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Rebuilding the list of instances to heal {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 04:39:57 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Didn't find any instances for network info cache update. {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 04:39:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:39:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:39:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:39:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:39:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:39:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:40:01 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:40:03 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:40:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:40:08 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:40:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:40:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:40:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:40:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:40:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:40:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:40:11 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:40:11 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:40:13 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:40:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:40:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:40:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:40:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:40:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:40:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:40:16 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:40:16 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:40:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:40:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:40:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:40:16 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:40:16 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:40:16 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:40:16 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=9067MB free_disk=24.874858856201172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:40:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:40:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:40:16 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:40:16 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:40:16 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:40:16 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:40:16 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:40:16 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:40:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:40:18 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:40:18 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:40:19 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:40:22 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:40:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:40:25 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:40:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:40:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:40:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:40:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:40:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:40:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:40:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:40:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:40:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:40:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:40:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:40:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:40:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:40:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:40:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:40:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:40:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:40:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:40:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:40:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:40:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:40:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:40:59 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:40:59 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:40:59 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Rebuilding the list of instances to heal {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 04:40:59 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Didn't find any instances for network info cache update. {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 04:41:01 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:41:03 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:41:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:41:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:41:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:41:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:41:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:41:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:41:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:41:09 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:41:11 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:41:12 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:41:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:41:14 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:41:17 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:41:18 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:41:18 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:41:18 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:41:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:41:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:41:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:41:18 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:41:18 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:41:18 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:41:18 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=9155MB free_disk=24.873199462890625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:41:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:41:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:41:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:41:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:41:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:41:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:41:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:41:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:41:19 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:41:19 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:41:19 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Refreshing inventories for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 04:41:19 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Updating ProviderTree inventory for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 04:41:19 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Updating inventory in ProviderTree for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 04:41:19 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Refreshing aggregate associations for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0, aggregates: None {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 04:41:19 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Refreshing trait associations for resource provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE {{(pid=75014) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 04:41:19 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:41:19 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:41:19 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:41:19 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.500s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:41:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:41:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:41:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:41:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:41:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:41:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:41:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:41:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:41:35 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:41:35 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Cleaning up deleted instances {{(pid=75014) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 04:41:35 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] There are 0 instances to clean {{(pid=75014) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 04:41:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:41:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:41:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:41:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:41:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:41:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:41:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:41:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:41:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:41:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:41:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:41:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:41:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:41:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:41:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:41:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:41:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:41:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:41:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:41:56 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:41:56 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=75014) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 04:41:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:41:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:41:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:41:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:41:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:41:58 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:42:01 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:42:01 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Starting heal instance info cache {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 04:42:01 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Rebuilding the list of instances to heal {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 04:42:01 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Didn't find any instances for network info cache update. {{(pid=75014) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 04:42:02 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:42:03 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:42:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:42:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:42:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:42:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:42:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:42:03 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:42:08 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:42:10 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:42:12 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:42:13 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:42:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:42:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:42:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:42:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:42:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:42:13 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:42:15 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:42:17 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:42:18 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:42:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:42:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:42:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:42:18 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Auditing locally available compute resources for user (node: user) {{(pid=75014) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 04:42:18 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:42:18 user nova-compute[75014]: WARNING nova.virt.libvirt.driver [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 04:42:18 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Hypervisor/Node resource view: name=user free_ram=9177MB free_disk=24.871910095214844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75014) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 04:42:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 04:42:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 04:42:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:42:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:42:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75014) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 04:42:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:42:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75014) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 04:42:18 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:42:18 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 04:42:18 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75014) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 04:42:18 user nova-compute[75014]: DEBUG nova.compute.provider_tree [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed in ProviderTree for provider: 46f4e8be-6fb4-40ac-b067-370499bbfbf0 {{(pid=75014) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 04:42:18 user nova-compute[75014]: DEBUG nova.scheduler.client.report [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Inventory has not changed for provider 46f4e8be-6fb4-40ac-b067-370499bbfbf0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75014) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 04:42:18 user nova-compute[75014]: DEBUG nova.compute.resource_tracker [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Compute_service record updated for user:user {{(pid=75014) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 04:42:18 user nova-compute[75014]: DEBUG oslo_concurrency.lockutils [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.128s {{(pid=75014) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 04:42:19 user nova-compute[75014]: DEBUG oslo_service.periodic_task [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75014) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 04:42:19 user nova-compute[75014]: DEBUG nova.compute.manager [None req-4f6e2da4-9542-4526-9366-2d60ce92f6ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75014) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 04:42:23 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:42:28 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:42:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:42:33 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:42:38 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:42:43 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 04:42:48 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 04:42:53 user nova-compute[75014]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75014) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}